[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:09:45.131443 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:45497
I20260709 13:09:45.132985 28565 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:09:45.134091 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:45.150700 28572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:45.150816 28571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:45.151588 28574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:45.152123 28565 server_base.cc:1061] running on GCE node
I20260709 13:09:46.266295 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:46.266570 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:46.266782 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602586266754 us; error 0 us; skew 500 ppm
I20260709 13:09:46.267630 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:46.273065 28565 webserver.cc:533] Webserver started at http://127.27.229.126:46859/ using document root <none> and password file <none>
I20260709 13:09:46.274065 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:46.274307 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:46.274770 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:46.280673 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "ead9d43d71514fc6b7b9e88d863893c9"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-twc1"
I20260709 13:09:46.288878 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.005s
I20260709 13:09:46.294341 28580 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.295571 28565 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:46.295925 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "ead9d43d71514fc6b7b9e88d863893c9"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-twc1"
I20260709 13:09:46.296254 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:46.357187 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:46.358866 28565 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:09:46.359352 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:46.429606 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:45497
I20260709 13:09:46.429680 28631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:45497 every 8 connection(s)
I20260709 13:09:46.437461 28632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:46.459093 28632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9: Bootstrap starting.
I20260709 13:09:46.465009 28632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.467002 28632 log.cc:826] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9: Log is configured to *not* fsync() on all Append() calls
I20260709 13:09:46.472378 28632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9: No bootstrap required, opened a new log
I20260709 13:09:46.492952 28632 raft_consensus.cc:359] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead9d43d71514fc6b7b9e88d863893c9" member_type: VOTER }
I20260709 13:09:46.493528 28632 raft_consensus.cc:385] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.493796 28632 raft_consensus.cc:740] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ead9d43d71514fc6b7b9e88d863893c9, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.494753 28632 consensus_queue.cc:260] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead9d43d71514fc6b7b9e88d863893c9" member_type: VOTER }
I20260709 13:09:46.495234 28632 raft_consensus.cc:399] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:46.495538 28632 raft_consensus.cc:493] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:46.495869 28632 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.499981 28632 raft_consensus.cc:515] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead9d43d71514fc6b7b9e88d863893c9" member_type: VOTER }
I20260709 13:09:46.500736 28632 leader_election.cc:304] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ead9d43d71514fc6b7b9e88d863893c9; no voters: 
I20260709 13:09:46.502439 28632 leader_election.cc:290] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:46.502758 28635 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.505156 28635 raft_consensus.cc:697] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 1 LEADER]: Becoming Leader. State: Replica: ead9d43d71514fc6b7b9e88d863893c9, State: Running, Role: LEADER
I20260709 13:09:46.506103 28635 consensus_queue.cc:237] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead9d43d71514fc6b7b9e88d863893c9" member_type: VOTER }
I20260709 13:09:46.507172 28632 sys_catalog.cc:565] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:46.517354 28637 sys_catalog.cc:455] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ead9d43d71514fc6b7b9e88d863893c9. Latest consensus state: current_term: 1 leader_uuid: "ead9d43d71514fc6b7b9e88d863893c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead9d43d71514fc6b7b9e88d863893c9" member_type: VOTER } }
I20260709 13:09:46.517149 28636 sys_catalog.cc:455] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ead9d43d71514fc6b7b9e88d863893c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ead9d43d71514fc6b7b9e88d863893c9" member_type: VOTER } }
I20260709 13:09:46.517952 28637 sys_catalog.cc:458] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:46.518033 28636 sys_catalog.cc:458] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:46.520779 28644 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:46.532303 28644 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:46.534548 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:46.549315 28644 catalog_manager.cc:1383] Generated new cluster ID: 3834f88889c2454f84ff6438d608d4ff
I20260709 13:09:46.549657 28644 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:46.579906 28644 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:46.581506 28644 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:46.603765 28644 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9: Generated new TSK 0
I20260709 13:09:46.604763 28644 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:46.665462 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:46.673712 28654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.674916 28655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.678694 28657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.678848 28565 server_base.cc:1061] running on GCE node
I20260709 13:09:46.679654 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:46.679862 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:46.680049 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602586680027 us; error 0 us; skew 500 ppm
I20260709 13:09:46.680676 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:46.684924 28565 webserver.cc:533] Webserver started at http://127.27.229.65:36845/ using document root <none> and password file <none>
I20260709 13:09:46.685483 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:46.685674 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:46.685992 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:46.687150 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "73d37edb634141d6b6dbb8df5522a819"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-twc1"
I20260709 13:09:46.692802 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:09:46.697203 28662 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.698058 28565 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:46.698343 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "73d37edb634141d6b6dbb8df5522a819"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-twc1"
I20260709 13:09:46.698647 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:46.718490 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:46.719843 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:46.722470 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:46.727031 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:46.727265 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.727541 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:46.727696 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.825331 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:43065
I20260709 13:09:46.825457 28724 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:43065 every 8 connection(s)
I20260709 13:09:46.832774 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:46.842551 28729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.848448 28730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:46.856047 28732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:46.857527 28565 server_base.cc:1061] running on GCE node
I20260709 13:09:46.858590 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:46.858809 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:46.859004 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602586858984 us; error 0 us; skew 500 ppm
I20260709 13:09:46.859592 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:46.863582 28565 webserver.cc:533] Webserver started at http://127.27.229.66:46377/ using document root <none> and password file <none>
I20260709 13:09:46.864125 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:46.864331 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:46.864653 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:46.865590 28725 heartbeater.cc:344] Connected to a master server at 127.27.229.126:45497
I20260709 13:09:46.866135 28725 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:46.866060 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "f45385570dfc4cfcaf9e054f24182ae4"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-twc1"
I20260709 13:09:46.867406 28725 heartbeater.cc:507] Master 127.27.229.126:45497 requested a full tablet report, sending...
I20260709 13:09:46.871232 28597 ts_manager.cc:194] Registered new tserver with Master: 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065)
I20260709 13:09:46.872159 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:46.874351 28597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36830
I20260709 13:09:46.877518 28737 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.878399 28565 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:09:46.878681 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "f45385570dfc4cfcaf9e054f24182ae4"
format_stamp: "Formatted at 2026-07-09 13:09:46 on dist-test-slave-twc1"
I20260709 13:09:46.878947 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:46.897598 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:46.898924 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:46.901466 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:46.904532 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:46.904739 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.904991 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:46.905131 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:46.999409 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:35077
I20260709 13:09:46.999650 28799 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:35077 every 8 connection(s)
I20260709 13:09:47.005519 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:47.014017 28803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:47.018401 28804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:47.019189 28565 server_base.cc:1061] running on GCE node
W20260709 13:09:47.020753 28806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:47.022529 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:47.022887 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:47.023137 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602587023120 us; error 0 us; skew 500 ppm
I20260709 13:09:47.023926 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:47.023988 28800 heartbeater.cc:344] Connected to a master server at 127.27.229.126:45497
I20260709 13:09:47.024369 28800 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:47.025236 28800 heartbeater.cc:507] Master 127.27.229.126:45497 requested a full tablet report, sending...
I20260709 13:09:47.026958 28565 webserver.cc:533] Webserver started at http://127.27.229.67:45029/ using document root <none> and password file <none>
I20260709 13:09:47.027347 28597 ts_manager.cc:194] Registered new tserver with Master: f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:47.027602 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:47.027880 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:47.028192 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:47.028718 28597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36838
I20260709 13:09:47.029743 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
format_stamp: "Formatted at 2026-07-09 13:09:47 on dist-test-slave-twc1"
I20260709 13:09:47.035779 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:47.040009 28811 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:47.040844 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:47.041208 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
format_stamp: "Formatted at 2026-07-09 13:09:47 on dist-test-slave-twc1"
I20260709 13:09:47.041589 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:47.059782 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:47.061390 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:47.063941 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:47.067687 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:47.067981 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:47.068274 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:47.068486 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:47.153013 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:38473
I20260709 13:09:47.153086 28873 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:38473 every 8 connection(s)
I20260709 13:09:47.170173 28874 heartbeater.cc:344] Connected to a master server at 127.27.229.126:45497
I20260709 13:09:47.170626 28874 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:47.171640 28874 heartbeater.cc:507] Master 127.27.229.126:45497 requested a full tablet report, sending...
I20260709 13:09:47.174049 28597 ts_manager.cc:194] Registered new tserver with Master: 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:47.175031 28565 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016325902s
I20260709 13:09:47.175582 28597 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36852
I20260709 13:09:47.226754 28597 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36856:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:47.230541 28597 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:47.331558 28765 tablet_service.cc:1511] Processing CreateTablet for tablet 961488caa8e649e3997a9ea99b2b23ec (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:47.334328 28762 tablet_service.cc:1511] Processing CreateTablet for tablet bb4bfbc591d74685a14782282e406757 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:47.331422 28764 tablet_service.cc:1511] Processing CreateTablet for tablet 01d9e60f02d34722b1f043986c84c68e (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:47.335505 28763 tablet_service.cc:1511] Processing CreateTablet for tablet 107ea945a6124c3ca4f6f8d645cd0fb6 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:47.337074 28765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961488caa8e649e3997a9ea99b2b23ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.337788 28763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107ea945a6124c3ca4f6f8d645cd0fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.338516 28764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9e60f02d34722b1f043986c84c68e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.340039 28761 tablet_service.cc:1511] Processing CreateTablet for tablet 14303d7f41b84f538cec2cfc56eafa44 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:47.341506 28761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14303d7f41b84f538cec2cfc56eafa44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.344923 28760 tablet_service.cc:1511] Processing CreateTablet for tablet de240b9d3c9c4605870a3f682c7cbf07 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:47.346365 28762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4bfbc591d74685a14782282e406757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.348186 28760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de240b9d3c9c4605870a3f682c7cbf07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.350425 28759 tablet_service.cc:1511] Processing CreateTablet for tablet 7144cec527c748c8a33b32addb0febb4 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:47.356508 28758 tablet_service.cc:1511] Processing CreateTablet for tablet cbfb1ba3eeb0453faec51c1a1a15dce3 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:47.358703 28758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfb1ba3eeb0453faec51c1a1a15dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.363508 28759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7144cec527c748c8a33b32addb0febb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.365041 28757 tablet_service.cc:1511] Processing CreateTablet for tablet 8867dd12925a4fd68dc0ca76371918e6 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:47.376256 28757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8867dd12925a4fd68dc0ca76371918e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.437183 28836 tablet_service.cc:1511] Processing CreateTablet for tablet bb4bfbc591d74685a14782282e406757 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:47.439234 28839 tablet_service.cc:1511] Processing CreateTablet for tablet 961488caa8e649e3997a9ea99b2b23ec (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:47.439796 28832 tablet_service.cc:1511] Processing CreateTablet for tablet cbfb1ba3eeb0453faec51c1a1a15dce3 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:47.444288 28892 tablet_bootstrap.cc:492] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:47.434484 28833 tablet_service.cc:1511] Processing CreateTablet for tablet 7144cec527c748c8a33b32addb0febb4 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:47.444392 28838 tablet_service.cc:1511] Processing CreateTablet for tablet 01d9e60f02d34722b1f043986c84c68e (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:47.434543 28834 tablet_service.cc:1511] Processing CreateTablet for tablet de240b9d3c9c4605870a3f682c7cbf07 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:47.445868 28839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961488caa8e649e3997a9ea99b2b23ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.442095 28837 tablet_service.cc:1511] Processing CreateTablet for tablet 107ea945a6124c3ca4f6f8d645cd0fb6 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:47.447021 28835 tablet_service.cc:1511] Processing CreateTablet for tablet 14303d7f41b84f538cec2cfc56eafa44 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:47.451687 28831 tablet_service.cc:1511] Processing CreateTablet for tablet 8867dd12925a4fd68dc0ca76371918e6 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:47.453387 28835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14303d7f41b84f538cec2cfc56eafa44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.455467 28689 tablet_service.cc:1511] Processing CreateTablet for tablet 01d9e60f02d34722b1f043986c84c68e (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:47.460122 28838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9e60f02d34722b1f043986c84c68e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.462708 28688 tablet_service.cc:1511] Processing CreateTablet for tablet 107ea945a6124c3ca4f6f8d645cd0fb6 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:47.466005 28689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9e60f02d34722b1f043986c84c68e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.460148 28690 tablet_service.cc:1511] Processing CreateTablet for tablet 961488caa8e649e3997a9ea99b2b23ec (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:47.471262 28687 tablet_service.cc:1511] Processing CreateTablet for tablet bb4bfbc591d74685a14782282e406757 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:47.476429 28832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfb1ba3eeb0453faec51c1a1a15dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.472849 28686 tablet_service.cc:1511] Processing CreateTablet for tablet 14303d7f41b84f538cec2cfc56eafa44 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:47.483119 28688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107ea945a6124c3ca4f6f8d645cd0fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.488852 28834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de240b9d3c9c4605870a3f682c7cbf07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.486586 28683 tablet_service.cc:1511] Processing CreateTablet for tablet cbfb1ba3eeb0453faec51c1a1a15dce3 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:47.494976 28837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 107ea945a6124c3ca4f6f8d645cd0fb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.493305 28682 tablet_service.cc:1511] Processing CreateTablet for tablet 8867dd12925a4fd68dc0ca76371918e6 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:47.496883 28684 tablet_service.cc:1511] Processing CreateTablet for tablet 7144cec527c748c8a33b32addb0febb4 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:47.488878 28685 tablet_service.cc:1511] Processing CreateTablet for tablet de240b9d3c9c4605870a3f682c7cbf07 (DEFAULT_TABLE table=test-workload [id=1597fb9275164b90b7d51698e4d4a6bb]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:47.499643 28687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4bfbc591d74685a14782282e406757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.500799 28684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7144cec527c748c8a33b32addb0febb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.503789 28683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfb1ba3eeb0453faec51c1a1a15dce3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.505301 28836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb4bfbc591d74685a14782282e406757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.521525 28831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8867dd12925a4fd68dc0ca76371918e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.522938 28682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8867dd12925a4fd68dc0ca76371918e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:47.531869 28645 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:47.534950 28685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de240b9d3c9c4605870a3f682c7cbf07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.535917 28833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7144cec527c748c8a33b32addb0febb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.542176 28690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 961488caa8e649e3997a9ea99b2b23ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.553942 28686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14303d7f41b84f538cec2cfc56eafa44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:47.574965 28892 tablet_bootstrap.cc:654] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.623231 28895 tablet_bootstrap.cc:492] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:47.628984 28893 tablet_bootstrap.cc:492] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:47.633287 28892 tablet_bootstrap.cc:492] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:47.634536 28892 ts_tablet_manager.cc:1403] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.205s	user 0.020s	sys 0.007s
I20260709 13:09:47.639583 28892 raft_consensus.cc:359] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.641137 28892 raft_consensus.cc:385] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.641448 28892 raft_consensus.cc:740] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.642835 28892 consensus_queue.cc:260] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.659876 28800 heartbeater.cc:499] Master 127.27.229.126:45497 was elected leader, sending a full tablet report...
I20260709 13:09:47.669667 28892 ts_tablet_manager.cc:1434] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.011s
I20260709 13:09:47.671710 28892 tablet_bootstrap.cc:492] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:47.680749 28895 tablet_bootstrap.cc:654] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.687176 28893 tablet_bootstrap.cc:654] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.688704 28892 tablet_bootstrap.cc:654] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.701012 28892 tablet_bootstrap.cc:492] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:47.701450 28892 ts_tablet_manager.cc:1403] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.006s
I20260709 13:09:47.705108 28892 raft_consensus.cc:359] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.706697 28892 raft_consensus.cc:385] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.707031 28892 raft_consensus.cc:740] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.707754 28892 consensus_queue.cc:260] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.711167 28895 tablet_bootstrap.cc:492] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:47.711673 28895 ts_tablet_manager.cc:1403] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.089s	user 0.000s	sys 0.018s
I20260709 13:09:47.714605 28895 raft_consensus.cc:359] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.715360 28895 raft_consensus.cc:385] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.715649 28895 raft_consensus.cc:740] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.717052 28892 ts_tablet_manager.cc:1434] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:09:47.718070 28892 tablet_bootstrap.cc:492] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:47.723019 28895 consensus_queue.cc:260] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.727156 28893 tablet_bootstrap.cc:492] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:47.727588 28893 ts_tablet_manager.cc:1403] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.020s
I20260709 13:09:47.727702 28892 tablet_bootstrap.cc:654] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.729766 28893 raft_consensus.cc:359] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.730494 28893 raft_consensus.cc:385] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.730742 28893 raft_consensus.cc:740] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.731415 28893 consensus_queue.cc:260] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.734135 28874 heartbeater.cc:499] Master 127.27.229.126:45497 was elected leader, sending a full tablet report...
I20260709 13:09:47.734632 28893 ts_tablet_manager.cc:1434] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:09:47.735066 28725 heartbeater.cc:499] Master 127.27.229.126:45497 was elected leader, sending a full tablet report...
I20260709 13:09:47.735752 28893 tablet_bootstrap.cc:492] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:47.742290 28893 tablet_bootstrap.cc:654] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.743337 28895 ts_tablet_manager.cc:1434] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.010s
I20260709 13:09:47.744390 28895 tablet_bootstrap.cc:492] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
W20260709 13:09:47.756188 28801 tablet.cc:2406] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:47.759596 28893 tablet_bootstrap.cc:492] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:47.760093 28893 ts_tablet_manager.cc:1403] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:09:47.762980 28893 raft_consensus.cc:359] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.763769 28893 raft_consensus.cc:385] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.764079 28893 raft_consensus.cc:740] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.765049 28893 consensus_queue.cc:260] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.766819 28895 tablet_bootstrap.cc:654] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.767169 28893 ts_tablet_manager.cc:1434] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:47.768121 28893 tablet_bootstrap.cc:492] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:47.772074 28892 tablet_bootstrap.cc:492] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:47.772586 28892 ts_tablet_manager.cc:1403] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.000s
I20260709 13:09:47.775166 28893 tablet_bootstrap.cc:654] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.775511 28892 raft_consensus.cc:359] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.776264 28892 raft_consensus.cc:385] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.776575 28892 raft_consensus.cc:740] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.777467 28892 consensus_queue.cc:260] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.782704 28892 ts_tablet_manager.cc:1434] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:47.783758 28892 tablet_bootstrap.cc:492] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:47.792440 28895 tablet_bootstrap.cc:492] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:47.792960 28895 ts_tablet_manager.cc:1403] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.001s
I20260709 13:09:47.796955 28892 tablet_bootstrap.cc:654] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.796998 28895 raft_consensus.cc:359] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.797816 28895 raft_consensus.cc:385] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.798163 28895 raft_consensus.cc:740] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.799268 28893 tablet_bootstrap.cc:492] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:47.798875 28895 consensus_queue.cc:260] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.801192 28895 ts_tablet_manager.cc:1434] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:47.802193 28895 tablet_bootstrap.cc:492] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:47.799986 28893 ts_tablet_manager.cc:1403] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.009s
I20260709 13:09:47.805754 28893 raft_consensus.cc:359] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.806571 28893 raft_consensus.cc:385] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.806951 28893 raft_consensus.cc:740] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.807823 28893 consensus_queue.cc:260] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.808467 28895 tablet_bootstrap.cc:654] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.812363 28893 ts_tablet_manager.cc:1434] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:09:47.813468 28893 tablet_bootstrap.cc:492] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:47.822613 28892 tablet_bootstrap.cc:492] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:47.823177 28892 ts_tablet_manager.cc:1403] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.000s
I20260709 13:09:47.824554 28895 tablet_bootstrap.cc:492] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:47.825059 28895 ts_tablet_manager.cc:1403] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.011s
I20260709 13:09:47.826241 28892 raft_consensus.cc:359] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.827004 28892 raft_consensus.cc:385] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.827310 28892 raft_consensus.cc:740] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.827936 28893 tablet_bootstrap.cc:654] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.827973 28895 raft_consensus.cc:359] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.828039 28892 consensus_queue.cc:260] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.828917 28895 raft_consensus.cc:385] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.829362 28895 raft_consensus.cc:740] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.830363 28901 raft_consensus.cc:493] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.830386 28895 consensus_queue.cc:260] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.830989 28901 raft_consensus.cc:515] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.833010 28896 raft_consensus.cc:493] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.833487 28896 raft_consensus.cc:515] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.835920 28896 leader_election.cc:290] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:47.837711 28895 ts_tablet_manager.cc:1434] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:09:47.842279 28895 tablet_bootstrap.cc:492] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:47.845592 28892 ts_tablet_manager.cc:1434] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:47.848811 28895 tablet_bootstrap.cc:654] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.849445 28892 tablet_bootstrap.cc:492] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:47.851357 28901 leader_election.cc:290] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:47.856670 28892 tablet_bootstrap.cc:654] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.889180 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
W20260709 13:09:47.892130 28741 leader_election.cc:343] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.904692 28900 raft_consensus.cc:493] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.904059 28896 raft_consensus.cc:493] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.906179 28900 raft_consensus.cc:515] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.906352 28896 raft_consensus.cc:515] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.912992 28893 tablet_bootstrap.cc:492] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:47.917868 28896 leader_election.cc:290] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:47.919763 28895 tablet_bootstrap.cc:492] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:47.920258 28895 ts_tablet_manager.cc:1403] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.028s
I20260709 13:09:47.920881 28893 ts_tablet_manager.cc:1403] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.004s
I20260709 13:09:47.925323 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:47.926060 28900 leader_election.cc:290] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
W20260709 13:09:47.934257 28741 leader_election.cc:343] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.938647 28893 raft_consensus.cc:359] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.944191 28893 raft_consensus.cc:385] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.944908 28893 raft_consensus.cc:740] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.945981 28895 raft_consensus.cc:359] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.950418 28896 raft_consensus.cc:493] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.950153 28893 consensus_queue.cc:260] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.951005 28896 raft_consensus.cc:515] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.952867 28893 ts_tablet_manager.cc:1434] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:09:47.953016 28896 leader_election.cc:290] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:47.949882 28895 raft_consensus.cc:385] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.953871 28895 raft_consensus.cc:740] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.955320 28895 consensus_queue.cc:260] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.956754 28893 tablet_bootstrap.cc:492] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:47.957156 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:47.958051 28895 ts_tablet_manager.cc:1434] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
W20260709 13:09:47.958714 28741 leader_election.cc:343] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.956053 28892 tablet_bootstrap.cc:492] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:47.966835 28892 ts_tablet_manager.cc:1403] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.008s
I20260709 13:09:47.966662 28901 raft_consensus.cc:493] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.967720 28901 raft_consensus.cc:515] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.959493 28895 tablet_bootstrap.cc:492] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:47.969907 28901 leader_election.cc:290] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065)
I20260709 13:09:47.969832 28892 raft_consensus.cc:359] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.971436 28892 raft_consensus.cc:385] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.972447 28892 raft_consensus.cc:740] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.975021 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:47.976115 28700 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 0.
I20260709 13:09:47.979030 28893 tablet_bootstrap.cc:654] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.979120 28892 consensus_queue.cc:260] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.980358 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:47.981387 28700 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 0.
I20260709 13:09:47.980518 28813 leader_election.cc:304] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:47.983479 28892 ts_tablet_manager.cc:1434] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:09:47.983414 28901 raft_consensus.cc:2804] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.983937 28901 raft_consensus.cc:493] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.983964 28813 leader_election.cc:304] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:47.984795 28901 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.986609 28896 raft_consensus.cc:493] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.988337 28892 tablet_bootstrap.cc:492] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:47.988564 28896 raft_consensus.cc:515] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:47.993052 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:47.993044 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:47.990847 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:47.994541 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.010974 28896 leader_election.cc:290] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.024475 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:48.024565 28901 raft_consensus.cc:515] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.025720 28848 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 0.
I20260709 13:09:48.007208 28700 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 0.
I20260709 13:09:48.027851 28741 leader_election.cc:304] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:48.028810 28896 raft_consensus.cc:2804] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.029158 28896 raft_consensus.cc:493] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.029453 28896 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.031950 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:48.032344 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
W20260709 13:09:48.034858 28666 leader_election.cc:343] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.035957 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.036772 28895 tablet_bootstrap.cc:654] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.039040 28901 leader_election.cc:290] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.039628 28901 raft_consensus.cc:2804] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.039994 28901 raft_consensus.cc:493] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.041290 28901 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.041807 28739 leader_election.cc:343] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.045440 28896 raft_consensus.cc:515] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.049957 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:48.050498 28892 tablet_bootstrap.cc:654] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.050608 28849 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.045200 28739 leader_election.cc:304] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819
W20260709 13:09:48.080179 28813 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:43065, user_credentials={real_user=slave}} blocked reactor thread for 92313.5us
I20260709 13:09:48.089766 28896 leader_election.cc:290] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.090777 28896 raft_consensus.cc:2749] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.090530 28901 raft_consensus.cc:515] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.091495 28893 tablet_bootstrap.cc:492] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:48.092549 28893 ts_tablet_manager.cc:1403] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.136s	user 0.017s	sys 0.002s
I20260709 13:09:48.092945 28921 raft_consensus.cc:493] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.093580 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.094568 28700 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.095314 28901 leader_election.cc:290] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065)
W20260709 13:09:48.096778 28739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:43065, user_credentials={real_user=slave}} blocked reactor thread for 58539.1us
I20260709 13:09:48.098517 28849 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 1.
I20260709 13:09:48.099018 28739 leader_election.cc:304] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:48.099148 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.099802 28896 raft_consensus.cc:2804] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.099851 28741 leader_election.cc:304] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:48.100263 28896 raft_consensus.cc:493] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.100673 28896 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.104805 28813 leader_election.cc:343] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.105212 28893 raft_consensus.cc:359] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.105859 28700 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 1.
I20260709 13:09:48.106050 28893 raft_consensus.cc:385] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:48.105906 28813 leader_election.cc:343] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.106552 28893 raft_consensus.cc:740] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
W20260709 13:09:48.107306 28813 leader_election.cc:343] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.093706 28921 raft_consensus.cc:515] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.109853 28896 raft_consensus.cc:515] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.110543 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.111366 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.112040 28700 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.111320 28813 leader_election.cc:304] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.112054 28923 raft_consensus.cc:2804] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:48.109330 28739 leader_election.cc:343] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.112645 28896 leader_election.cc:290] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
W20260709 13:09:48.115541 28813 leader_election.cc:343] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.117333 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
W20260709 13:09:48.117610 28739 leader_election.cc:343] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.118065 28739 leader_election.cc:304] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.113878 28901 raft_consensus.cc:2804] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:48.119500 28741 leader_election.cc:343] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.119329 28896 raft_consensus.cc:2749] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.107503 28893 consensus_queue.cc:260] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.121299 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.120828 28901 raft_consensus.cc:697] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:48.124953 28893 ts_tablet_manager.cc:1434] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.002s
I20260709 13:09:48.122812 28901 consensus_queue.cc:237] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.128221 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.128971 28699 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.130918 28893 tablet_bootstrap.cc:492] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:48.133819 28700 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 1.
I20260709 13:09:48.134303 28892 tablet_bootstrap.cc:492] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:48.134789 28892 ts_tablet_manager.cc:1403] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.148s	user 0.033s	sys 0.001s
I20260709 13:09:48.135219 28813 leader_election.cc:304] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.136575 28920 raft_consensus.cc:2804] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.136848 28923 raft_consensus.cc:697] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:48.140818 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.142984 28775 raft_consensus.cc:2468] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 0.
I20260709 13:09:48.142976 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
W20260709 13:09:48.145069 28813 leader_election.cc:343] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:48.142146 28739 leader_election.cc:343] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.149092 28895 tablet_bootstrap.cc:492] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:48.150099 28895 ts_tablet_manager.cc:1403] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.191s	user 0.026s	sys 0.021s
I20260709 13:09:48.154426 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.155444 28664 leader_election.cc:304] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:48.155596 28775 raft_consensus.cc:2468] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 0.
I20260709 13:09:48.152675 28596 catalog_manager.cc:5697] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.158327 28900 raft_consensus.cc:2804] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.158696 28900 raft_consensus.cc:493] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.159029 28900 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.149657 28699 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 1.
I20260709 13:09:48.161510 28813 leader_election.cc:304] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.148638 28923 consensus_queue.cc:237] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.152392 28921 leader_election.cc:290] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.162652 28901 raft_consensus.cc:2804] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.165292 28901 raft_consensus.cc:493] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.165670 28901 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.156315 28892 raft_consensus.cc:359] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.179139 28900 raft_consensus.cc:515] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.183908 28901 raft_consensus.cc:515] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.187158 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
W20260709 13:09:48.188859 28813 leader_election.cc:343] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.192299 28893 tablet_bootstrap.cc:654] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.160233 28895 raft_consensus.cc:359] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.194083 28895 raft_consensus.cc:385] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.194451 28895 raft_consensus.cc:740] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.195516 28921 raft_consensus.cc:493] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.175011 28892 raft_consensus.cc:385] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.196101 28921 raft_consensus.cc:515] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.195544 28901 leader_election.cc:290] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.197907 28892 raft_consensus.cc:740] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.196334 28739 leader_election.cc:304] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:48.200224 28920 raft_consensus.cc:697] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:48.224931 28892 consensus_queue.cc:260] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.218492 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.227598 28775 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.226117 28900 leader_election.cc:290] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.228262 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:48.230314 28926 raft_consensus.cc:2804] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.230872 28926 raft_consensus.cc:697] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
W20260709 13:09:48.230913 28666 leader_election.cc:343] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.231853 28926 consensus_queue.cc:237] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.235088 28921 leader_election.cc:290] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.235605 28895 consensus_queue.cc:260] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.235962 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.236479 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.237154 28774 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 0.
I20260709 13:09:48.238639 28813 leader_election.cc:304] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:48.236582 28699 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 0.
W20260709 13:09:48.233028 28739 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:43065, user_credentials={real_user=slave}} blocked reactor thread for 44450us
I20260709 13:09:48.242949 28921 raft_consensus.cc:2804] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.243352 28921 raft_consensus.cc:493] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.243657 28892 ts_tablet_manager.cc:1434] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.003s
I20260709 13:09:48.244225 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.244860 28892 tablet_bootstrap.cc:492] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:48.244832 28774 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.239357 28895 ts_tablet_manager.cc:1434] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.004s
I20260709 13:09:48.246644 28920 consensus_queue.cc:237] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.248613 28895 tablet_bootstrap.cc:492] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:48.243712 28921 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.270884 28775 raft_consensus.cc:2468] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 1.
I20260709 13:09:48.272328 28813 leader_election.cc:304] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.286296 28928 raft_consensus.cc:2804] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.286937 28928 raft_consensus.cc:697] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:48.287828 28928 consensus_queue.cc:237] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.308382 28921 raft_consensus.cc:515] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.303095 28774 raft_consensus.cc:2468] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 1.
I20260709 13:09:48.310904 28664 leader_election.cc:304] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:48.311424 28921 leader_election.cc:290] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.311996 28900 raft_consensus.cc:2804] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.315181 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.315814 28775 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.315083 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.317807 28699 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.319787 28893 tablet_bootstrap.cc:492] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:48.320291 28893 ts_tablet_manager.cc:1403] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.195s	user 0.028s	sys 0.023s
I20260709 13:09:48.325428 28775 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 1.
I20260709 13:09:48.327739 28895 tablet_bootstrap.cc:654] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.327374 28893 raft_consensus.cc:359] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.329075 28893 raft_consensus.cc:385] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.329414 28893 raft_consensus.cc:740] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.328470 28900 raft_consensus.cc:697] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:48.327948 28699 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 1.
I20260709 13:09:48.332545 28900 consensus_queue.cc:237] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.334220 28813 leader_election.cc:304] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:48.335052 28928 raft_consensus.cc:2804] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.336323 28928 raft_consensus.cc:697] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:48.335158 28597 catalog_manager.cc:5697] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.337280 28928 consensus_queue.cc:237] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.337998 28892 tablet_bootstrap.cc:654] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.335079 28893 consensus_queue.cc:260] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.341506 28893 ts_tablet_manager.cc:1434] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:09:48.342531 28893 tablet_bootstrap.cc:492] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:48.354892 28895 tablet_bootstrap.cc:492] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:48.355635 28895 ts_tablet_manager.cc:1403] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.107s	user 0.006s	sys 0.010s
I20260709 13:09:48.358987 28596 catalog_manager.cc:5697] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.360828 28895 raft_consensus.cc:359] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.361635 28895 raft_consensus.cc:385] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.355309 28597 catalog_manager.cc:5697] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.357683 28893 tablet_bootstrap.cc:654] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.362020 28895 raft_consensus.cc:740] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.366619 28895 consensus_queue.cc:260] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.369719 28900 raft_consensus.cc:493] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.370224 28900 raft_consensus.cc:515] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.372299 28900 leader_election.cc:290] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.369259 28895 ts_tablet_manager.cc:1434] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:48.373440 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.373693 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:48.373689 28895 tablet_bootstrap.cc:492] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:48.374893 28849 raft_consensus.cc:2393] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 73d37edb634141d6b6dbb8df5522a819 in current term 1: Already voted for candidate f45385570dfc4cfcaf9e054f24182ae4 in this term.
I20260709 13:09:48.376127 28666 leader_election.cc:304] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.376988 28900 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.383792 28900 raft_consensus.cc:2749] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.388379 28595 catalog_manager.cc:5697] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.391543 28595 catalog_manager.cc:5697] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.395565 28895 tablet_bootstrap.cc:654] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.400020 28595 catalog_manager.cc:5697] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.411469 28893 tablet_bootstrap.cc:492] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:48.412058 28893 ts_tablet_manager.cc:1403] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.007s
I20260709 13:09:48.415171 28893 raft_consensus.cc:359] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.415975 28893 raft_consensus.cc:385] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.416273 28893 raft_consensus.cc:740] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.416919 28893 consensus_queue.cc:260] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.418779 28893 ts_tablet_manager.cc:1434] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:48.419752 28893 tablet_bootstrap.cc:492] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:48.420401 28892 tablet_bootstrap.cc:492] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:48.420941 28892 ts_tablet_manager.cc:1403] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.176s	user 0.038s	sys 0.028s
I20260709 13:09:48.424533 28892 raft_consensus.cc:359] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.425392 28892 raft_consensus.cc:385] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.426307 28895 tablet_bootstrap.cc:492] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:48.428390 28892 raft_consensus.cc:740] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.428633 28895 ts_tablet_manager.cc:1403] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.006s
I20260709 13:09:48.429421 28892 consensus_queue.cc:260] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.431850 28895 raft_consensus.cc:359] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.432572 28895 raft_consensus.cc:385] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.427227 28893 tablet_bootstrap.cc:654] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.432864 28895 raft_consensus.cc:740] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.434244 28895 consensus_queue.cc:260] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.434906 28892 ts_tablet_manager.cc:1434] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:48.437958 28892 tablet_bootstrap.cc:492] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:48.436498 28895 ts_tablet_manager.cc:1434] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:09:48.444542 28895 tablet_bootstrap.cc:492] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:48.445297 28893 tablet_bootstrap.cc:492] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:48.448410 28893 ts_tablet_manager.cc:1403] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.000s
I20260709 13:09:48.450510 28893 raft_consensus.cc:359] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.451231 28893 raft_consensus.cc:385] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.451954 28893 raft_consensus.cc:740] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.452736 28893 consensus_queue.cc:260] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.453352 28892 tablet_bootstrap.cc:654] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.455017 28893 ts_tablet_manager.cc:1434] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:09:48.456923 28895 tablet_bootstrap.cc:654] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.464203 28893 tablet_bootstrap.cc:492] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Bootstrap starting.
I20260709 13:09:48.470719 28893 tablet_bootstrap.cc:654] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.472314 28895 tablet_bootstrap.cc:492] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:48.472854 28895 ts_tablet_manager.cc:1403] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.010s
I20260709 13:09:48.476028 28895 raft_consensus.cc:359] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.476791 28895 raft_consensus.cc:385] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.477119 28895 raft_consensus.cc:740] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.477810 28895 consensus_queue.cc:260] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.480285 28892 tablet_bootstrap.cc:492] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:48.480772 28892 ts_tablet_manager.cc:1403] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.007s
I20260709 13:09:48.482206 28895 ts_tablet_manager.cc:1434] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:48.483168 28895 tablet_bootstrap.cc:492] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819: Bootstrap starting.
I20260709 13:09:48.483348 28892 raft_consensus.cc:359] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.484030 28892 raft_consensus.cc:385] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.484283 28892 raft_consensus.cc:740] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.484920 28892 consensus_queue.cc:260] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.487036 28892 ts_tablet_manager.cc:1434] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:48.487870 28892 tablet_bootstrap.cc:492] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4: Bootstrap starting.
I20260709 13:09:48.488248 28893 tablet_bootstrap.cc:492] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: No bootstrap required, opened a new log
I20260709 13:09:48.488693 28893 ts_tablet_manager.cc:1403] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:09:48.491192 28893 raft_consensus.cc:359] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.491828 28893 raft_consensus.cc:385] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.492092 28893 raft_consensus.cc:740] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.492869 28893 consensus_queue.cc:260] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.497354 28893 ts_tablet_manager.cc:1434] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:48.500694 28892 tablet_bootstrap.cc:654] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.505579 28895 tablet_bootstrap.cc:654] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.516109 28892 tablet_bootstrap.cc:492] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4: No bootstrap required, opened a new log
I20260709 13:09:48.516513 28892 ts_tablet_manager.cc:1403] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.012s
I20260709 13:09:48.516716 28895 tablet_bootstrap.cc:492] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819: No bootstrap required, opened a new log
I20260709 13:09:48.517164 28895 ts_tablet_manager.cc:1403] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.011s
I20260709 13:09:48.518517 28892 raft_consensus.cc:359] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.519160 28892 raft_consensus.cc:385] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.519407 28892 raft_consensus.cc:740] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.519655 28895 raft_consensus.cc:359] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.520056 28892 consensus_queue.cc:260] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.520470 28895 raft_consensus.cc:385] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.520797 28895 raft_consensus.cc:740] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.521428 28895 consensus_queue.cc:260] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.522073 28892 ts_tablet_manager.cc:1434] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:48.524053 28895 ts_tablet_manager.cc:1434] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:48.528213 28900 raft_consensus.cc:493] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.528899 28900 raft_consensus.cc:515] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.532317 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:48.533130 28849 raft_consensus.cc:2468] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 0.
I20260709 13:09:48.534404 28926 raft_consensus.cc:493] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.534888 28926 raft_consensus.cc:515] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.535550 28900 leader_election.cc:290] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.535094 28666 leader_election.cc:304] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:48.534335 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.536746 28775 raft_consensus.cc:2468] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 0.
I20260709 13:09:48.537477 28900 raft_consensus.cc:2804] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.537827 28900 raft_consensus.cc:493] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.538223 28900 raft_consensus.cc:3060] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.538427 28645 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:48.540107 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.542034 28926 leader_election.cc:290] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.543169 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:48.543782 28849 raft_consensus.cc:2468] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 0.
I20260709 13:09:48.544989 28741 leader_election.cc:304] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:48.545655 28926 raft_consensus.cc:2804] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.545495 28900 raft_consensus.cc:515] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.546115 28926 raft_consensus.cc:493] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.546764 28699 raft_consensus.cc:2393] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f45385570dfc4cfcaf9e054f24182ae4 in current term 1: Already voted for candidate 73d37edb634141d6b6dbb8df5522a819 in this term.
I20260709 13:09:48.549239 28900 leader_election.cc:290] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.549508 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.547048 28926 raft_consensus.cc:3060] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.549788 28928 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.551054 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:48.551579 28849 raft_consensus.cc:3060] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.558836 28926 raft_consensus.cc:515] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.559196 28849 raft_consensus.cc:2468] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 1.
I20260709 13:09:48.560079 28775 raft_consensus.cc:2393] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 73d37edb634141d6b6dbb8df5522a819 in current term 1: Already voted for candidate f45385570dfc4cfcaf9e054f24182ae4 in this term.
I20260709 13:09:48.560742 28666 leader_election.cc:304] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:48.562633 28926 leader_election.cc:290] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.563463 28900 raft_consensus.cc:2804] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.563649 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.564199 28900 raft_consensus.cc:697] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:48.564489 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:48.565171 28849 raft_consensus.cc:2393] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f45385570dfc4cfcaf9e054f24182ae4 in current term 1: Already voted for candidate 73d37edb634141d6b6dbb8df5522a819 in this term.
I20260709 13:09:48.565083 28900 consensus_queue.cc:237] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.565578 28928 raft_consensus.cc:493] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.566056 28928 raft_consensus.cc:515] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.567787 28928 leader_election.cc:290] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.568744 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.569005 28698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.569555 28775 raft_consensus.cc:2393] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in current term 1: Already voted for candidate 73d37edb634141d6b6dbb8df5522a819 in this term.
I20260709 13:09:48.570713 28813 leader_election.cc:304] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1; no voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.572160 28928 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.572518 28739 leader_election.cc:304] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.573596 28926 raft_consensus.cc:2749] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.576383 28921 raft_consensus.cc:493] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.576948 28921 raft_consensus.cc:515] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.579133 28921 leader_election.cc:290] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.579830 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.580472 28699 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 0.
I20260709 13:09:48.580775 28775 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.581404 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.582051 28774 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 0.
I20260709 13:09:48.585491 28928 raft_consensus.cc:2749] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.587636 28813 leader_election.cc:304] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:48.588385 28921 raft_consensus.cc:2804] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.588748 28921 raft_consensus.cc:493] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.589166 28921 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.588610 28595 catalog_manager.cc:5697] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.595046 28920 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:48.604235 28921 raft_consensus.cc:515] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.606647 28921 leader_election.cc:290] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.609176 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.609833 28699 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.616930 28699 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 1.
I20260709 13:09:48.609198 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.618271 28813 leader_election.cc:304] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:48.618532 28774 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.618919 28901 raft_consensus.cc:2804] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.619381 28901 raft_consensus.cc:697] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:48.620182 28901 consensus_queue.cc:237] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.625149 28774 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 1.
I20260709 13:09:48.629527 28926 raft_consensus.cc:493] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.630144 28926 raft_consensus.cc:515] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.632397 28926 leader_election.cc:290] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:48.634006 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" is_pre_election: true
I20260709 13:09:48.636236 28699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.637630 28699 raft_consensus.cc:2393] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f45385570dfc4cfcaf9e054f24182ae4 in current term 1: Already voted for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in this term.
I20260709 13:09:48.638607 28739 leader_election.cc:304] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f45385570dfc4cfcaf9e054f24182ae4; no voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.639376 28926 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.641428 28595 catalog_manager.cc:5697] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.645406 28926 raft_consensus.cc:2749] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.654923 28901 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.656955 28926 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.670157 28921 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.672051 28926 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:48.690905 28928 consensus_queue.cc:1048] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.695784 28928 raft_consensus.cc:493] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.696244 28928 raft_consensus.cc:515] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.697721 28928 leader_election.cc:290] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.699442 28698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73d37edb634141d6b6dbb8df5522a819" is_pre_election: true
I20260709 13:09:48.700242 28698 raft_consensus.cc:2393] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in current term 1: Already voted for candidate f45385570dfc4cfcaf9e054f24182ae4 in this term.
I20260709 13:09:48.701121 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4" is_pre_election: true
I20260709 13:09:48.703557 28813 leader_election.cc:304] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1; no voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.703940 28896 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.704370 28928 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.719031 28900 consensus_queue.cc:1048] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.721312 28928 raft_consensus.cc:2749] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.745199 28926 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.747586 28965 consensus_queue.cc:1048] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:48.749042 28920 consensus_queue.cc:1048] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.750561 28697 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.773105 28920 consensus_queue.cc:1048] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.787082 28901 consensus_queue.cc:1048] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.837810 28849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
mode: GRACEFUL
new_leader_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:34056
I20260709 13:09:48.838430 28849 raft_consensus.cc:606] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Received request to transfer leadership to TS 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.853578 28774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:09:48.854136 28774 raft_consensus.cc:606] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Received request to transfer leadership to TS 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.859225 28849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
mode: GRACEFUL
new_leader_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:34056
I20260709 13:09:48.859735 28849 raft_consensus.cc:606] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Received request to transfer leadership to TS 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.864611 28774 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4bfbc591d74685a14782282e406757"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:43346
I20260709 13:09:48.865113 28774 raft_consensus.cc:606] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Received request to transfer leadership to TS 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:48.869864 28849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:34056
I20260709 13:09:48.870386 28849 raft_consensus.cc:606] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.875309 28849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:34056
I20260709 13:09:48.875818 28849 raft_consensus.cc:606] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.880823 28849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:34056
I20260709 13:09:48.881338 28849 raft_consensus.cc:606] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.895470 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:09:48.896137 28697 raft_consensus.cc:606] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:48.901692 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
mode: GRACEFUL
new_leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:09:48.902379 28697 raft_consensus.cc:606] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Received request to transfer leadership to TS 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:48.950002 28900 consensus_queue.cc:1048] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.956962 28965 raft_consensus.cc:993] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819: : Instructing follower 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:48.957408 28965 raft_consensus.cc:1081] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Signalling peer 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:48.959446 28848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:34048
I20260709 13:09:48.961407 28848 raft_consensus.cc:493] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:48.961818 28848 raft_consensus.cc:3060] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.966110 28965 consensus_queue.cc:1048] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.968851 28848 raft_consensus.cc:515] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.978940 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:48.979581 28697 raft_consensus.cc:3055] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.979957 28697 raft_consensus.cc:740] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:48.980103 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8867dd12925a4fd68dc0ca76371918e6" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:48.980691 28774 raft_consensus.cc:3060] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.980924 28697 consensus_queue.cc:260] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.982533 28697 raft_consensus.cc:3060] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.978945 28848 leader_election.cc:290] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 2 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:48.987279 28774 raft_consensus.cc:2468] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 2.
I20260709 13:09:48.988531 28813 leader_election.cc:304] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:48.989346 28920 raft_consensus.cc:2804] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.989894 28697 raft_consensus.cc:2468] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 2.
I20260709 13:09:48.989861 28920 raft_consensus.cc:697] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:48.990988 28920 consensus_queue.cc:237] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:48.998750 28595 catalog_manager.cc:5697] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 1 to 2, leader changed from 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65) to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.072906 28920 consensus_queue.cc:1048] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.084335 28921 consensus_queue.cc:1048] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.094636 28901 raft_consensus.cc:993] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.095119 28928 raft_consensus.cc:1081] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.096915 28774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43328
I20260709 13:09:49.097487 28774 raft_consensus.cc:493] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.097787 28774 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.102764 28774 raft_consensus.cc:515] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.105638 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:49.106462 28697 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.105968 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.107301 28848 raft_consensus.cc:3055] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.107594 28848 raft_consensus.cc:740] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:49.108316 28848 consensus_queue.cc:260] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.109201 28848 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.115393 28848 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.116793 28741 leader_election.cc:304] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:49.105655 28774 leader_election.cc:290] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.118016 28901 raft_consensus.cc:993] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: : Instructing follower 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.117988 28923 raft_consensus.cc:2804] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.118561 28923 raft_consensus.cc:697] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:49.118554 28921 raft_consensus.cc:1081] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Signalling peer 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.119442 28923 consensus_queue.cc:237] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.120759 28700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:09:49.121320 28700 raft_consensus.cc:493] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.121685 28700 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.122143 28697 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.126942 28597 catalog_manager.cc:5697] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 1 to 2, leader changed from 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.130204 28700 raft_consensus.cc:515] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.132824 28700 leader_election.cc:290] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.134302 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.135658 28848 raft_consensus.cc:3055] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.135070 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:49.136005 28848 raft_consensus.cc:740] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:49.136242 28774 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.136864 28848 consensus_queue.cc:260] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.138139 28848 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.140852 28774 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.141968 28664 leader_election.cc:304] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:49.142632 28965 raft_consensus.cc:2804] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.143021 28965 raft_consensus.cc:697] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:49.143864 28965 consensus_queue.cc:237] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.144791 28848 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.150583 28597 catalog_manager.cc:5697] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 1 to 2, leader changed from 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67) to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.166932 28921 raft_consensus.cc:993] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.167415 28921 raft_consensus.cc:1081] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.169111 28774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43328
I20260709 13:09:49.169689 28774 raft_consensus.cc:493] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.170082 28774 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.174641 28774 raft_consensus.cc:515] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.176417 28774 leader_election.cc:290] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.177238 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:49.177578 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.177860 28700 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.178167 28848 raft_consensus.cc:3055] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.178555 28848 raft_consensus.cc:740] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:49.179448 28848 consensus_queue.cc:260] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.181151 28848 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.184576 28700 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.185959 28739 leader_election.cc:304] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:49.186826 28923 raft_consensus.cc:2804] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.187318 28923 raft_consensus.cc:697] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:49.188099 28923 consensus_queue.cc:237] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.187933 28848 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.194832 28597 catalog_manager.cc:5697] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 1 to 2, leader changed from 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.219153 28921 raft_consensus.cc:993] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: : Instructing follower 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.219573 28928 raft_consensus.cc:1081] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Signalling peer 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.221022 28700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:09:49.221485 28700 raft_consensus.cc:493] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.221762 28700 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.226274 28700 raft_consensus.cc:515] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.227955 28700 leader_election.cc:290] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.228816 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:49.229061 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.229401 28774 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.229660 28848 raft_consensus.cc:3055] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.230044 28848 raft_consensus.cc:740] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:49.230847 28848 consensus_queue.cc:260] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.232067 28848 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.245639 28774 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.246953 28664 leader_election.cc:304] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:49.247973 28965 raft_consensus.cc:2804] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.248517 28965 raft_consensus.cc:697] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:49.248489 28848 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.249938 28965 consensus_queue.cc:237] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.257066 28595 catalog_manager.cc:5697] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 1 to 2, leader changed from 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67) to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.263556 28936 raft_consensus.cc:993] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.264039 28936 raft_consensus.cc:1081] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.266072 28775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43336
I20260709 13:09:49.266669 28775 raft_consensus.cc:493] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.267062 28775 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.274639 28775 raft_consensus.cc:515] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.277105 28775 leader_election.cc:290] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.277825 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.277493 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:49.278558 28848 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.278811 28700 raft_consensus.cc:3055] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.280128 28700 raft_consensus.cc:740] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:49.281024 28700 consensus_queue.cc:260] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.282292 28700 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.283226 28926 raft_consensus.cc:993] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.283878 28923 raft_consensus.cc:1081] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Signalling peer 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.285799 28697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:09:49.286437 28697 raft_consensus.cc:493] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.286798 28697 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.288014 28848 raft_consensus.cc:2468] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.289193 28700 raft_consensus.cc:2468] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.289280 28741 leader_election.cc:304] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:49.290256 28923 raft_consensus.cc:2804] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.290723 28923 raft_consensus.cc:697] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:49.291558 28923 consensus_queue.cc:237] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.294785 28697 raft_consensus.cc:515] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.298177 28697 leader_election.cc:290] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.300081 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.300823 28848 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.302515 28901 raft_consensus.cc:993] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.302981 28901 raft_consensus.cc:1081] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:49.306164 28595 catalog_manager.cc:5697] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 1 to 2, leader changed from 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.307986 28848 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.309393 28774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43328
I20260709 13:09:49.309625 28666 leader_election.cc:304] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:49.310045 28774 raft_consensus.cc:493] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.310421 28774 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.311053 28926 raft_consensus.cc:993] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.311474 28926 raft_consensus.cc:1081] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Signalling peer 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:49.312635 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:49.313222 28775 raft_consensus.cc:3055] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.313530 28775 raft_consensus.cc:740] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:49.314363 28775 consensus_queue.cc:260] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.315587 28775 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.317178 28774 raft_consensus.cc:515] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.318203 28965 raft_consensus.cc:2804] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.318703 28965 raft_consensus.cc:697] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:49.319492 28965 consensus_queue.cc:237] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.325950 28775 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.327127 28697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4bfbc591d74685a14782282e406757"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:09:49.327750 28697 raft_consensus.cc:493] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.328110 28697 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.332825 28774 leader_election.cc:290] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.335173 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.334908 28595 catalog_manager.cc:5697] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 1 to 2, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.335791 28848 raft_consensus.cc:3055] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.336145 28848 raft_consensus.cc:740] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:49.336215 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:49.336797 28700 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.336997 28848 consensus_queue.cc:260] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.338284 28848 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.338003 28697 raft_consensus.cc:515] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.341038 28774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:49.341729 28774 raft_consensus.cc:3055] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:49.344955 28848 raft_consensus.cc:2468] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.346068 28774 raft_consensus.cc:740] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:49.347105 28741 leader_election.cc:304] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:49.346923 28774 consensus_queue.cc:260] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.348047 28774 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.348435 28923 raft_consensus.cc:2804] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.348896 28923 raft_consensus.cc:697] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:49.349712 28923 consensus_queue.cc:237] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.350101 28700 raft_consensus.cc:2468] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 2.
I20260709 13:09:49.353322 28697 leader_election.cc:290] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:49.354156 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:49.354786 28849 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.358769 28774 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.360446 28664 leader_election.cc:304] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:49.360162 28595 catalog_manager.cc:5697] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 1 to 2, leader changed from 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.361362 28965 raft_consensus.cc:2804] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.361887 28965 raft_consensus.cc:697] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:49.362205 28849 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 2.
I20260709 13:09:49.362803 28965 consensus_queue.cc:237] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:49.371382 28597 catalog_manager.cc:5697] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 1 to 2, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.497449 28774 raft_consensus.cc:1275] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.498840 28928 consensus_queue.cc:1048] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.506034 28697 raft_consensus.cc:1275] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.507666 28920 consensus_queue.cc:1048] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.558646 28848 raft_consensus.cc:1275] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.559929 28965 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.568329 28774 raft_consensus.cc:1275] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.570181 28849 raft_consensus.cc:1275] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.570487 28980 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:49.571664 28923 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.579321 28697 raft_consensus.cc:1275] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.581220 28926 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.657155 28697 raft_consensus.cc:1275] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.658331 28979 consensus_queue.cc:1048] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.665544 28849 raft_consensus.cc:1275] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.667466 28926 consensus_queue.cc:1048] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.702693 28849 raft_consensus.cc:1275] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.704155 28980 consensus_queue.cc:1048] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.712406 28697 raft_consensus.cc:1275] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.712757 28774 raft_consensus.cc:1275] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.714211 28926 consensus_queue.cc:1048] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.714552 28980 consensus_queue.cc:1048] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.723928 28849 raft_consensus.cc:1275] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.725378 28923 consensus_queue.cc:1048] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.822521 28849 raft_consensus.cc:1275] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.823803 28980 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.833840 28774 raft_consensus.cc:1275] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.835175 28965 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.853183 28697 raft_consensus.cc:1275] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.854319 28923 consensus_queue.cc:1048] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.862061 28849 raft_consensus.cc:1275] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.863785 28979 consensus_queue.cc:1048] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.899428 28849 raft_consensus.cc:1275] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.900666 28965 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:49.908790 28774 raft_consensus.cc:1275] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:49.911015 28980 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.933224 28565 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:09:51.934329 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.955071 28775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:09:51.955724 28775 raft_consensus.cc:606] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Received request to transfer leadership to TS 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:51.966459 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
mode: GRACEFUL
new_leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:42154
I20260709 13:09:51.966964 28697 raft_consensus.cc:606] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Received request to transfer leadership to TS 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:51.968051 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:51.968487 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:51.999012 28992 raft_consensus.cc:993] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:51.999485 28996 raft_consensus.cc:1081] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Signalling peer 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:52.001103 28849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:34034
I20260709 13:09:52.001624 28849 raft_consensus.cc:493] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.001909 28849 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.006569 28849 raft_consensus.cc:515] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:52.008168 28849 leader_election.cc:290] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 3 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:52.009018 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:52.009328 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:52.009527 28697 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.009833 28775 raft_consensus.cc:3055] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.010141 28775 raft_consensus.cc:740] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:52.010797 28775 consensus_queue.cc:260] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:52.011765 28775 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.014515 28697 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 3.
I20260709 13:09:52.015568 28813 leader_election.cc:304] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:52.016225 28990 raft_consensus.cc:2804] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.016381 28775 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 3.
I20260709 13:09:52.017460 28990 raft_consensus.cc:697] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:52.018226 28990 consensus_queue.cc:237] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:52.025069 28596 catalog_manager.cc:5697] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 2 to 3, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.141685 28980 raft_consensus.cc:993] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819: : Instructing follower 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:52.142148 29003 raft_consensus.cc:1081] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Signalling peer 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:52.143895 28849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:34048
I20260709 13:09:52.144502 28849 raft_consensus.cc:493] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.144793 28849 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.149086 28849 raft_consensus.cc:515] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:52.150653 28849 leader_election.cc:290] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 3 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065)
I20260709 13:09:52.151594 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:52.151907 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:52.152086 28775 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.152419 28697 raft_consensus.cc:3055] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:52.152715 28697 raft_consensus.cc:740] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:52.153358 28697 consensus_queue.cc:260] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:52.154273 28697 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:52.156683 28775 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 3.
I20260709 13:09:52.157641 28813 leader_election.cc:304] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:52.158324 28990 raft_consensus.cc:2804] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:52.158793 28990 raft_consensus.cc:697] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:52.158854 28697 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 3.
I20260709 13:09:52.159637 28990 consensus_queue.cc:237] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:52.168123 28596 catalog_manager.cc:5697] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 2 to 3, leader changed from 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65) to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.562908 28775 raft_consensus.cc:1275] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.564190 28990 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.566897 28697 raft_consensus.cc:1275] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.568300 28997 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.656024 28775 raft_consensus.cc:1275] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.657213 28997 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.666052 28697 raft_consensus.cc:1275] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:52.667968 29009 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:52.969323 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.979367 28849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:34056
I20260709 13:09:52.979837 28849 raft_consensus.cc:606] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:52.984562 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:09:52.985069 28697 raft_consensus.cc:606] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:52.989830 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:09:52.990437 28697 raft_consensus.cc:606] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:52.995077 28697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4bfbc591d74685a14782282e406757"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:09:52.995599 28697 raft_consensus.cc:606] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:53.004971 28849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
mode: GRACEFUL
new_leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:34056
I20260709 13:09:53.005430 28849 raft_consensus.cc:606] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Received request to transfer leadership to TS f45385570dfc4cfcaf9e054f24182ae4
I20260709 13:09:53.020545 28997 raft_consensus.cc:993] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.020951 29009 raft_consensus.cc:1081] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.022342 28775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43328
I20260709 13:09:53.022790 28775 raft_consensus.cc:493] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.023090 28775 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.027665 28775 raft_consensus.cc:515] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.029325 28775 leader_election.cc:290] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 4 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:53.030329 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:53.030256 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7144cec527c748c8a33b32addb0febb4" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:53.030968 28849 raft_consensus.cc:3055] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:53.031016 28697 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.031388 28849 raft_consensus.cc:740] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:53.032123 28849 consensus_queue.cc:260] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.033246 28849 raft_consensus.cc:3060] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.037765 28697 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 4.
I20260709 13:09:53.039034 28739 leader_election.cc:304] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:53.039166 28849 raft_consensus.cc:2468] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 4.
I20260709 13:09:53.039875 28996 raft_consensus.cc:2804] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:53.040841 28996 raft_consensus.cc:697] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:53.041605 28996 consensus_queue.cc:237] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.047637 28595 catalog_manager.cc:5697] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 3 to 4, leader changed from 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.146373 29018 raft_consensus.cc:993] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.146791 29003 raft_consensus.cc:1081] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.148236 28775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43336
I20260709 13:09:53.148691 28775 raft_consensus.cc:493] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.148962 28775 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.154313 28775 raft_consensus.cc:515] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.155807 28775 leader_election.cc:290] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 3 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:53.156726 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:53.156832 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:53.157224 28697 raft_consensus.cc:3055] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.157254 28849 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.157573 28697 raft_consensus.cc:740] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:53.158349 28697 consensus_queue.cc:260] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.159251 28697 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.161283 28849 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 3.
I20260709 13:09:53.162204 28741 leader_election.cc:304] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:53.162837 28996 raft_consensus.cc:2804] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.163182 28697 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 3.
I20260709 13:09:53.163311 28996 raft_consensus.cc:697] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:53.164110 28996 consensus_queue.cc:237] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.170429 28595 catalog_manager.cc:5697] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 2 to 3, leader changed from 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.205856 29018 raft_consensus.cc:993] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.206274 29018 raft_consensus.cc:1081] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.207639 28775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43336
I20260709 13:09:53.208091 28775 raft_consensus.cc:493] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.208380 28775 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.212538 28775 raft_consensus.cc:515] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.214046 28775 leader_election.cc:290] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 3 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:53.214778 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:53.215018 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "107ea945a6124c3ca4f6f8d645cd0fb6" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:53.215297 28697 raft_consensus.cc:3055] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.215512 28849 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.215569 28697 raft_consensus.cc:740] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:53.216256 28697 consensus_queue.cc:260] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.217126 28697 raft_consensus.cc:3060] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.219599 28849 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 3.
I20260709 13:09:53.220549 28741 leader_election.cc:304] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:53.221205 28996 raft_consensus.cc:2804] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.221722 28996 raft_consensus.cc:697] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:53.222483 28697 raft_consensus.cc:2468] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 3.
I20260709 13:09:53.222548 28996 consensus_queue.cc:237] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.230546 28597 catalog_manager.cc:5697] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 2 to 3, leader changed from 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.290890 29020 raft_consensus.cc:993] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.291299 29003 raft_consensus.cc:993] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819: : Instructing follower f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.291373 28997 raft_consensus.cc:1081] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.291870 29018 raft_consensus.cc:1081] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Signalling peer f45385570dfc4cfcaf9e054f24182ae4 to start an election
I20260709 13:09:53.292884 28774 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43328
I20260709 13:09:53.293175 28775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4bfbc591d74685a14782282e406757"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
 from {username='slave'} at 127.0.0.1:43336
I20260709 13:09:53.293431 28774 raft_consensus.cc:493] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.293653 28775 raft_consensus.cc:493] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.293831 28774 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.294037 28775 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.300150 28775 raft_consensus.cc:515] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.300181 28774 raft_consensus.cc:515] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.302534 28774 leader_election.cc:290] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 4 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:53.303241 28775 leader_election.cc:290] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 3 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:53.303653 28697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:53.304208 28697 raft_consensus.cc:3055] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.304548 28697 raft_consensus.cc:740] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:53.304486 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:53.304817 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "961488caa8e649e3997a9ea99b2b23ec" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:53.305410 28700 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.305454 28848 raft_consensus.cc:3055] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:53.305349 28697 consensus_queue.cc:260] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.306013 28848 raft_consensus.cc:740] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:53.306737 28697 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.306800 28848 consensus_queue.cc:260] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.307183 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "f45385570dfc4cfcaf9e054f24182ae4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:53.307844 28849 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.308069 28848 raft_consensus.cc:3060] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:53.312928 28700 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 4.
I20260709 13:09:53.313153 28697 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 3.
I20260709 13:09:53.313937 28849 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 3.
I20260709 13:09:53.314332 28739 leader_election.cc:304] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73d37edb634141d6b6dbb8df5522a819, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:53.314736 28848 raft_consensus.cc:2468] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f45385570dfc4cfcaf9e054f24182ae4 in term 4.
I20260709 13:09:53.315173 28996 raft_consensus.cc:2804] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:53.315131 28741 leader_election.cc:304] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, f45385570dfc4cfcaf9e054f24182ae4; no voters: 
I20260709 13:09:53.315727 28996 raft_consensus.cc:697] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 4 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:53.316015 29014 raft_consensus.cc:2804] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.316443 29014 raft_consensus.cc:697] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Becoming Leader. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:53.316672 28996 consensus_queue.cc:237] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.317077 29014 consensus_queue.cc:237] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:53.325300 28597 catalog_manager.cc:5697] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 3 to 4, leader changed from 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.326486 28597 catalog_manager.cc:5697] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 reported cstate change: term changed from 2 to 3, leader changed from 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65) to f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "f45385570dfc4cfcaf9e054f24182ae4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.501885 28700 raft_consensus.cc:1275] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:53.503206 28996 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:53.512372 28848 raft_consensus.cc:1275] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:53.514081 29022 consensus_queue.cc:1048] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:53.603339 28700 raft_consensus.cc:1275] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.604560 29022 consensus_queue.cc:1048] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.613307 28848 raft_consensus.cc:1275] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.616164 29022 consensus_queue.cc:1048] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.713909 28848 raft_consensus.cc:1275] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.715301 29014 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.726852 28700 raft_consensus.cc:1275] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.727037 28697 raft_consensus.cc:1275] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.728612 28996 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.728931 29022 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.739976 28848 raft_consensus.cc:1275] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.741400 29022 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.802693 28700 raft_consensus.cc:1275] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:53.803932 29022 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:53.812352 28848 raft_consensus.cc:1275] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Refusing update from remote peer f45385570dfc4cfcaf9e054f24182ae4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:53.813772 28996 consensus_queue.cc:1048] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.012876 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:56.020133 28775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:09:56.020892 28775 raft_consensus.cc:606] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Received request to transfer leadership to TS 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:56.023536 28775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:09:56.024012 28775 raft_consensus.cc:606] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Received request to transfer leadership to TS 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:56.026283 28775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb4bfbc591d74685a14782282e406757"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:09:56.026741 28775 raft_consensus.cc:606] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Received request to transfer leadership to TS 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:56.029006 28775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:09:56.029496 28775 raft_consensus.cc:606] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Received request to transfer leadership to TS 73d37edb634141d6b6dbb8df5522a819
I20260709 13:09:56.032087 28775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07"
dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
mode: GRACEFUL
new_leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:33622
I20260709 13:09:56.032524 28775 raft_consensus.cc:606] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Received request to transfer leadership to TS 2aca3140d1e74494b8b9dc7a5daf0ad1
I20260709 13:09:56.033526 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:56.034049 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:56.156155 28996 raft_consensus.cc:993] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:56.156690 29036 raft_consensus.cc:1081] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Signalling peer 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:56.158368 28848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:34034
I20260709 13:09:56.158833 28848 raft_consensus.cc:493] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.159107 28848 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.164439 28848 raft_consensus.cc:515] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.166132 28848 leader_election.cc:290] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 3 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:56.167292 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:56.167322 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de240b9d3c9c4605870a3f682c7cbf07" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:56.168187 28700 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.168288 28775 raft_consensus.cc:3055] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:56.168583 28775 raft_consensus.cc:740] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:56.169246 28775 consensus_queue.cc:260] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.170176 28775 raft_consensus.cc:3060] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.172727 28700 raft_consensus.cc:2468] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 3.
I20260709 13:09:56.173955 28813 leader_election.cc:304] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:56.174580 28775 raft_consensus.cc:2468] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 3.
I20260709 13:09:56.174736 28997 raft_consensus.cc:2804] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:56.175680 28997 raft_consensus.cc:697] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:56.176514 28997 consensus_queue.cc:237] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.181428 28996 raft_consensus.cc:993] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:56.182085 29036 raft_consensus.cc:1081] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Signalling peer 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:56.183841 28700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:09:56.184262 28700 raft_consensus.cc:493] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.184532 28700 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.185225 28595 catalog_manager.cc:5697] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 2 to 3, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.188716 28700 raft_consensus.cc:515] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.190536 28700 leader_election.cc:290] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 4 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:56.191439 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:56.191956 28775 raft_consensus.cc:3055] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:56.191852 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01d9e60f02d34722b1f043986c84c68e" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:56.192276 28775 raft_consensus.cc:740] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:56.192412 28848 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.193068 28775 consensus_queue.cc:260] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.194335 28775 raft_consensus.cc:3060] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.199092 28848 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 4.
I20260709 13:09:56.200662 28775 raft_consensus.cc:2468] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 4.
I20260709 13:09:56.200618 28666 leader_election.cc:304] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:56.202531 29044 raft_consensus.cc:2804] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:56.203899 29044 raft_consensus.cc:697] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 4 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:56.204918 29044 consensus_queue.cc:237] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.211972 28595 catalog_manager.cc:5697] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 3 to 4, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.297643 29036 raft_consensus.cc:993] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:56.298115 29036 raft_consensus.cc:1081] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Signalling peer 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:56.299484 28700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:09:56.299958 28700 raft_consensus.cc:493] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.300247 28700 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.304307 28700 raft_consensus.cc:515] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.305729 28700 leader_election.cc:290] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 3 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:56.306605 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:56.306807 28848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfb1ba3eeb0453faec51c1a1a15dce3" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:56.307173 28775 raft_consensus.cc:3055] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:56.307252 28848 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.307518 28775 raft_consensus.cc:740] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:56.308221 28775 consensus_queue.cc:260] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.309326 28775 raft_consensus.cc:3060] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.313319 28848 raft_consensus.cc:2468] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 3.
I20260709 13:09:56.314373 28666 leader_election.cc:304] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:56.315122 29044 raft_consensus.cc:2804] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:56.315272 28775 raft_consensus.cc:2468] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 3.
I20260709 13:09:56.315557 29044 raft_consensus.cc:697] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 3 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:56.316505 29044 consensus_queue.cc:237] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.323674 28595 catalog_manager.cc:5697] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 2 to 3, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.460490 29039 raft_consensus.cc:993] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:56.461071 28996 raft_consensus.cc:1081] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Signalling peer 2aca3140d1e74494b8b9dc7a5daf0ad1 to start an election
I20260709 13:09:56.462939 28849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb4bfbc591d74685a14782282e406757"
dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
 from {username='slave'} at 127.0.0.1:34034
I20260709 13:09:56.463429 28849 raft_consensus.cc:493] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.463754 28849 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.468134 28849 raft_consensus.cc:515] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.469623 28849 leader_election.cc:290] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 4 election: Requested vote from peers 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065), f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077)
I20260709 13:09:56.470597 28700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
I20260709 13:09:56.470767 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb4bfbc591d74685a14782282e406757" candidate_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:56.471246 28700 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.471297 28775 raft_consensus.cc:3055] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:56.471623 28775 raft_consensus.cc:740] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:56.472190 28775 consensus_queue.cc:260] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.473018 28775 raft_consensus.cc:3060] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:56.475562 28700 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 4.
I20260709 13:09:56.476536 28813 leader_election.cc:304] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:56.477123 28775 raft_consensus.cc:2468] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aca3140d1e74494b8b9dc7a5daf0ad1 in term 4.
I20260709 13:09:56.477212 28997 raft_consensus.cc:2804] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:56.477633 28997 raft_consensus.cc:697] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 LEADER]: Becoming Leader. State: Replica: 2aca3140d1e74494b8b9dc7a5daf0ad1, State: Running, Role: LEADER
I20260709 13:09:56.478453 28997 consensus_queue.cc:237] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.484946 28595 catalog_manager.cc:5697] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 reported cstate change: term changed from 3 to 4, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:56.502012 29036 raft_consensus.cc:993] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: : Instructing follower 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:56.502519 29036 raft_consensus.cc:1081] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Signalling peer 73d37edb634141d6b6dbb8df5522a819 to start an election
I20260709 13:09:56.504237 28700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44"
dest_uuid: "73d37edb634141d6b6dbb8df5522a819"
 from {username='slave'} at 127.0.0.1:54002
I20260709 13:09:56.504806 28700 raft_consensus.cc:493] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:56.505160 28700 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.509687 28700 raft_consensus.cc:515] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.511202 28700 leader_election.cc:290] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 3 election: Requested vote from peers f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66:35077), 2aca3140d1e74494b8b9dc7a5daf0ad1 (127.27.229.67:38473)
I20260709 13:09:56.511813 28775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f45385570dfc4cfcaf9e054f24182ae4"
I20260709 13:09:56.512163 28849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14303d7f41b84f538cec2cfc56eafa44" candidate_uuid: "73d37edb634141d6b6dbb8df5522a819" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1"
I20260709 13:09:56.512343 28775 raft_consensus.cc:3055] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:56.512591 28849 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.512645 28775 raft_consensus.cc:740] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f45385570dfc4cfcaf9e054f24182ae4, State: Running, Role: LEADER
I20260709 13:09:56.513394 28775 consensus_queue.cc:260] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.514283 28775 raft_consensus.cc:3060] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:56.516942 28849 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 3.
I20260709 13:09:56.517903 28666 leader_election.cc:304] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aca3140d1e74494b8b9dc7a5daf0ad1, 73d37edb634141d6b6dbb8df5522a819; no voters: 
I20260709 13:09:56.518323 28775 raft_consensus.cc:2468] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73d37edb634141d6b6dbb8df5522a819 in term 3.
I20260709 13:09:56.518779 29044 raft_consensus.cc:2804] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:56.519169 29044 raft_consensus.cc:697] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 3 LEADER]: Becoming Leader. State: Replica: 73d37edb634141d6b6dbb8df5522a819, State: Running, Role: LEADER
I20260709 13:09:56.519889 29044 consensus_queue.cc:237] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } }
I20260709 13:09:56.526588 28595 catalog_manager.cc:5697] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 reported cstate change: term changed from 2 to 3, leader changed from f45385570dfc4cfcaf9e054f24182ae4 (127.27.229.66) to 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "73d37edb634141d6b6dbb8df5522a819" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.576519 28775 raft_consensus.cc:1275] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.577703 28997 consensus_queue.cc:1048] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.589370 28700 raft_consensus.cc:1275] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.590659 28997 consensus_queue.cc:1048] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.626423 28775 raft_consensus.cc:1275] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:56.627590 29044 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.633700 28849 raft_consensus.cc:1275] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:56.635354 29045 consensus_queue.cc:1048] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:56.700363 28849 raft_consensus.cc:1275] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.701594 29045 consensus_queue.cc:1048] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.709971 28775 raft_consensus.cc:1275] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:56.712109 29044 consensus_queue.cc:1048] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:56.972292 28775 raft_consensus.cc:1275] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:56.973549 28997 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:56.982264 28700 raft_consensus.cc:1275] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Refusing update from remote peer 2aca3140d1e74494b8b9dc7a5daf0ad1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:56.984280 29037 consensus_queue.cc:1048] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73d37edb634141d6b6dbb8df5522a819" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 43065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:57.020509 28775 raft_consensus.cc:1275] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:57.021647 29044 consensus_queue.cc:1048] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f45385570dfc4cfcaf9e054f24182ae4" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 35077 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.030670 28849 raft_consensus.cc:1275] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Refusing update from remote peer 73d37edb634141d6b6dbb8df5522a819: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:57.033784 29059 consensus_queue.cc:1048] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aca3140d1e74494b8b9dc7a5daf0ad1" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:57.034992 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:57.042579 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
I20260709 13:09:57.073390 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:57.074142 28565 tablet_replica.cc:333] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.074801 28565 raft_consensus.cc:2243] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.075314 28565 raft_consensus.cc:2272] T de240b9d3c9c4605870a3f682c7cbf07 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.078030 28565 tablet_replica.cc:333] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.078583 28565 raft_consensus.cc:2243] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.079011 28565 raft_consensus.cc:2272] T 8867dd12925a4fd68dc0ca76371918e6 P 73d37edb634141d6b6dbb8df5522a819 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.080621 28565 tablet_replica.cc:333] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.081236 28565 raft_consensus.cc:2243] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.081990 28565 raft_consensus.cc:2272] T 14303d7f41b84f538cec2cfc56eafa44 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.083846 28565 tablet_replica.cc:333] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.084321 28565 raft_consensus.cc:2243] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.084800 28565 raft_consensus.cc:2272] T bb4bfbc591d74685a14782282e406757 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.087248 28565 tablet_replica.cc:333] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
W20260709 13:09:57.087255 28813 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:57.087937 28565 raft_consensus.cc:2243] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.088667 28565 raft_consensus.cc:2272] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:57.090582 28813 consensus_peers.cc:597] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 -> Peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Couldn't send request to peer 73d37edb634141d6b6dbb8df5522a819. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.090962 28565 tablet_replica.cc:333] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.091498 28565 raft_consensus.cc:2243] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.091957 28565 raft_consensus.cc:2272] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 73d37edb634141d6b6dbb8df5522a819 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.093667 28565 tablet_replica.cc:333] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.094161 28565 raft_consensus.cc:2243] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.094857 28565 raft_consensus.cc:2272] T 01d9e60f02d34722b1f043986c84c68e P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.096812 28565 tablet_replica.cc:333] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.097260 28565 raft_consensus.cc:2243] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.097663 28565 raft_consensus.cc:2272] T 961488caa8e649e3997a9ea99b2b23ec P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.099213 28565 tablet_replica.cc:333] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819: stopping tablet replica
I20260709 13:09:57.099654 28565 raft_consensus.cc:2243] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.100076 28565 raft_consensus.cc:2272] T 7144cec527c748c8a33b32addb0febb4 P 73d37edb634141d6b6dbb8df5522a819 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.192698 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
W20260709 13:09:57.194324 28813 consensus_peers.cc:597] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 -> Peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Couldn't send request to peer 73d37edb634141d6b6dbb8df5522a819. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:43065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.212128 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
W20260709 13:09:57.228792 28739 consensus_peers.cc:597] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 -> Peer 73d37edb634141d6b6dbb8df5522a819 (127.27.229.65:43065): Couldn't send request to peer 73d37edb634141d6b6dbb8df5522a819. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:43065: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:57.239243 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:57.239907 28565 tablet_replica.cc:333] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.240454 28565 raft_consensus.cc:2243] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.241218 28565 raft_consensus.cc:2272] T 961488caa8e649e3997a9ea99b2b23ec P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.243075 28565 tablet_replica.cc:333] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.243587 28565 raft_consensus.cc:2243] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.244006 28565 raft_consensus.cc:2272] T 8867dd12925a4fd68dc0ca76371918e6 P f45385570dfc4cfcaf9e054f24182ae4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.245662 28565 tablet_replica.cc:333] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.246198 28565 raft_consensus.cc:2243] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.246943 28565 raft_consensus.cc:2272] T 7144cec527c748c8a33b32addb0febb4 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.248544 28565 tablet_replica.cc:333] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.249017 28565 raft_consensus.cc:2243] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.249398 28565 raft_consensus.cc:2272] T de240b9d3c9c4605870a3f682c7cbf07 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.251531 28565 tablet_replica.cc:333] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.252012 28565 raft_consensus.cc:2243] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.252708 28565 raft_consensus.cc:2272] T 107ea945a6124c3ca4f6f8d645cd0fb6 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.254315 28565 tablet_replica.cc:333] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.254774 28565 raft_consensus.cc:2243] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.255174 28565 raft_consensus.cc:2272] T cbfb1ba3eeb0453faec51c1a1a15dce3 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.257061 28565 tablet_replica.cc:333] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.257545 28565 raft_consensus.cc:2243] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.257951 28565 raft_consensus.cc:2272] T 01d9e60f02d34722b1f043986c84c68e P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.259976 28565 tablet_replica.cc:333] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.260452 28565 raft_consensus.cc:2243] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.260842 28565 raft_consensus.cc:2272] T bb4bfbc591d74685a14782282e406757 P f45385570dfc4cfcaf9e054f24182ae4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.262802 28565 tablet_replica.cc:333] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4: stopping tablet replica
I20260709 13:09:57.263230 28565 raft_consensus.cc:2243] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.263615 28565 raft_consensus.cc:2272] T 14303d7f41b84f538cec2cfc56eafa44 P f45385570dfc4cfcaf9e054f24182ae4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.289899 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
I20260709 13:09:57.305908 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
I20260709 13:09:57.326426 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:57.327112 28565 tablet_replica.cc:333] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.327657 28565 raft_consensus.cc:2243] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.328382 28565 raft_consensus.cc:2272] T 8867dd12925a4fd68dc0ca76371918e6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.330078 28565 tablet_replica.cc:333] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.330641 28565 raft_consensus.cc:2243] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.331058 28565 raft_consensus.cc:2272] T 01d9e60f02d34722b1f043986c84c68e P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.332993 28565 tablet_replica.cc:333] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.333483 28565 raft_consensus.cc:2243] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.333884 28565 raft_consensus.cc:2272] T cbfb1ba3eeb0453faec51c1a1a15dce3 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.335929 28565 tablet_replica.cc:333] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.336390 28565 raft_consensus.cc:2243] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.336796 28565 raft_consensus.cc:2272] T 107ea945a6124c3ca4f6f8d645cd0fb6 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.338377 28565 tablet_replica.cc:333] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.338829 28565 raft_consensus.cc:2243] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.339479 28565 raft_consensus.cc:2272] T de240b9d3c9c4605870a3f682c7cbf07 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.341221 28565 tablet_replica.cc:333] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.341667 28565 raft_consensus.cc:2243] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.342125 28565 raft_consensus.cc:2272] T 14303d7f41b84f538cec2cfc56eafa44 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.344089 28565 tablet_replica.cc:333] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.344553 28565 raft_consensus.cc:2243] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.345219 28565 raft_consensus.cc:2272] T bb4bfbc591d74685a14782282e406757 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.346987 28565 tablet_replica.cc:333] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.347414 28565 raft_consensus.cc:2243] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.347790 28565 raft_consensus.cc:2272] T 7144cec527c748c8a33b32addb0febb4 P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.349294 28565 tablet_replica.cc:333] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1: stopping tablet replica
I20260709 13:09:57.349711 28565 raft_consensus.cc:2243] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.350140 28565 raft_consensus.cc:2272] T 961488caa8e649e3997a9ea99b2b23ec P 2aca3140d1e74494b8b9dc7a5daf0ad1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.375656 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
I20260709 13:09:57.391587 28565 master.cc:562] Master@127.27.229.126:45497 shutting down...
I20260709 13:09:57.528813 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:57.529337 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.529665 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P ead9d43d71514fc6b7b9e88d863893c9: stopping tablet replica
I20260709 13:09:57.548799 28565 master.cc:584] Master@127.27.229.126:45497 shutdown complete.
2aca3140d1e74494b8b9dc7a5daf0ad1  1
73d37edb634141d6b6dbb8df5522a819  4
f45385570dfc4cfcaf9e054f24182ae4  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12457 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:09:57.585621 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:38135
I20260709 13:09:57.586758 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.592502 29069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.592521 29070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.592751 29072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.593945 28565 server_base.cc:1061] running on GCE node
I20260709 13:09:57.594794 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.594971 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.595084 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602597595073 us; error 0 us; skew 500 ppm
I20260709 13:09:57.595544 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.597793 28565 webserver.cc:533] Webserver started at http://127.27.229.126:45151/ using document root <none> and password file <none>
I20260709 13:09:57.598376 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.598536 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.598750 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.599785 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "604cf017bfa748adbdea597ef4787664"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-twc1"
I20260709 13:09:57.604027 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:57.607218 29077 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.607893 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:57.608155 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "604cf017bfa748adbdea597ef4787664"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-twc1"
I20260709 13:09:57.608433 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.632786 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.634044 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.670315 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:38135
I20260709 13:09:57.670406 29128 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:38135 every 8 connection(s)
I20260709 13:09:57.674166 29129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:57.683449 29129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664: Bootstrap starting.
I20260709 13:09:57.688040 29129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:57.692126 29129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664: No bootstrap required, opened a new log
I20260709 13:09:57.694713 29129 raft_consensus.cc:359] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604cf017bfa748adbdea597ef4787664" member_type: VOTER }
I20260709 13:09:57.695250 29129 raft_consensus.cc:385] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:57.695529 29129 raft_consensus.cc:740] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604cf017bfa748adbdea597ef4787664, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.696213 29129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604cf017bfa748adbdea597ef4787664" member_type: VOTER }
I20260709 13:09:57.696713 29129 raft_consensus.cc:399] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:57.697016 29129 raft_consensus.cc:493] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:57.697333 29129 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:57.702672 29129 raft_consensus.cc:515] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604cf017bfa748adbdea597ef4787664" member_type: VOTER }
I20260709 13:09:57.703233 29129 leader_election.cc:304] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 604cf017bfa748adbdea597ef4787664; no voters: 
I20260709 13:09:57.704315 29129 leader_election.cc:290] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:57.704625 29132 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:57.705963 29132 raft_consensus.cc:697] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 1 LEADER]: Becoming Leader. State: Replica: 604cf017bfa748adbdea597ef4787664, State: Running, Role: LEADER
I20260709 13:09:57.706611 29132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604cf017bfa748adbdea597ef4787664" member_type: VOTER }
I20260709 13:09:57.707244 29129 sys_catalog.cc:565] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:57.710819 29133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "604cf017bfa748adbdea597ef4787664" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604cf017bfa748adbdea597ef4787664" member_type: VOTER } }
I20260709 13:09:57.711498 29133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:57.711467 29134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 604cf017bfa748adbdea597ef4787664. Latest consensus state: current_term: 1 leader_uuid: "604cf017bfa748adbdea597ef4787664" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604cf017bfa748adbdea597ef4787664" member_type: VOTER } }
I20260709 13:09:57.712126 29134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:57.714195 29138 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:57.721673 29138 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:57.723502 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:57.730456 29138 catalog_manager.cc:1383] Generated new cluster ID: 72f4c257c4fb4ca5aab54912016f4e9d
I20260709 13:09:57.730763 29138 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:57.770988 29138 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:57.772193 29138 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:57.785619 29138 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664: Generated new TSK 0
I20260709 13:09:57.786278 29138 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:57.854024 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.859827 29150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.860715 29151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.861948 29153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.862494 28565 server_base.cc:1061] running on GCE node
I20260709 13:09:57.863246 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.863441 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.863598 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602597863578 us; error 0 us; skew 500 ppm
I20260709 13:09:57.864085 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.866519 28565 webserver.cc:533] Webserver started at http://127.27.229.65:34333/ using document root <none> and password file <none>
I20260709 13:09:57.866983 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.867154 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.867408 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.868428 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-twc1"
I20260709 13:09:57.872790 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:09:57.876219 29158 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.876921 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:57.877208 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-twc1"
I20260709 13:09:57.877478 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.896387 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.897621 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.899108 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:57.901427 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:57.901644 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.901877 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:57.902072 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:57.941179 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:33581
I20260709 13:09:57.941272 29220 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:33581 every 8 connection(s)
I20260709 13:09:57.945940 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.952490 29225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.953188 29226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.955942 29228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.956525 28565 server_base.cc:1061] running on GCE node
I20260709 13:09:57.957387 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.957585 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.957736 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602597957718 us; error 0 us; skew 500 ppm
I20260709 13:09:57.958262 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.960417 28565 webserver.cc:533] Webserver started at http://127.27.229.66:33643/ using document root <none> and password file <none>
I20260709 13:09:57.960879 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.961059 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:57.961321 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:57.962476 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "49195b9666374b8e928416b05f269c55"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-twc1"
I20260709 13:09:57.967020 29221 heartbeater.cc:344] Connected to a master server at 127.27.229.126:38135
I20260709 13:09:57.967406 29221 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:57.967888 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:57.968142 29221 heartbeater.cc:507] Master 127.27.229.126:38135 requested a full tablet report, sending...
I20260709 13:09:57.970252 29094 ts_manager.cc:194] Registered new tserver with Master: 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581)
I20260709 13:09:57.971509 29233 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.972317 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:57.972513 29094 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55384
I20260709 13:09:57.972661 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "49195b9666374b8e928416b05f269c55"
format_stamp: "Formatted at 2026-07-09 13:09:57 on dist-test-slave-twc1"
I20260709 13:09:57.973035 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:58.023898 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:58.025104 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:58.026533 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:58.028817 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:58.029006 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.029271 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:58.029418 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.087756 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:39011
I20260709 13:09:58.087914 29295 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:39011 every 8 connection(s)
I20260709 13:09:58.092377 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:58.099099 29299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:58.101229 29300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:58.106743 29302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:58.107191 29296 heartbeater.cc:344] Connected to a master server at 127.27.229.126:38135
I20260709 13:09:58.107661 29296 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:58.107915 28565 server_base.cc:1061] running on GCE node
I20260709 13:09:58.108716 29296 heartbeater.cc:507] Master 127.27.229.126:38135 requested a full tablet report, sending...
I20260709 13:09:58.109058 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:58.109319 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:58.109489 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602598109471 us; error 0 us; skew 500 ppm
I20260709 13:09:58.110222 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:58.111274 29094 ts_manager.cc:194] Registered new tserver with Master: 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:58.112937 28565 webserver.cc:533] Webserver started at http://127.27.229.67:36419/ using document root <none> and password file <none>
I20260709 13:09:58.113112 29094 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55390
I20260709 13:09:58.113471 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:58.113708 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:58.114017 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:58.115151 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
format_stamp: "Formatted at 2026-07-09 13:09:58 on dist-test-slave-twc1"
I20260709 13:09:58.120198 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:58.123466 29307 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.124203 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:58.124509 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
format_stamp: "Formatted at 2026-07-09 13:09:58 on dist-test-slave-twc1"
I20260709 13:09:58.124804 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:58.144919 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:58.146219 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:58.147646 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:58.149860 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:58.150100 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.150331 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:58.150482 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:58.189905 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:39155
I20260709 13:09:58.190059 29369 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:39155 every 8 connection(s)
I20260709 13:09:58.203171 29370 heartbeater.cc:344] Connected to a master server at 127.27.229.126:38135
I20260709 13:09:58.203517 29370 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:58.204223 29370 heartbeater.cc:507] Master 127.27.229.126:38135 requested a full tablet report, sending...
I20260709 13:09:58.206090 29094 ts_manager.cc:194] Registered new tserver with Master: d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:58.206338 28565 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013513606s
I20260709 13:09:58.207398 29094 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55398
I20260709 13:09:58.231889 29094 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55408:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:58.234686 29094 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:58.307844 29335 tablet_service.cc:1511] Processing CreateTablet for tablet 50104813c534412093bddca68cd83cdf (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:58.309332 29335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50104813c534412093bddca68cd83cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.315112 29334 tablet_service.cc:1511] Processing CreateTablet for tablet b3739ec8e1ac4e3b88c90fb2385ea429 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:58.316591 29334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3739ec8e1ac4e3b88c90fb2385ea429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.324616 29333 tablet_service.cc:1511] Processing CreateTablet for tablet 617574c688d3413abd234a67bbd120fd (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:58.326188 29384 tablet_bootstrap.cc:492] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.326896 29333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617574c688d3413abd234a67bbd120fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.328670 29332 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8493ef9b9a4eaa92d60e35d0574070 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:58.329211 29330 tablet_service.cc:1511] Processing CreateTablet for tablet 64d7c033ab8f4169863e0383f1442170 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:58.330243 29332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8493ef9b9a4eaa92d60e35d0574070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.330914 29330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d7c033ab8f4169863e0383f1442170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.335187 29331 tablet_service.cc:1511] Processing CreateTablet for tablet d5ef1009c48045c4a021e37f250dc06f (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:58.336566 29331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ef1009c48045c4a021e37f250dc06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.337641 29334 tablet_service.cc:1511] Processing CreateTablet for tablet c260d0eda1fa4286af5f5a15c2f49869 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:58.338909 29334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c260d0eda1fa4286af5f5a15c2f49869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.342630 29384 tablet_bootstrap.cc:654] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.348978 29186 tablet_service.cc:1511] Processing CreateTablet for tablet 50104813c534412093bddca68cd83cdf (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:58.350374 29186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50104813c534412093bddca68cd83cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.342355 29329 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3a6a0c39894fc4b7ffa3227deea924 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:58.354765 29329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3a6a0c39894fc4b7ffa3227deea924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.355199 29335 tablet_service.cc:1511] Processing CreateTablet for tablet 63f6750cee374c4c8b89dcd0111dfd90 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:58.345417 29328 tablet_service.cc:1511] Processing CreateTablet for tablet 9894e675acac4126a857f9cf38fea226 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:58.364189 29335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f6750cee374c4c8b89dcd0111dfd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.364933 29328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9894e675acac4126a857f9cf38fea226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.371186 29185 tablet_service.cc:1511] Processing CreateTablet for tablet b3739ec8e1ac4e3b88c90fb2385ea429 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:58.372577 29185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3739ec8e1ac4e3b88c90fb2385ea429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.375129 29184 tablet_service.cc:1511] Processing CreateTablet for tablet 617574c688d3413abd234a67bbd120fd (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:58.376538 29184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617574c688d3413abd234a67bbd120fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.376343 29260 tablet_service.cc:1511] Processing CreateTablet for tablet b3739ec8e1ac4e3b88c90fb2385ea429 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:58.377655 29260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3739ec8e1ac4e3b88c90fb2385ea429. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.379235 29183 tablet_service.cc:1511] Processing CreateTablet for tablet 63f6750cee374c4c8b89dcd0111dfd90 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:58.380703 29183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f6750cee374c4c8b89dcd0111dfd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.382179 29259 tablet_service.cc:1511] Processing CreateTablet for tablet 617574c688d3413abd234a67bbd120fd (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:58.383049 29182 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8493ef9b9a4eaa92d60e35d0574070 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:58.383524 29259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 617574c688d3413abd234a67bbd120fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.375037 29261 tablet_service.cc:1511] Processing CreateTablet for tablet 50104813c534412093bddca68cd83cdf (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:58.384830 29261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50104813c534412093bddca68cd83cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.385169 29181 tablet_service.cc:1511] Processing CreateTablet for tablet d5ef1009c48045c4a021e37f250dc06f (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:58.387112 29258 tablet_service.cc:1511] Processing CreateTablet for tablet 63f6750cee374c4c8b89dcd0111dfd90 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:58.388445 29258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f6750cee374c4c8b89dcd0111dfd90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.388170 29179 tablet_service.cc:1511] Processing CreateTablet for tablet c260d0eda1fa4286af5f5a15c2f49869 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:58.393390 29254 tablet_service.cc:1511] Processing CreateTablet for tablet c260d0eda1fa4286af5f5a15c2f49869 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:58.394745 29254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c260d0eda1fa4286af5f5a15c2f49869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.396267 29252 tablet_service.cc:1511] Processing CreateTablet for tablet 9894e675acac4126a857f9cf38fea226 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:58.397156 29384 tablet_bootstrap.cc:492] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:58.397632 29384 ts_tablet_manager.cc:1403] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.017s
I20260709 13:09:58.399372 29257 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8493ef9b9a4eaa92d60e35d0574070 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:58.400056 29255 tablet_service.cc:1511] Processing CreateTablet for tablet 64d7c033ab8f4169863e0383f1442170 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:58.401512 29384 raft_consensus.cc:359] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.402288 29384 raft_consensus.cc:385] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.402575 29384 raft_consensus.cc:740] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.404349 29384 consensus_queue.cc:260] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.409595 29178 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3a6a0c39894fc4b7ffa3227deea924 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:58.397787 29252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9894e675acac4126a857f9cf38fea226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.387112 29180 tablet_service.cc:1511] Processing CreateTablet for tablet 64d7c033ab8f4169863e0383f1442170 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:58.412310 29256 tablet_service.cc:1511] Processing CreateTablet for tablet d5ef1009c48045c4a021e37f250dc06f (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:58.396230 29253 tablet_service.cc:1511] Processing CreateTablet for tablet 5e3a6a0c39894fc4b7ffa3227deea924 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:58.414904 29253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3a6a0c39894fc4b7ffa3227deea924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.418285 29257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8493ef9b9a4eaa92d60e35d0574070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.422145 29182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8493ef9b9a4eaa92d60e35d0574070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.426435 29181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ef1009c48045c4a021e37f250dc06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.430871 29177 tablet_service.cc:1511] Processing CreateTablet for tablet 9894e675acac4126a857f9cf38fea226 (DEFAULT_TABLE table=test-workload [id=cb38f3c8fbe544759ed68c5b364d6d2a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:58.471697 29177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9894e675acac4126a857f9cf38fea226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.474927 29178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e3a6a0c39894fc4b7ffa3227deea924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.481297 29180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d7c033ab8f4169863e0383f1442170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.484632 29256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ef1009c48045c4a021e37f250dc06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.489346 29179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c260d0eda1fa4286af5f5a15c2f49869. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.492676 29255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d7c033ab8f4169863e0383f1442170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.493434 29386 tablet_bootstrap.cc:492] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:58.518945 29387 tablet_bootstrap.cc:492] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.525180 29387 tablet_bootstrap.cc:654] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.532838 29370 heartbeater.cc:499] Master 127.27.229.126:38135 was elected leader, sending a full tablet report...
I20260709 13:09:58.534047 29387 tablet_bootstrap.cc:492] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.534765 29387 ts_tablet_manager.cc:1403] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 13:09:58.537729 29387 raft_consensus.cc:359] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.538615 29387 raft_consensus.cc:385] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.538985 29387 raft_consensus.cc:740] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.539958 29387 consensus_queue.cc:260] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.539096 29384 ts_tablet_manager.cc:1434] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.141s	user 0.007s	sys 0.000s
I20260709 13:09:58.542724 29384 tablet_bootstrap.cc:492] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.537845 29386 tablet_bootstrap.cc:654] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.549274 29296 heartbeater.cc:499] Master 127.27.229.126:38135 was elected leader, sending a full tablet report...
I20260709 13:09:58.567546 29387 ts_tablet_manager.cc:1434] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.004s
I20260709 13:09:58.568619 29387 tablet_bootstrap.cc:492] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.576174 29387 tablet_bootstrap.cc:654] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.582844 29384 tablet_bootstrap.cc:654] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.593556 29386 tablet_bootstrap.cc:492] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:58.594185 29386 ts_tablet_manager.cc:1403] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.000s
I20260709 13:09:58.597430 29386 raft_consensus.cc:359] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.598315 29386 raft_consensus.cc:385] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.598647 29386 raft_consensus.cc:740] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.617182 29386 consensus_queue.cc:260] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.629534 29387 tablet_bootstrap.cc:492] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.630081 29387 ts_tablet_manager.cc:1403] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.062s	user 0.037s	sys 0.022s
I20260709 13:09:58.630299 29384 tablet_bootstrap.cc:492] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:58.630761 29384 ts_tablet_manager.cc:1403] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.088s	user 0.031s	sys 0.018s
I20260709 13:09:58.632850 29387 raft_consensus.cc:359] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.633591 29387 raft_consensus.cc:385] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.633883 29387 raft_consensus.cc:740] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.634371 29384 raft_consensus.cc:359] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.634660 29387 consensus_queue.cc:260] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.635082 29384 raft_consensus.cc:385] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.635412 29384 raft_consensus.cc:740] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.636157 29384 consensus_queue.cc:260] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.637053 29387 ts_tablet_manager.cc:1434] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:58.637984 29387 tablet_bootstrap.cc:492] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.639964 29384 ts_tablet_manager.cc:1434] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:58.640959 29384 tablet_bootstrap.cc:492] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.643913 29221 heartbeater.cc:499] Master 127.27.229.126:38135 was elected leader, sending a full tablet report...
I20260709 13:09:58.644189 29387 tablet_bootstrap.cc:654] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.647341 29384 tablet_bootstrap.cc:654] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.654476 29386 ts_tablet_manager.cc:1434] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.060s	user 0.015s	sys 0.008s
I20260709 13:09:58.655516 29386 tablet_bootstrap.cc:492] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:58.655898 29387 tablet_bootstrap.cc:492] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.656446 29387 ts_tablet_manager.cc:1403] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:09:58.659567 29387 raft_consensus.cc:359] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.660423 29387 raft_consensus.cc:385] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.660748 29387 raft_consensus.cc:740] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.662595 29386 tablet_bootstrap.cc:654] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.662938 29387 consensus_queue.cc:260] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.664170 29384 tablet_bootstrap.cc:492] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:58.664683 29384 ts_tablet_manager.cc:1403] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.015s
I20260709 13:09:58.664777 29388 raft_consensus.cc:493] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.665313 29388 raft_consensus.cc:515] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.667029 29387 ts_tablet_manager.cc:1434] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:09:58.667663 29384 raft_consensus.cc:359] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.668076 29387 tablet_bootstrap.cc:492] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.668406 29384 raft_consensus.cc:385] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.668737 29384 raft_consensus.cc:740] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.669615 29384 consensus_queue.cc:260] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.668068 29388 leader_election.cc:290] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:58.678128 29387 tablet_bootstrap.cc:654] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.683782 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
W20260709 13:09:58.685668 29310 leader_election.cc:343] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.691956 29387 tablet_bootstrap.cc:492] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.692586 29387 ts_tablet_manager.cc:1403] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.003s
I20260709 13:09:58.694653 29384 ts_tablet_manager.cc:1434] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.005s
I20260709 13:09:58.695724 29384 tablet_bootstrap.cc:492] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.697425 29387 raft_consensus.cc:359] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.698194 29387 raft_consensus.cc:385] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.698503 29387 raft_consensus.cc:740] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.702025 29384 tablet_bootstrap.cc:654] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.701691 29387 consensus_queue.cc:260] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.706602 29390 raft_consensus.cc:493] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.707103 29390 raft_consensus.cc:515] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.710008 29390 leader_election.cc:290] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155), 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581)
I20260709 13:09:58.714046 29384 tablet_bootstrap.cc:492] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:58.714534 29384 ts_tablet_manager.cc:1403] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:09:58.705984 29387 ts_tablet_manager.cc:1434] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:58.716321 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
I20260709 13:09:58.717185 29271 raft_consensus.cc:2468] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 0.
W20260709 13:09:58.718971 29142 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:58.718801 29310 leader_election.cc:304] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:58.717371 29387 tablet_bootstrap.cc:492] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.720162 29398 raft_consensus.cc:2804] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.720570 29398 raft_consensus.cc:493] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.720902 29398 raft_consensus.cc:3060] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.728886 29398 raft_consensus.cc:515] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.733887 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:58.734756 29387 tablet_bootstrap.cc:654] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:58.735212 29310 leader_election.cc:343] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.736136 29398 leader_election.cc:290] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:58.737342 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:58.731541 29384 raft_consensus.cc:359] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.737879 29384 raft_consensus.cc:385] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.738008 29271 raft_consensus.cc:3060] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.738256 29384 raft_consensus.cc:740] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.739296 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:58.739120 29384 consensus_queue.cc:260] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.739884 29345 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:58.741369 29384 ts_tablet_manager.cc:1434] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:09:58.742617 29384 tablet_bootstrap.cc:492] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.749027 29384 tablet_bootstrap.cc:654] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.755143 29236 leader_election.cc:304] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:58.756268 29390 raft_consensus.cc:2804] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.756671 29390 raft_consensus.cc:493] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.756994 29390 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.757419 29386 tablet_bootstrap.cc:492] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:58.757733 29387 tablet_bootstrap.cc:492] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.757957 29386 ts_tablet_manager.cc:1403] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.103s	user 0.032s	sys 0.059s
I20260709 13:09:58.758221 29387 ts_tablet_manager.cc:1403] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 13:09:58.760856 29386 raft_consensus.cc:359] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.761585 29386 raft_consensus.cc:385] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.761904 29386 raft_consensus.cc:740] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.762739 29386 consensus_queue.cc:260] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.764907 29386 ts_tablet_manager.cc:1434] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:58.764973 29390 raft_consensus.cc:515] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:58.766000 29386 tablet_bootstrap.cc:492] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:58.766563 29387 raft_consensus.cc:359] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.768647 29387 raft_consensus.cc:385] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.771262 29387 raft_consensus.cc:740] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.773453 29387 consensus_queue.cc:260] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.773963 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:58.774570 29196 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:58.767771 29271 raft_consensus.cc:2468] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 1.
I20260709 13:09:58.772738 29386 tablet_bootstrap.cc:654] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.777796 29310 leader_election.cc:304] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:58.778623 29398 raft_consensus.cc:2804] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.779102 29398 raft_consensus.cc:697] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:58.779906 29398 consensus_queue.cc:237] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.781450 29390 leader_election.cc:290] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Requested vote from peers d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155), 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581)
I20260709 13:09:58.783190 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:58.783768 29345 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.786527 29384 tablet_bootstrap.cc:492] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:58.787048 29384 ts_tablet_manager.cc:1403] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.020s
I20260709 13:09:58.791371 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:58.794839 29196 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.792157 29345 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:58.801216 29196 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:58.801213 29387 ts_tablet_manager.cc:1434] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.043s	user 0.016s	sys 0.014s
I20260709 13:09:58.802955 29387 tablet_bootstrap.cc:492] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.789898 29384 raft_consensus.cc:359] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.805382 29236 leader_election.cc:304] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:58.810165 29384 raft_consensus.cc:385] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.810632 29384 raft_consensus.cc:740] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.811511 29384 consensus_queue.cc:260] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.812443 29387 tablet_bootstrap.cc:654] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.813612 29386 tablet_bootstrap.cc:492] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:58.814073 29384 ts_tablet_manager.cc:1434] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:09:58.814147 29386 ts_tablet_manager.cc:1403] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.025s
I20260709 13:09:58.815165 29384 tablet_bootstrap.cc:492] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.814639 29092 catalog_manager.cc:5697] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.817462 29386 raft_consensus.cc:359] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.818449 29386 raft_consensus.cc:385] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.818795 29386 raft_consensus.cc:740] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.819672 29386 consensus_queue.cc:260] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.822220 29384 tablet_bootstrap.cc:654] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.822443 29386 ts_tablet_manager.cc:1434] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:09:58.823653 29386 tablet_bootstrap.cc:492] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:58.826725 29390 raft_consensus.cc:2804] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.830946 29386 tablet_bootstrap.cc:654] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.832388 29413 raft_consensus.cc:493] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.832942 29413 raft_consensus.cc:515] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.834903 29406 raft_consensus.cc:493] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.837215 29406 raft_consensus.cc:515] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.839211 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:58.840366 29406 leader_election.cc:290] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:58.841667 29406 raft_consensus.cc:493] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.841599 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:58.843145 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:58.836616 29384 tablet_bootstrap.cc:492] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:58.846813 29345 raft_consensus.cc:2468] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:58.847069 29384 ts_tablet_manager.cc:1403] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.006s
I20260709 13:09:58.847751 29406 raft_consensus.cc:515] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.850302 29384 raft_consensus.cc:359] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.850991 29384 raft_consensus.cc:385] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.851260 29384 raft_consensus.cc:740] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.843595 29390 raft_consensus.cc:697] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:58.852387 29390 consensus_queue.cc:237] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
W20260709 13:09:58.843869 29236 leader_election.cc:343] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.857358 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:58.858079 29236 leader_election.cc:304] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:58.858274 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
W20260709 13:09:58.858955 29236 leader_election.cc:343] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:58.859802 29236 leader_election.cc:343] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.860400 29412 raft_consensus.cc:2804] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.860976 29412 raft_consensus.cc:493] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.861406 29412 raft_consensus.cc:3060] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.862212 29384 consensus_queue.cc:260] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
W20260709 13:09:58.860464 29236 leader_election.cc:343] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.863250 29236 leader_election.cc:304] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49195b9666374b8e928416b05f269c55; no voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:09:58.865820 29413 leader_election.cc:290] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:58.849759 29406 leader_election.cc:290] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:58.868404 29384 ts_tablet_manager.cc:1434] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.005s
I20260709 13:09:58.869524 29384 tablet_bootstrap.cc:492] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.866420 29413 raft_consensus.cc:2749] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.876086 29386 tablet_bootstrap.cc:492] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:58.876365 29387 tablet_bootstrap.cc:492] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.876317 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:58.876715 29386 ts_tablet_manager.cc:1403] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.025s
I20260709 13:09:58.875698 29412 raft_consensus.cc:515] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.877007 29387 ts_tablet_manager.cc:1403] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.050s
I20260709 13:09:58.878839 29412 leader_election.cc:290] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:58.880403 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:58.880846 29345 raft_consensus.cc:3060] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.880622 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:58.881094 29387 raft_consensus.cc:359] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.881860 29387 raft_consensus.cc:385] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.882196 29387 raft_consensus.cc:740] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.882941 29387 consensus_queue.cc:260] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.884316 29386 raft_consensus.cc:359] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.885154 29386 raft_consensus.cc:385] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.885675 29386 raft_consensus.cc:740] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.887715 29345 raft_consensus.cc:2468] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:58.885176 29387 ts_tablet_manager.cc:1434] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:58.889521 29387 tablet_bootstrap.cc:492] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.891817 29384 tablet_bootstrap.cc:654] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.893289 29398 raft_consensus.cc:493] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.893239 29386 consensus_queue.cc:260] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.893877 29398 raft_consensus.cc:515] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.895967 29398 leader_election.cc:290] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:58.897560 29387 tablet_bootstrap.cc:654] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.898674 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:58.898893 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
W20260709 13:09:58.900424 29310 leader_election.cc:343] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.901124 29196 raft_consensus.cc:2468] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 0.
I20260709 13:09:58.902626 29386 ts_tablet_manager.cc:1434] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 13:09:58.903776 29386 tablet_bootstrap.cc:492] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:58.904294 29310 leader_election.cc:304] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 49195b9666374b8e928416b05f269c55
I20260709 13:09:58.905443 29398 raft_consensus.cc:2804] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.905789 29398 raft_consensus.cc:493] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.906185 29398 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.910974 29386 tablet_bootstrap.cc:654] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.913107 29398 raft_consensus.cc:515] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.915972 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:58.916561 29196 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:58.922174 29386 tablet_bootstrap.cc:492] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:58.922787 29386 ts_tablet_manager.cc:1403] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
W20260709 13:09:58.923801 29236 leader_election.cc:343] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.924201 29236 leader_election.cc:304] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49195b9666374b8e928416b05f269c55; no voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:09:58.924932 29417 raft_consensus.cc:2749] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:58.925284 29236 leader_election.cc:304] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:58.926106 29417 raft_consensus.cc:2804] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.926522 29417 raft_consensus.cc:697] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:58.927244 29417 consensus_queue.cc:237] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.927762 29387 tablet_bootstrap.cc:492] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.928321 29387 ts_tablet_manager.cc:1403] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 13:09:58.931658 29387 raft_consensus.cc:359] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.932482 29387 raft_consensus.cc:385] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.932804 29387 raft_consensus.cc:740] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.933295 29094 catalog_manager.cc:5697] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.922940 29196 raft_consensus.cc:2468] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 1.
I20260709 13:09:58.934557 29386 raft_consensus.cc:359] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.935359 29386 raft_consensus.cc:385] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:58.935091 29236 leader_election.cc:343] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.935781 29386 raft_consensus.cc:740] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.933581 29387 consensus_queue.cc:260] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.935295 29310 leader_election.cc:304] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:58.936762 29386 consensus_queue.cc:260] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.937554 29388 raft_consensus.cc:2804] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:58.938360 29387 ts_tablet_manager.cc:1434] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:09:58.939319 29387 tablet_bootstrap.cc:492] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.941335 29384 tablet_bootstrap.cc:492] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:58.941505 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:58.941843 29384 ts_tablet_manager.cc:1403] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.028s
W20260709 13:09:58.942957 29310 leader_election.cc:343] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.944977 29384 raft_consensus.cc:359] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.939356 29386 ts_tablet_manager.cc:1434] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:58.946789 29386 tablet_bootstrap.cc:492] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:58.947875 29398 leader_election.cc:290] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:58.945726 29384 raft_consensus.cc:385] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.948585 29384 raft_consensus.cc:740] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.949615 29384 consensus_queue.cc:260] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.952042 29384 ts_tablet_manager.cc:1434] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:58.953075 29386 tablet_bootstrap.cc:654] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.953431 29387 tablet_bootstrap.cc:654] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.953096 29384 tablet_bootstrap.cc:492] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:58.960892 29388 raft_consensus.cc:697] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:58.961809 29388 consensus_queue.cc:237] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.963660 29384 tablet_bootstrap.cc:654] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.964630 29092 catalog_manager.cc:5697] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.974196 29386 tablet_bootstrap.cc:492] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:58.974777 29386 ts_tablet_manager.cc:1403] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.001s
I20260709 13:09:58.975054 29387 tablet_bootstrap.cc:492] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:58.975528 29387 ts_tablet_manager.cc:1403] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.011s
I20260709 13:09:58.978099 29386 raft_consensus.cc:359] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.978168 29387 raft_consensus.cc:359] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.979038 29386 raft_consensus.cc:385] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.979133 29387 raft_consensus.cc:385] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:58.979475 29386 raft_consensus.cc:740] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.979660 29387 raft_consensus.cc:740] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.980448 29387 consensus_queue.cc:260] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.980510 29386 consensus_queue.cc:260] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.982796 29387 ts_tablet_manager.cc:1434] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:58.983707 29387 tablet_bootstrap.cc:492] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:58.986317 29417 raft_consensus.cc:493] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.986816 29417 raft_consensus.cc:515] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:58.988936 29417 leader_election.cc:290] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:58.989059 29387 tablet_bootstrap.cc:654] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:58.990686 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
W20260709 13:09:58.992250 29236 leader_election.cc:343] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.992686 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:58.993023 29386 ts_tablet_manager.cc:1434] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:09:58.993310 29345 raft_consensus.cc:2468] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:58.994606 29236 leader_election.cc:304] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:58.995342 29417 raft_consensus.cc:2804] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:58.995693 29417 raft_consensus.cc:493] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:58.996033 29417 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.000792 29387 tablet_bootstrap.cc:492] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:59.001340 29387 ts_tablet_manager.cc:1403] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 13:09:59.002454 29417 raft_consensus.cc:515] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.003379 29384 tablet_bootstrap.cc:492] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:59.003819 29384 ts_tablet_manager.cc:1403] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.020s
I20260709 13:09:59.004180 29387 raft_consensus.cc:359] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.004918 29387 raft_consensus.cc:385] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.005246 29387 raft_consensus.cc:740] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.005512 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:59.006139 29387 consensus_queue.cc:260] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.006383 29384 raft_consensus.cc:359] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.007042 29384 raft_consensus.cc:385] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:59.006955 29236 leader_election.cc:343] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:59.007488 29384 raft_consensus.cc:740] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.007241 29090 catalog_manager.cc:5697] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.008143 29384 consensus_queue.cc:260] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.008934 29387 ts_tablet_manager.cc:1434] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:09:59.009130 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.009722 29345 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.010226 29387 tablet_bootstrap.cc:492] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55: Bootstrap starting.
I20260709 13:09:59.010169 29384 ts_tablet_manager.cc:1434] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:59.011435 29384 tablet_bootstrap.cc:492] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:59.013365 29386 tablet_bootstrap.cc:492] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:59.015421 29388 raft_consensus.cc:493] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.015908 29388 raft_consensus.cc:515] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.016836 29384 tablet_bootstrap.cc:654] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.019089 29388 leader_election.cc:290] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:59.020008 29386 tablet_bootstrap.cc:654] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.020151 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
I20260709 13:09:59.020905 29271 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 0.
I20260709 13:09:59.021206 29387 tablet_bootstrap.cc:654] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.022307 29310 leader_election.cc:304] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.032810 29387 tablet_bootstrap.cc:492] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55: No bootstrap required, opened a new log
I20260709 13:09:59.032922 29388 raft_consensus.cc:2804] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.033401 29388 raft_consensus.cc:493] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.033481 29387 ts_tablet_manager.cc:1403] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.011s
I20260709 13:09:59.033806 29388 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.036566 29387 raft_consensus.cc:359] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.037410 29387 raft_consensus.cc:385] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.037748 29387 raft_consensus.cc:740] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.038677 29387 consensus_queue.cc:260] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.041045 29387 ts_tablet_manager.cc:1434] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:59.043046 29386 tablet_bootstrap.cc:492] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:59.043558 29386 ts_tablet_manager.cc:1403] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.005s
I20260709 13:09:59.019160 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:59.045540 29196 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 0.
I20260709 13:09:59.046784 29386 raft_consensus.cc:359] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.047487 29386 raft_consensus.cc:385] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.041116 29345 raft_consensus.cc:2468] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:59.047849 29386 raft_consensus.cc:740] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.048403 29417 leader_election.cc:290] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.048952 29236 leader_election.cc:304] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:59.050639 29388 raft_consensus.cc:515] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.051909 29384 tablet_bootstrap.cc:492] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:59.051986 29417 raft_consensus.cc:2804] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.052408 29384 ts_tablet_manager.cc:1403] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.016s
I20260709 13:09:59.048794 29386 consensus_queue.cc:260] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.052879 29388 leader_election.cc:290] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:59.052559 29417 raft_consensus.cc:697] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:59.054251 29386 ts_tablet_manager.cc:1434] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:09:59.054141 29417 consensus_queue.cc:237] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.054589 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.055147 29271 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.055253 29386 tablet_bootstrap.cc:492] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:59.058495 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:59.059202 29196 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.068037 29386 tablet_bootstrap.cc:654] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.068336 29384 raft_consensus.cc:359] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.069037 29384 raft_consensus.cc:385] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.069334 29384 raft_consensus.cc:740] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.065701 29196 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 1.
I20260709 13:09:59.070029 29384 consensus_queue.cc:260] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.070655 29310 leader_election.cc:304] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.071604 29388 raft_consensus.cc:2804] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.072124 29388 raft_consensus.cc:697] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:59.072371 29384 ts_tablet_manager.cc:1434] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:09:59.073314 29384 tablet_bootstrap.cc:492] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5: Bootstrap starting.
I20260709 13:09:59.073000 29388 consensus_queue.cc:237] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.075197 29092 catalog_manager.cc:5697] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.079634 29384 tablet_bootstrap.cc:654] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.090979 29271 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 1.
I20260709 13:09:59.094532 29388 raft_consensus.cc:493] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.094996 29388 raft_consensus.cc:515] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.096393 29386 tablet_bootstrap.cc:492] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:59.096920 29386 ts_tablet_manager.cc:1403] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.018s
I20260709 13:09:59.097386 29384 tablet_bootstrap.cc:492] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5: No bootstrap required, opened a new log
I20260709 13:09:59.099754 29386 raft_consensus.cc:359] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.097842 29384 ts_tablet_manager.cc:1403] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:09:59.100454 29386 raft_consensus.cc:385] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.099984 29092 catalog_manager.cc:5697] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.100942 29386 raft_consensus.cc:740] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.101791 29386 consensus_queue.cc:260] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.102133 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:59.102710 29196 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 0.
I20260709 13:09:59.104254 29310 leader_election.cc:304] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.104776 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
I20260709 13:09:59.105141 29423 raft_consensus.cc:2804] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.105590 29423 raft_consensus.cc:493] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.106117 29423 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.107335 29384 raft_consensus.cc:359] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.107999 29384 raft_consensus.cc:385] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.108170 29386 ts_tablet_manager.cc:1434] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:59.108280 29384 raft_consensus.cc:740] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.109099 29384 consensus_queue.cc:260] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.105540 29271 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 0.
I20260709 13:09:59.110400 29386 tablet_bootstrap.cc:492] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:59.111351 29384 ts_tablet_manager.cc:1434] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:09:59.100819 29388 leader_election.cc:290] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:59.114774 29423 raft_consensus.cc:515] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.116863 29423 leader_election.cc:290] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:59.116995 29386 tablet_bootstrap.cc:654] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.118659 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:59.119297 29196 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.122260 29386 tablet_bootstrap.cc:492] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:59.122720 29386 ts_tablet_manager.cc:1403] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:09:59.122717 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.123535 29271 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.125566 29386 raft_consensus.cc:359] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.125974 29196 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 1.
I20260709 13:09:59.126355 29386 raft_consensus.cc:385] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.126679 29386 raft_consensus.cc:740] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.127161 29310 leader_election.cc:304] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.128069 29423 raft_consensus.cc:2804] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.127314 29386 consensus_queue.cc:260] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.128566 29423 raft_consensus.cc:697] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:59.129392 29423 consensus_queue.cc:237] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.129793 29271 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 1.
I20260709 13:09:59.130228 29386 ts_tablet_manager.cc:1434] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:59.131181 29386 tablet_bootstrap.cc:492] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf: Bootstrap starting.
I20260709 13:09:59.136868 29386 tablet_bootstrap.cc:654] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:59.138404 29094 catalog_manager.cc:5697] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.141155 29394 raft_consensus.cc:493] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.141801 29386 tablet_bootstrap.cc:492] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf: No bootstrap required, opened a new log
I20260709 13:09:59.141652 29394 raft_consensus.cc:515] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.142263 29386 ts_tablet_manager.cc:1403] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:09:59.144404 29394 leader_election.cc:290] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.144918 29386 raft_consensus.cc:359] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.145385 29386 raft_consensus.cc:385] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:59.145625 29386 raft_consensus.cc:740] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Initialized, Role: FOLLOWER
I20260709 13:09:59.146317 29386 consensus_queue.cc:260] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.148082 29386 ts_tablet_manager.cc:1434] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:59.159461 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
I20260709 13:09:59.160282 29271 raft_consensus.cc:2393] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508c7ae6b5c14d68a444dfa68227b3cf in current term 1: Already voted for candidate d8fbd72d942040d4a9b4f90f646c60d5 in this term.
I20260709 13:09:59.162982 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:59.164173 29161 leader_election.cc:304] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:09:59.164884 29394 raft_consensus.cc:3060] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.169422 29394 raft_consensus.cc:2749] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.174162 29417 raft_consensus.cc:493] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.174609 29417 raft_consensus.cc:515] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.176353 29417 leader_election.cc:290] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.177170 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3a6a0c39894fc4b7ffa3227deea924" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:59.177404 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3a6a0c39894fc4b7ffa3227deea924" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:59.177693 29196 raft_consensus.cc:2468] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:59.178026 29417 raft_consensus.cc:493] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.178015 29345 raft_consensus.cc:2468] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:59.178766 29236 leader_election.cc:304] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:59.178617 29417 raft_consensus.cc:515] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.179582 29412 raft_consensus.cc:2804] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.179899 29412 raft_consensus.cc:493] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.180163 29412 raft_consensus.cc:3060] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.181072 29417 leader_election.cc:290] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.182051 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:59.182135 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:59.182667 29196 raft_consensus.cc:2393] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 49195b9666374b8e928416b05f269c55 in current term 1: Already voted for candidate d8fbd72d942040d4a9b4f90f646c60d5 in this term.
I20260709 13:09:59.183773 29236 leader_election.cc:304] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49195b9666374b8e928416b05f269c55; no voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:09:59.184552 29417 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.186053 29412 raft_consensus.cc:515] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.187681 29412 leader_election.cc:290] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.188737 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3a6a0c39894fc4b7ffa3227deea924" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.189225 29345 raft_consensus.cc:3060] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.189644 29417 raft_consensus.cc:2749] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.188568 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e3a6a0c39894fc4b7ffa3227deea924" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:59.190330 29196 raft_consensus.cc:3060] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.193768 29345 raft_consensus.cc:2468] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:59.194739 29196 raft_consensus.cc:2468] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:59.194904 29236 leader_election.cc:304] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.195679 29417 raft_consensus.cc:2804] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.196113 29417 raft_consensus.cc:697] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:59.196830 29417 consensus_queue.cc:237] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.205444 29094 catalog_manager.cc:5697] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.212682 29394 raft_consensus.cc:493] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.213143 29394 raft_consensus.cc:515] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.214794 29394 leader_election.cc:290] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.215617 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
I20260709 13:09:59.215875 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:59.216151 29271 raft_consensus.cc:2468] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 0.
I20260709 13:09:59.216409 29345 raft_consensus.cc:2468] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 0.
I20260709 13:09:59.217128 29161 leader_election.cc:304] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:59.217799 29394 raft_consensus.cc:2804] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.218114 29394 raft_consensus.cc:493] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.218403 29394 raft_consensus.cc:3060] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.222949 29394 raft_consensus.cc:515] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.224663 29394 leader_election.cc:290] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.225358 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.225562 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.225859 29271 raft_consensus.cc:3060] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.226054 29345 raft_consensus.cc:3060] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.230000 29423 consensus_queue.cc:1048] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.231683 29345 raft_consensus.cc:2468] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 1.
I20260709 13:09:59.232002 29271 raft_consensus.cc:2468] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 1.
I20260709 13:09:59.232893 29161 leader_election.cc:304] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.233978 29394 raft_consensus.cc:2804] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.234540 29394 raft_consensus.cc:697] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:09:59.235987 29417 consensus_queue.cc:1048] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.235380 29394 consensus_queue.cc:237] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.241717 29412 raft_consensus.cc:493] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.242363 29412 raft_consensus.cc:515] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.245759 29195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" is_pre_election: true
I20260709 13:09:59.246577 29195 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:59.248188 29236 leader_election.cc:304] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:59.249166 29417 raft_consensus.cc:2804] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:59.249552 29417 raft_consensus.cc:493] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:59.249899 29417 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.246829 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:59.250586 29345 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 0.
I20260709 13:09:59.250114 29412 leader_election.cc:290] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.258616 29417 raft_consensus.cc:515] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.261355 29417 leader_election.cc:290] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.263928 29398 consensus_queue.cc:1048] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.265677 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:59.266505 29196 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.269515 29092 catalog_manager.cc:5697] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 1 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.271489 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.272112 29344 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.281695 29196 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:59.283217 29236 leader_election.cc:304] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:59.284184 29412 raft_consensus.cc:2804] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:59.284803 29412 raft_consensus.cc:697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:59.285542 29344 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 1.
I20260709 13:09:59.286046 29412 consensus_queue.cc:237] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.298632 29390 consensus_queue.cc:1048] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.310094 29094 catalog_manager.cc:5697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.388420 29442 raft_consensus.cc:493] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.388862 29442 raft_consensus.cc:515] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.390566 29442 leader_election.cc:290] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.391402 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
I20260709 13:09:59.391583 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:59.392290 29344 raft_consensus.cc:2393] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508c7ae6b5c14d68a444dfa68227b3cf in current term 1: Already voted for candidate 49195b9666374b8e928416b05f269c55 in this term.
I20260709 13:09:59.393101 29161 leader_election.cc:304] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:09:59.393747 29442 raft_consensus.cc:3060] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.399618 29442 raft_consensus.cc:2749] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.410456 29271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50104813c534412093bddca68cd83cdf"
dest_uuid: "49195b9666374b8e928416b05f269c55"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:47686
I20260709 13:09:59.411041 29271 raft_consensus.cc:606] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:59.423159 29344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:43658
I20260709 13:09:59.423629 29344 raft_consensus.cc:606] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:59.428356 29344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "617574c688d3413abd234a67bbd120fd"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:43658
I20260709 13:09:59.428807 29344 raft_consensus.cc:606] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:59.433532 29344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:43658
I20260709 13:09:59.434036 29344 raft_consensus.cc:606] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:59.438711 29271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "49195b9666374b8e928416b05f269c55"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:47686
I20260709 13:09:59.439195 29271 raft_consensus.cc:606] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:09:59.443648 29344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
mode: GRACEFUL
new_leader_uuid: "49195b9666374b8e928416b05f269c55"
 from {username='slave'} at 127.0.0.1:43658
I20260709 13:09:59.444137 29344 raft_consensus.cc:606] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Received request to transfer leadership to TS 49195b9666374b8e928416b05f269c55
I20260709 13:09:59.465049 29388 consensus_queue.cc:1048] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.465253 29196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9894e675acac4126a857f9cf38fea226"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
mode: GRACEFUL
new_leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:50308
I20260709 13:09:59.465849 29196 raft_consensus.cc:606] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 LEADER]: Received request to transfer leadership to TS d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:09:59.470029 29390 consensus_queue.cc:1048] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.501384 29423 consensus_queue.cc:1048] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.515393 29456 raft_consensus.cc:993] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.516250 29423 raft_consensus.cc:1081] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.517555 29413 consensus_queue.cc:1048] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.519407 29196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "617574c688d3413abd234a67bbd120fd"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50290
I20260709 13:09:59.520001 29196 raft_consensus.cc:493] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.520391 29196 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.529155 29196 raft_consensus.cc:515] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.532049 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.532502 29196 leader_election.cc:290] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.532673 29271 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.533095 29442 raft_consensus.cc:493] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:59.533608 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.533581 29442 raft_consensus.cc:515] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.534319 29344 raft_consensus.cc:3055] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.534653 29344 raft_consensus.cc:740] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:59.535808 29442 leader_election.cc:290] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.535471 29344 consensus_queue.cc:260] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.536635 29344 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.538125 29270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49195b9666374b8e928416b05f269c55" is_pre_election: true
I20260709 13:09:59.538795 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" is_pre_election: true
I20260709 13:09:59.539633 29345 raft_consensus.cc:2393] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 508c7ae6b5c14d68a444dfa68227b3cf in current term 1: Already voted for candidate 49195b9666374b8e928416b05f269c55 in this term.
I20260709 13:09:59.542083 29456 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.542306 29161 leader_election.cc:304] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:09:59.543478 29442 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:59.544973 29344 raft_consensus.cc:2468] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.546397 29161 leader_election.cc:304] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.547348 29394 raft_consensus.cc:2804] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.547431 29271 raft_consensus.cc:2468] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.549558 29394 raft_consensus.cc:697] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:09:59.551194 29442 raft_consensus.cc:2749] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:59.550846 29394 consensus_queue.cc:237] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.558945 29092 catalog_manager.cc:5697] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 1 to 2, leader changed from d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 2 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.560887 29388 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.570729 29388 raft_consensus.cc:993] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.571167 29388 raft_consensus.cc:1081] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.573288 29196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50290
I20260709 13:09:59.574087 29196 raft_consensus.cc:493] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.574503 29196 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.574702 29413 consensus_queue.cc:1048] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.581001 29196 raft_consensus.cc:515] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.583736 29270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.584324 29270 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.586374 29196 leader_election.cc:290] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.591113 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.591224 29270 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.591919 29344 raft_consensus.cc:3055] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.592509 29344 raft_consensus.cc:740] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:59.592721 29161 leader_election.cc:304] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:59.593766 29394 raft_consensus.cc:2804] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.593565 29344 consensus_queue.cc:260] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.594301 29394 raft_consensus.cc:697] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:09:59.594597 29413 consensus_queue.cc:1048] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.595057 29344 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.595194 29394 consensus_queue.cc:237] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.602252 29344 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.603772 29090 catalog_manager.cc:5697] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 1 to 2, leader changed from d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 2 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.612834 29456 consensus_queue.cc:1048] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.617296 29456 consensus_queue.cc:1048] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.627264 29398 raft_consensus.cc:993] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5: : Instructing follower 49195b9666374b8e928416b05f269c55 to start an election
I20260709 13:09:59.627710 29398 raft_consensus.cc:1081] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Signalling peer 49195b9666374b8e928416b05f269c55 to start an election
I20260709 13:09:59.629854 29271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f"
dest_uuid: "49195b9666374b8e928416b05f269c55"
 from {username='slave'} at 127.0.0.1:47672
I20260709 13:09:59.631148 29271 raft_consensus.cc:493] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.631568 29271 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.636482 29271 raft_consensus.cc:515] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.639200 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:59.639791 29196 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.640388 29271 leader_election.cc:290] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 2 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.642733 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.643301 29344 raft_consensus.cc:3055] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.643608 29344 raft_consensus.cc:740] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:59.644433 29344 consensus_queue.cc:260] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.644824 29394 consensus_queue.cc:1048] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.645637 29344 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.646643 29196 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 2.
I20260709 13:09:59.647827 29236 leader_election.cc:304] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:59.648726 29413 raft_consensus.cc:2804] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.649199 29413 raft_consensus.cc:697] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:59.650024 29413 consensus_queue.cc:237] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.653374 29344 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 2.
I20260709 13:09:59.656056 29461 raft_consensus.cc:993] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf: : Instructing follower d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:09:59.656523 29394 raft_consensus.cc:1081] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 LEADER]: Signalling peer d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:09:59.658648 29344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9894e675acac4126a857f9cf38fea226"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:43656
I20260709 13:09:59.658190 29094 catalog_manager.cc:5697] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 1 to 2, leader changed from d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67) to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.659197 29344 raft_consensus.cc:493] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.659578 29344 raft_consensus.cc:3060] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.665447 29394 consensus_queue.cc:1048] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.666322 29344 raft_consensus.cc:515] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.668375 29344 leader_election.cc:290] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 2 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:59.670145 29270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.672152 29196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9894e675acac4126a857f9cf38fea226" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:09:59.672974 29196 raft_consensus.cc:3055] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.673415 29196 raft_consensus.cc:740] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:09:59.674467 29196 consensus_queue.cc:260] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.675733 29196 raft_consensus.cc:3060] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.677804 29413 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.682725 29196 raft_consensus.cc:2468] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 2.
I20260709 13:09:59.683940 29310 leader_election.cc:304] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 49195b9666374b8e928416b05f269c55
I20260709 13:09:59.684741 29388 raft_consensus.cc:2804] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.685199 29388 raft_consensus.cc:697] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:59.685842 29388 consensus_queue.cc:237] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.695063 29092 catalog_manager.cc:5697] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 1 to 2, leader changed from 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65) to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.700273 29417 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.712996 29388 raft_consensus.cc:993] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.713469 29423 raft_consensus.cc:1081] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.715190 29196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50290
I20260709 13:09:59.715613 29390 raft_consensus.cc:993] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.715745 29196 raft_consensus.cc:493] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.716002 29417 raft_consensus.cc:1081] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.716204 29196 raft_consensus.cc:3060] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.717577 29195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50302
I20260709 13:09:59.718189 29195 raft_consensus.cc:493] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.718568 29195 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.721392 29196 raft_consensus.cc:515] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.723341 29196 leader_election.cc:290] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.724099 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.724725 29271 raft_consensus.cc:3060] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.724472 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3739ec8e1ac4e3b88c90fb2385ea429" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.725450 29344 raft_consensus.cc:3055] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.725771 29344 raft_consensus.cc:740] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:09:59.726586 29344 consensus_queue.cc:260] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.727677 29344 raft_consensus.cc:3060] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.728451 29195 raft_consensus.cc:515] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.731432 29270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.732054 29270 raft_consensus.cc:3055] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.732087 29195 leader_election.cc:290] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:09:59.732510 29270 raft_consensus.cc:740] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:59.733435 29270 consensus_queue.cc:260] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.734565 29270 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.734719 29344 raft_consensus.cc:2468] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.734900 29345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.735422 29345 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.736002 29161 leader_election.cc:304] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.736900 29394 raft_consensus.cc:2804] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.737365 29394 raft_consensus.cc:697] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:09:59.738168 29394 consensus_queue.cc:237] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.740929 29270 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.741866 29161 leader_election.cc:304] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:09:59.742369 29345 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.742730 29442 raft_consensus.cc:2804] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.743243 29442 raft_consensus.cc:697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:09:59.744071 29271 raft_consensus.cc:2468] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.744028 29442 consensus_queue.cc:237] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:09:59.744915 29269 raft_consensus.cc:1240] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Rejecting Update request from peer d8fbd72d942040d4a9b4f90f646c60d5 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:59.748248 29092 catalog_manager.cc:5697] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 1 to 2, leader changed from d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 2 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.759245 29092 catalog_manager.cc:5697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 1 to 2, leader changed from 49195b9666374b8e928416b05f269c55 (127.27.229.66) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 2 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:59.787343 29417 consensus_queue.cc:1048] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.791652 29417 consensus_queue.cc:1048] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:59.900799 29417 raft_consensus.cc:993] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.901275 29417 raft_consensus.cc:1081] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:09:59.903263 29195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50104813c534412093bddca68cd83cdf"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50302
I20260709 13:09:59.903754 29195 raft_consensus.cc:493] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.904042 29195 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.908761 29195 raft_consensus.cc:515] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:59.910597 29195 leader_election.cc:290] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Requested vote from peers d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:09:59.911360 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:09:59.911691 29269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:09:59.911876 29344 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.912170 29269 raft_consensus.cc:3055] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.912441 29269 raft_consensus.cc:740] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:09:59.913055 29269 consensus_queue.cc:260] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:59.913986 29269 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.916798 29344 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.917908 29161 leader_election.cc:304] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:09:59.918648 29442 raft_consensus.cc:2804] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.918884 29269 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:09:59.919039 29442 raft_consensus.cc:697] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:09:59.919827 29442 consensus_queue.cc:237] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:09:59.926080 29092 catalog_manager.cc:5697] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 1 to 2, leader changed from 49195b9666374b8e928416b05f269c55 (127.27.229.66) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 2 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.969149 29344 raft_consensus.cc:1275] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.970412 29442 consensus_queue.cc:1048] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.980111 29269 raft_consensus.cc:1275] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.980599 29344 raft_consensus.cc:1275] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.981472 29473 consensus_queue.cc:1048] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.982338 29442 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.993085 29269 raft_consensus.cc:1275] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.994833 29442 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.102808 29269 raft_consensus.cc:3060] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.107640 29269 raft_consensus.cc:1275] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.108896 29388 consensus_queue.cc:1048] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.116288 29195 raft_consensus.cc:1275] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.118153 29398 consensus_queue.cc:1048] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.121811 29344 raft_consensus.cc:1275] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.123448 29394 consensus_queue.cc:1048] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.133435 29269 raft_consensus.cc:1275] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.135133 29442 consensus_queue.cc:1048] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.207300 29344 raft_consensus.cc:1275] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 49195b9666374b8e928416b05f269c55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.208581 29417 consensus_queue.cc:1048] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.217483 29195 raft_consensus.cc:1275] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Refusing update from remote peer 49195b9666374b8e928416b05f269c55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.220291 29344 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.221977 29442 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:00.221977 29406 consensus_queue.cc:1048] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:00.232084 29269 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.233741 29442 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.370447 29344 raft_consensus.cc:1275] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.371680 29442 consensus_queue.cc:1048] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.379606 29269 raft_consensus.cc:1275] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.381505 29461 consensus_queue.cc:1048] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:02.497603 28565 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:10:02.498426 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.515087 29195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
mode: GRACEFUL
new_leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:10:02.515568 29195 raft_consensus.cc:606] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Received request to transfer leadership to TS d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:10:02.517836 29195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
mode: GRACEFUL
new_leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:10:02.518340 29195 raft_consensus.cc:606] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Received request to transfer leadership to TS d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:10:02.519253 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:02.519652 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.866009 29442 raft_consensus.cc:993] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: : Instructing follower d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:02.866432 29480 raft_consensus.cc:1081] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Signalling peer d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:02.867990 29344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:43656
I20260709 13:10:02.868510 29344 raft_consensus.cc:493] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.868854 29344 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.873068 29344 raft_consensus.cc:515] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:02.874442 29344 leader_election.cc:290] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:10:02.875329 29195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:10:02.875592 29269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:02.875837 29195 raft_consensus.cc:3055] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:02.876082 29269 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.876132 29195 raft_consensus.cc:740] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:02.876868 29195 consensus_queue.cc:260] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:02.877732 29195 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:02.880910 29269 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:02.882023 29310 leader_election.cc:304] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:02.882369 29195 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:02.882680 29477 raft_consensus.cc:2804] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:02.883829 29477 raft_consensus.cc:697] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:10:02.884581 29477 consensus_queue.cc:237] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:02.892648 29094 catalog_manager.cc:5697] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 2 to 3, leader changed from 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65) to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.057000 29442 raft_consensus.cc:993] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf: : Instructing follower d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:03.057410 29480 raft_consensus.cc:1081] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Signalling peer d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:03.058770 29344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:43656
I20260709 13:10:03.059170 29344 raft_consensus.cc:493] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.059412 29344 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.063271 29344 raft_consensus.cc:515] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.064642 29344 leader_election.cc:290] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:10:03.065588 29195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:10:03.065850 29269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:03.066123 29195 raft_consensus.cc:3055] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:03.066361 29269 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.066439 29195 raft_consensus.cc:740] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:03.067183 29195 consensus_queue.cc:260] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.068068 29195 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.071012 29269 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:03.072016 29310 leader_election.cc:304] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:03.072695 29477 raft_consensus.cc:2804] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.072602 29195 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:03.073225 29477 raft_consensus.cc:697] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:10:03.074028 29477 consensus_queue.cc:237] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.080547 29094 catalog_manager.cc:5697] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 2 to 3, leader changed from 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65) to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.357054 29269 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.358420 29477 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.368561 29195 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.371934 29481 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.488001 29195 raft_consensus.cc:1275] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.489207 29477 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.498246 29269 raft_consensus.cc:1275] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:03.500600 29495 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:03.520365 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.539111 29344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:43658
I20260709 13:10:03.539553 29344 raft_consensus.cc:606] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:10:03.543826 29344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:43658
I20260709 13:10:03.544237 29344 raft_consensus.cc:606] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:10:03.548447 29269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f"
dest_uuid: "49195b9666374b8e928416b05f269c55"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:47686
I20260709 13:10:03.548933 29269 raft_consensus.cc:606] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:10:03.553280 29269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170"
dest_uuid: "49195b9666374b8e928416b05f269c55"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:47686
I20260709 13:10:03.553733 29269 raft_consensus.cc:606] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:10:03.558090 29269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869"
dest_uuid: "49195b9666374b8e928416b05f269c55"
mode: GRACEFUL
new_leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:47686
I20260709 13:10:03.558527 29269 raft_consensus.cc:606] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Received request to transfer leadership to TS 508c7ae6b5c14d68a444dfa68227b3cf
I20260709 13:10:03.693578 29497 raft_consensus.cc:993] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:03.694126 29476 raft_consensus.cc:1081] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:03.696072 29195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50302
I20260709 13:10:03.696697 29195 raft_consensus.cc:493] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.697083 29195 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.703258 29195 raft_consensus.cc:515] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.704949 29195 leader_election.cc:290] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:10:03.705732 29269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:03.706158 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:10:03.706317 29269 raft_consensus.cc:3055] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.706600 29344 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.706626 29269 raft_consensus.cc:740] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:10:03.707459 29269 consensus_queue.cc:260] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.708343 29269 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.711016 29344 raft_consensus.cc:2468] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:10:03.712024 29161 leader_election.cc:304] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:03.712662 29480 raft_consensus.cc:2804] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.713146 29269 raft_consensus.cc:2468] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:10:03.713739 29480 raft_consensus.cc:697] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:03.714588 29480 consensus_queue.cc:237] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.720901 29094 catalog_manager.cc:5697] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 1 to 2, leader changed from 49195b9666374b8e928416b05f269c55 (127.27.229.66) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 2 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.911993 29495 raft_consensus.cc:993] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:03.912472 29477 raft_consensus.cc:1081] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:03.914077 29195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50290
I20260709 13:10:03.914654 29195 raft_consensus.cc:493] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.915025 29195 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.920655 29195 raft_consensus.cc:515] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.921064 29497 raft_consensus.cc:993] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:03.921490 29476 raft_consensus.cc:1081] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:03.922977 29196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50302
I20260709 13:10:03.923105 29269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:03.923761 29196 raft_consensus.cc:493] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.923787 29269 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.924010 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:10:03.924295 29196 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.924612 29344 raft_consensus.cc:3055] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:03.924934 29344 raft_consensus.cc:740] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:10:03.925616 29344 consensus_queue.cc:260] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.926599 29344 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:03.930874 29269 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 4.
I20260709 13:10:03.930703 29196 raft_consensus.cc:515] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.932237 29161 leader_election.cc:304] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:10:03.932574 29196 leader_election.cc:290] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 3 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:10:03.932420 29344 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 4.
I20260709 13:10:03.933065 29480 raft_consensus.cc:2804] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:03.933527 29480 raft_consensus.cc:697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:03.922375 29195 leader_election.cc:290] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 4 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:10:03.934360 29480 consensus_queue.cc:237] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.935724 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:03.936314 29271 raft_consensus.cc:3055] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:03.936569 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef1009c48045c4a021e37f250dc06f" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:10:03.936642 29271 raft_consensus.cc:740] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:10:03.937259 29344 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.937666 29271 consensus_queue.cc:260] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.938943 29271 raft_consensus.cc:3060] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:03.941870 29094 catalog_manager.cc:5697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 3 to 4, leader changed from d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 4 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.942829 29344 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 3.
I20260709 13:10:03.943970 29161 leader_election.cc:304] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:03.944147 29271 raft_consensus.cc:2468] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 3.
I20260709 13:10:03.944726 29480 raft_consensus.cc:2804] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:03.945191 29480 raft_consensus.cc:697] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:03.945868 29480 consensus_queue.cc:237] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:03.954612 29094 catalog_manager.cc:5697] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 2 to 3, leader changed from 49195b9666374b8e928416b05f269c55 (127.27.229.66) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 3 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.024037 29490 raft_consensus.cc:993] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:04.024428 29495 raft_consensus.cc:1081] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:04.025817 29195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50290
I20260709 13:10:04.026333 29195 raft_consensus.cc:493] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.026638 29195 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.031149 29195 raft_consensus.cc:515] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:04.032644 29195 leader_election.cc:290] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 4 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:10:04.033538 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:04.033643 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f6750cee374c4c8b89dcd0111dfd90" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:10:04.034083 29271 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.034108 29344 raft_consensus.cc:3055] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:04.034529 29344 raft_consensus.cc:740] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:10:04.035115 29344 consensus_queue.cc:260] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:04.035880 29344 raft_consensus.cc:3060] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:04.038728 29271 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 4.
I20260709 13:10:04.039753 29161 leader_election.cc:304] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, 508c7ae6b5c14d68a444dfa68227b3cf; no voters: 
I20260709 13:10:04.040258 29344 raft_consensus.cc:2468] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 4.
I20260709 13:10:04.040397 29480 raft_consensus.cc:2804] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:04.040834 29480 raft_consensus.cc:697] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:04.041502 29480 consensus_queue.cc:237] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:04.046864 29094 catalog_manager.cc:5697] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 3 to 4, leader changed from d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 4 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.087584 29497 raft_consensus.cc:993] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55: : Instructing follower 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:04.087965 29476 raft_consensus.cc:1081] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Signalling peer 508c7ae6b5c14d68a444dfa68227b3cf to start an election
I20260709 13:10:04.089429 29195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
 from {username='slave'} at 127.0.0.1:50302
I20260709 13:10:04.089953 29195 raft_consensus.cc:493] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:04.090243 29195 raft_consensus.cc:3060] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.094643 29195 raft_consensus.cc:515] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:04.096048 29195 leader_election.cc:290] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:10:04.097021 29271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:04.097189 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d7c033ab8f4169863e0383f1442170" candidate_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:10:04.097518 29271 raft_consensus.cc:3055] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:04.097630 29344 raft_consensus.cc:3060] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.097812 29271 raft_consensus.cc:740] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:10:04.098555 29271 consensus_queue.cc:260] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:04.099440 29271 raft_consensus.cc:3060] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.101792 29344 raft_consensus.cc:2468] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:10:04.102820 29161 leader_election.cc:304] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 508c7ae6b5c14d68a444dfa68227b3cf, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:04.103598 29480 raft_consensus.cc:2804] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:04.103962 29480 raft_consensus.cc:697] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Leader. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:04.104311 29271 raft_consensus.cc:2468] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 508c7ae6b5c14d68a444dfa68227b3cf in term 2.
I20260709 13:10:04.104640 29480 consensus_queue.cc:237] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:04.111411 29094 catalog_manager.cc:5697] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf reported cstate change: term changed from 1 to 2, leader changed from 49195b9666374b8e928416b05f269c55 (127.27.229.66) to 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65). New cstate: current_term: 2 leader_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.196125 29271 raft_consensus.cc:1275] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.197357 29480 consensus_queue.cc:1048] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.208732 29344 raft_consensus.cc:1275] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.210381 29480 consensus_queue.cc:1048] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:04.377149 29271 raft_consensus.cc:1275] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.378448 29480 consensus_queue.cc:1048] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.386686 29344 raft_consensus.cc:1275] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:04.388952 29480 consensus_queue.cc:1048] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.412189 29344 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 4 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:04.413497 29480 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.421859 29271 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:04.423867 29515 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.538692 29271 raft_consensus.cc:1275] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.539876 29498 consensus_queue.cc:1048] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.550421 29345 raft_consensus.cc:1275] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.551931 29498 consensus_queue.cc:1048] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.558283 29345 raft_consensus.cc:1275] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 4 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:04.559491 29498 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.567886 29271 raft_consensus.cc:1275] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Refusing update from remote peer 508c7ae6b5c14d68a444dfa68227b3cf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:04.569566 29480 consensus_queue.cc:1048] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:06.565435 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:06.573800 29195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50104813c534412093bddca68cd83cdf"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
mode: GRACEFUL
new_leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:10:06.574570 29195 raft_consensus.cc:606] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Received request to transfer leadership to TS d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:10:06.575820 29498 raft_consensus.cc:993] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf: : Instructing follower d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:06.576437 29480 raft_consensus.cc:1081] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Signalling peer d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:06.577764 29195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "617574c688d3413abd234a67bbd120fd"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
mode: GRACEFUL
new_leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:10:06.578094 29344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50104813c534412093bddca68cd83cdf"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:43656
I20260709 13:10:06.578315 29195 raft_consensus.cc:606] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Received request to transfer leadership to TS d8fbd72d942040d4a9b4f90f646c60d5
I20260709 13:10:06.578603 29344 raft_consensus.cc:493] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.579020 29344 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.580893 29195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
mode: GRACEFUL
new_leader_uuid: "49195b9666374b8e928416b05f269c55"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:10:06.581331 29195 raft_consensus.cc:606] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 LEADER]: Received request to transfer leadership to TS 49195b9666374b8e928416b05f269c55
I20260709 13:10:06.583659 29195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869"
dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
mode: GRACEFUL
new_leader_uuid: "49195b9666374b8e928416b05f269c55"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:10:06.584185 29195 raft_consensus.cc:606] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Received request to transfer leadership to TS 49195b9666374b8e928416b05f269c55
I20260709 13:10:06.585711 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:06.586197 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:06.586750 29344 raft_consensus.cc:515] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:10:06.588505 29344 leader_election.cc:290] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Requested vote from peers 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011), 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581)
I20260709 13:10:06.589481 29269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:06.589751 29195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50104813c534412093bddca68cd83cdf" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:10:06.590265 29269 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.590425 29195 raft_consensus.cc:3055] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.590822 29195 raft_consensus.cc:740] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:06.592532 29195 consensus_queue.cc:260] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:10:06.593984 29195 raft_consensus.cc:3060] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.596012 29269 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:06.597216 29310 leader_election.cc:304] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:06.598132 29495 raft_consensus.cc:2804] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:06.598920 29195 raft_consensus.cc:2468] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:06.599179 29495 raft_consensus.cc:697] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:10:06.600214 29495 consensus_queue.cc:237] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } }
I20260709 13:10:06.607214 29094 catalog_manager.cc:5697] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 2 to 3, leader changed from 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65) to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.768460 29498 raft_consensus.cc:993] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf: : Instructing follower d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:06.768904 29480 raft_consensus.cc:1081] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Signalling peer d8fbd72d942040d4a9b4f90f646c60d5 to start an election
I20260709 13:10:06.770269 29344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "617574c688d3413abd234a67bbd120fd"
dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
 from {username='slave'} at 127.0.0.1:43656
I20260709 13:10:06.770715 29344 raft_consensus.cc:493] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.770972 29344 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.775112 29344 raft_consensus.cc:515] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.776525 29344 leader_election.cc:290] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), 49195b9666374b8e928416b05f269c55 (127.27.229.66:39011)
I20260709 13:10:06.777374 29195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:10:06.777563 29269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "617574c688d3413abd234a67bbd120fd" candidate_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49195b9666374b8e928416b05f269c55"
I20260709 13:10:06.777969 29195 raft_consensus.cc:3055] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.778057 29269 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.778334 29195 raft_consensus.cc:740] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:06.779147 29195 consensus_queue.cc:260] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.780339 29195 raft_consensus.cc:3060] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.784475 29269 raft_consensus.cc:2468] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:06.785611 29310 leader_election.cc:304] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:06.786414 29195 raft_consensus.cc:2468] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8fbd72d942040d4a9b4f90f646c60d5 in term 3.
I20260709 13:10:06.786437 29495 raft_consensus.cc:2804] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:06.788056 29495 raft_consensus.cc:697] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Becoming Leader. State: Replica: d8fbd72d942040d4a9b4f90f646c60d5, State: Running, Role: LEADER
I20260709 13:10:06.788980 29495 consensus_queue.cc:237] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.797798 29094 catalog_manager.cc:5697] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 reported cstate change: term changed from 2 to 3, leader changed from 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65) to d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:06.846868 29498 raft_consensus.cc:993] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: : Instructing follower 49195b9666374b8e928416b05f269c55 to start an election
I20260709 13:10:06.847337 29480 raft_consensus.cc:1081] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 LEADER]: Signalling peer 49195b9666374b8e928416b05f269c55 to start an election
I20260709 13:10:06.848781 29269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070"
dest_uuid: "49195b9666374b8e928416b05f269c55"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:10:06.849247 29269 raft_consensus.cc:493] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.849507 29269 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.853588 29269 raft_consensus.cc:515] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.855158 29269 leader_election.cc:290] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 5 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:10:06.856063 29195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:10:06.856318 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8493ef9b9a4eaa92d60e35d0574070" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:10:06.856570 29195 raft_consensus.cc:3055] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:06.856807 29344 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.856884 29195 raft_consensus.cc:740] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:06.857638 29195 consensus_queue.cc:260] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.858534 29195 raft_consensus.cc:3060] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:06.861233 29344 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 5.
I20260709 13:10:06.862412 29236 leader_election.cc:304] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:06.862623 29195 raft_consensus.cc:2468] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 5.
I20260709 13:10:06.863173 29476 raft_consensus.cc:2804] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:06.864179 29476 raft_consensus.cc:697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 5 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:10:06.864962 29476 consensus_queue.cc:237] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.871768 29094 catalog_manager.cc:5697] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 4 to 5, leader changed from 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65) to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 5 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.968389 29498 raft_consensus.cc:993] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf: : Instructing follower 49195b9666374b8e928416b05f269c55 to start an election
I20260709 13:10:06.968811 29480 raft_consensus.cc:1081] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Signalling peer 49195b9666374b8e928416b05f269c55 to start an election
I20260709 13:10:06.970168 29269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869"
dest_uuid: "49195b9666374b8e928416b05f269c55"
 from {username='slave'} at 127.0.0.1:47682
I20260709 13:10:06.970553 29269 raft_consensus.cc:493] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.970768 29269 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.974663 29269 raft_consensus.cc:515] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.976061 29269 leader_election.cc:290] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 3 election: Requested vote from peers 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581), d8fbd72d942040d4a9b4f90f646c60d5 (127.27.229.67:39155)
I20260709 13:10:06.976893 29195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "508c7ae6b5c14d68a444dfa68227b3cf"
I20260709 13:10:06.977095 29344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c260d0eda1fa4286af5f5a15c2f49869" candidate_uuid: "49195b9666374b8e928416b05f269c55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d8fbd72d942040d4a9b4f90f646c60d5"
I20260709 13:10:06.977347 29195 raft_consensus.cc:3055] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:06.977615 29195 raft_consensus.cc:740] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 508c7ae6b5c14d68a444dfa68227b3cf, State: Running, Role: LEADER
I20260709 13:10:06.977591 29344 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.978403 29195 consensus_queue.cc:260] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.979239 29195 raft_consensus.cc:3060] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:06.982456 29344 raft_consensus.cc:2468] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 3.
I20260709 13:10:06.983263 29195 raft_consensus.cc:2468] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49195b9666374b8e928416b05f269c55 in term 3.
I20260709 13:10:06.983376 29236 leader_election.cc:304] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49195b9666374b8e928416b05f269c55, d8fbd72d942040d4a9b4f90f646c60d5; no voters: 
I20260709 13:10:06.984047 29476 raft_consensus.cc:2804] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:06.984517 29476 raft_consensus.cc:697] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 3 LEADER]: Becoming Leader. State: Replica: 49195b9666374b8e928416b05f269c55, State: Running, Role: LEADER
I20260709 13:10:06.985267 29476 consensus_queue.cc:237] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } }
I20260709 13:10:06.991747 29094 catalog_manager.cc:5697] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 reported cstate change: term changed from 2 to 3, leader changed from 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65) to 49195b9666374b8e928416b05f269c55 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "49195b9666374b8e928416b05f269c55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.061054 29269 raft_consensus.cc:1275] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.062265 29495 consensus_queue.cc:1048] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.071951 29195 raft_consensus.cc:1275] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.073729 29528 consensus_queue.cc:1048] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:07.236905 29269 raft_consensus.cc:1275] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.238056 29528 consensus_queue.cc:1048] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49195b9666374b8e928416b05f269c55" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 39011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.246935 29195 raft_consensus.cc:1275] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Refusing update from remote peer d8fbd72d942040d4a9b4f90f646c60d5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.248214 29495 consensus_queue.cc:1048] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.262154 29344 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 5 FOLLOWER]: Refusing update from remote peer 49195b9666374b8e928416b05f269c55: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:07.263304 29476 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:07.266173 29195 raft_consensus.cc:1275] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 5 FOLLOWER]: Refusing update from remote peer 49195b9666374b8e928416b05f269c55: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:07.267572 29530 consensus_queue.cc:1048] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:07.373804 29195 raft_consensus.cc:1275] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Refusing update from remote peer 49195b9666374b8e928416b05f269c55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.375005 29530 consensus_queue.cc:1048] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "508c7ae6b5c14d68a444dfa68227b3cf" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 33581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.384065 29344 raft_consensus.cc:1275] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Refusing update from remote peer 49195b9666374b8e928416b05f269c55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:07.385460 29543 consensus_queue.cc:1048] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8fbd72d942040d4a9b4f90f646c60d5" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39155 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:07.587077 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.592857 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
I20260709 13:10:07.615861 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:07.616616 28565 tablet_replica.cc:333] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.617203 28565 raft_consensus.cc:2243] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.618010 28565 raft_consensus.cc:2272] T 64d7c033ab8f4169863e0383f1442170 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.619930 28565 tablet_replica.cc:333] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.620474 28565 raft_consensus.cc:2243] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.620865 28565 raft_consensus.cc:2272] T 5e3a6a0c39894fc4b7ffa3227deea924 P 508c7ae6b5c14d68a444dfa68227b3cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.622612 28565 tablet_replica.cc:333] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.623075 28565 raft_consensus.cc:2243] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.623889 28565 raft_consensus.cc:2272] T 63f6750cee374c4c8b89dcd0111dfd90 P 508c7ae6b5c14d68a444dfa68227b3cf [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.625406 29310 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:10:07.626457 28565 tablet_replica.cc:333] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.627187 28565 raft_consensus.cc:2243] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.627748 28565 raft_consensus.cc:2272] T 9894e675acac4126a857f9cf38fea226 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:07.628499 29310 consensus_peers.cc:597] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 -> Peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Couldn't send request to peer 508c7ae6b5c14d68a444dfa68227b3cf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.630127 28565 tablet_replica.cc:333] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.630833 28565 raft_consensus.cc:2243] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.631644 28565 raft_consensus.cc:2272] T b3739ec8e1ac4e3b88c90fb2385ea429 P 508c7ae6b5c14d68a444dfa68227b3cf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.633342 28565 tablet_replica.cc:333] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.633805 28565 raft_consensus.cc:2243] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.634538 28565 raft_consensus.cc:2272] T d5ef1009c48045c4a021e37f250dc06f P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.636224 28565 tablet_replica.cc:333] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.636750 28565 raft_consensus.cc:2243] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.637178 28565 raft_consensus.cc:2272] T 8a8493ef9b9a4eaa92d60e35d0574070 P 508c7ae6b5c14d68a444dfa68227b3cf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.639176 28565 tablet_replica.cc:333] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.639742 28565 raft_consensus.cc:2243] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.640147 28565 raft_consensus.cc:2272] T 617574c688d3413abd234a67bbd120fd P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.642289 28565 tablet_replica.cc:333] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.642755 28565 raft_consensus.cc:2243] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.643139 28565 raft_consensus.cc:2272] T c260d0eda1fa4286af5f5a15c2f49869 P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.645100 28565 tablet_replica.cc:333] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf: stopping tablet replica
I20260709 13:10:07.645546 28565 raft_consensus.cc:2243] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.645988 28565 raft_consensus.cc:2272] T 50104813c534412093bddca68cd83cdf P 508c7ae6b5c14d68a444dfa68227b3cf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.675333 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
W20260709 13:10:07.698700 29310 consensus_peers.cc:597] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 -> Peer 508c7ae6b5c14d68a444dfa68227b3cf (127.27.229.65:33581): Couldn't send request to peer 508c7ae6b5c14d68a444dfa68227b3cf. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:33581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:07.698865 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
I20260709 13:10:07.721982 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:07.722669 28565 tablet_replica.cc:333] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.723270 28565 raft_consensus.cc:2243] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.723773 28565 raft_consensus.cc:2272] T 617574c688d3413abd234a67bbd120fd P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.726071 28565 tablet_replica.cc:333] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.726643 28565 raft_consensus.cc:2243] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.727418 28565 raft_consensus.cc:2272] T 5e3a6a0c39894fc4b7ffa3227deea924 P 49195b9666374b8e928416b05f269c55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.729249 28565 tablet_replica.cc:333] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.729768 28565 raft_consensus.cc:2243] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.730212 28565 raft_consensus.cc:2272] T d5ef1009c48045c4a021e37f250dc06f P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.731860 28565 tablet_replica.cc:333] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.732360 28565 raft_consensus.cc:2243] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.733014 28565 raft_consensus.cc:2272] T 8a8493ef9b9a4eaa92d60e35d0574070 P 49195b9666374b8e928416b05f269c55 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.735165 28565 tablet_replica.cc:333] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.735644 28565 raft_consensus.cc:2243] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.736057 28565 raft_consensus.cc:2272] T b3739ec8e1ac4e3b88c90fb2385ea429 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.737991 28565 tablet_replica.cc:333] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.738480 28565 raft_consensus.cc:2243] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.738884 28565 raft_consensus.cc:2272] T 9894e675acac4126a857f9cf38fea226 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.740458 28565 tablet_replica.cc:333] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.741077 28565 raft_consensus.cc:2243] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.741468 28565 raft_consensus.cc:2272] T 64d7c033ab8f4169863e0383f1442170 P 49195b9666374b8e928416b05f269c55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.743055 28565 tablet_replica.cc:333] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.743484 28565 raft_consensus.cc:2243] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.744158 28565 raft_consensus.cc:2272] T c260d0eda1fa4286af5f5a15c2f49869 P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.746116 28565 tablet_replica.cc:333] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.746615 28565 raft_consensus.cc:2243] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.747141 28565 raft_consensus.cc:2272] T 50104813c534412093bddca68cd83cdf P 49195b9666374b8e928416b05f269c55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.749599 28565 tablet_replica.cc:333] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55: stopping tablet replica
I20260709 13:10:07.750101 28565 raft_consensus.cc:2243] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.750517 28565 raft_consensus.cc:2272] T 63f6750cee374c4c8b89dcd0111dfd90 P 49195b9666374b8e928416b05f269c55 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.777781 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
I20260709 13:10:07.795794 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
I20260709 13:10:07.815805 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:07.816452 28565 tablet_replica.cc:333] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.817022 28565 raft_consensus.cc:2243] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.817452 28565 raft_consensus.cc:2272] T 5e3a6a0c39894fc4b7ffa3227deea924 P d8fbd72d942040d4a9b4f90f646c60d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.819434 28565 tablet_replica.cc:333] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.819959 28565 raft_consensus.cc:2243] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.820396 28565 raft_consensus.cc:2272] T 63f6750cee374c4c8b89dcd0111dfd90 P d8fbd72d942040d4a9b4f90f646c60d5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.822288 28565 tablet_replica.cc:333] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.822891 28565 raft_consensus.cc:2243] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.823315 28565 raft_consensus.cc:2272] T 8a8493ef9b9a4eaa92d60e35d0574070 P d8fbd72d942040d4a9b4f90f646c60d5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.825779 28565 tablet_replica.cc:333] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.826417 28565 raft_consensus.cc:2243] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.826901 28565 raft_consensus.cc:2272] T d5ef1009c48045c4a021e37f250dc06f P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.828624 28565 tablet_replica.cc:333] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.829114 28565 raft_consensus.cc:2243] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.829838 28565 raft_consensus.cc:2272] T 617574c688d3413abd234a67bbd120fd P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.832042 28565 tablet_replica.cc:333] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.832543 28565 raft_consensus.cc:2243] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.833280 28565 raft_consensus.cc:2272] T 9894e675acac4126a857f9cf38fea226 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.834960 28565 tablet_replica.cc:333] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.835419 28565 raft_consensus.cc:2243] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.835835 28565 raft_consensus.cc:2272] T b3739ec8e1ac4e3b88c90fb2385ea429 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.837478 28565 tablet_replica.cc:333] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.837961 28565 raft_consensus.cc:2243] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.838343 28565 raft_consensus.cc:2272] T 64d7c033ab8f4169863e0383f1442170 P d8fbd72d942040d4a9b4f90f646c60d5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.839880 28565 tablet_replica.cc:333] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.840288 28565 raft_consensus.cc:2243] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:07.840643 28565 raft_consensus.cc:2272] T c260d0eda1fa4286af5f5a15c2f49869 P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.842622 28565 tablet_replica.cc:333] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5: stopping tablet replica
I20260709 13:10:07.843039 28565 raft_consensus.cc:2243] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.843667 28565 raft_consensus.cc:2272] T 50104813c534412093bddca68cd83cdf P d8fbd72d942040d4a9b4f90f646c60d5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.861737 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
I20260709 13:10:07.879194 28565 master.cc:562] Master@127.27.229.126:38135 shutting down...
I20260709 13:10:07.897027 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:07.897529 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:07.897823 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P 604cf017bfa748adbdea597ef4787664: stopping tablet replica
I20260709 13:10:07.917299 28565 master.cc:584] Master@127.27.229.126:38135 shutdown complete.
49195b9666374b8e928416b05f269c55  4
508c7ae6b5c14d68a444dfa68227b3cf  5
d8fbd72d942040d4a9b4f90f646c60d5  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10368 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:10:07.953827 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:42083
I20260709 13:10:07.954958 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:07.960306 29547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.960404 29548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:07.961593 29550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:07.962735 28565 server_base.cc:1061] running on GCE node
I20260709 13:10:07.963562 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:07.963759 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:07.963927 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602607963909 us; error 0 us; skew 500 ppm
I20260709 13:10:07.964452 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:07.966876 28565 webserver.cc:533] Webserver started at http://127.27.229.126:36191/ using document root <none> and password file <none>
I20260709 13:10:07.967330 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:07.967494 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:07.967762 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:07.968861 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-twc1"
I20260709 13:10:07.973341 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:10:07.976882 29555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:07.977617 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:07.977910 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a"
format_stamp: "Formatted at 2026-07-09 13:10:07 on dist-test-slave-twc1"
I20260709 13:10:07.978225 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:07.999737 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.001034 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.038587 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:42083
I20260709 13:10:08.038697 29606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:42083 every 8 connection(s)
I20260709 13:10:08.042421 29607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.052011 29607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Bootstrap starting.
I20260709 13:10:08.056577 29607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.060710 29607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: No bootstrap required, opened a new log
I20260709 13:10:08.062848 29607 raft_consensus.cc:359] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" member_type: VOTER }
I20260709 13:10:08.063242 29607 raft_consensus.cc:385] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:08.063460 29607 raft_consensus.cc:740] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa34c50a94a64ecc89d5a56c3ce9a26a, State: Initialized, Role: FOLLOWER
I20260709 13:10:08.064028 29607 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" member_type: VOTER }
I20260709 13:10:08.064486 29607 raft_consensus.cc:399] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:08.064688 29607 raft_consensus.cc:493] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:08.064940 29607 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.069020 29607 raft_consensus.cc:515] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" member_type: VOTER }
I20260709 13:10:08.069545 29607 leader_election.cc:304] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa34c50a94a64ecc89d5a56c3ce9a26a; no voters: 
I20260709 13:10:08.070712 29607 leader_election.cc:290] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:08.071007 29610 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:08.072335 29610 raft_consensus.cc:697] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 1 LEADER]: Becoming Leader. State: Replica: fa34c50a94a64ecc89d5a56c3ce9a26a, State: Running, Role: LEADER
I20260709 13:10:08.073015 29610 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" member_type: VOTER }
I20260709 13:10:08.073647 29607 sys_catalog.cc:565] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:08.078055 29612 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa34c50a94a64ecc89d5a56c3ce9a26a. Latest consensus state: current_term: 1 leader_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" member_type: VOTER } }
I20260709 13:10:08.078713 29612 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:08.077867 29611 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa34c50a94a64ecc89d5a56c3ce9a26a" member_type: VOTER } }
I20260709 13:10:08.079687 29611 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:08.086259 29617 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:08.091214 29617 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:08.092191 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:08.100844 29617 catalog_manager.cc:1383] Generated new cluster ID: 746cf83ff9b64027b93e207e8f426270
I20260709 13:10:08.101148 29617 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:08.125267 29617 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:08.126528 29617 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:08.140802 29617 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Generated new TSK 0
I20260709 13:10:08.141386 29617 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:08.158432 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.164379 29628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.165488 29629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.167023 28565 server_base.cc:1061] running on GCE node
W20260709 13:10:08.166925 29631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.167922 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:08.168120 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.168275 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602608168259 us; error 0 us; skew 500 ppm
I20260709 13:10:08.168776 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.170996 28565 webserver.cc:533] Webserver started at http://127.27.229.65:46373/ using document root <none> and password file <none>
I20260709 13:10:08.171439 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.171614 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.171869 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.172899 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "a9d8198d0b954886af452e89a8029614"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-twc1"
I20260709 13:10:08.178239 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:08.181439 29636 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.182300 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:10:08.182585 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "a9d8198d0b954886af452e89a8029614"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-twc1"
I20260709 13:10:08.182858 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.193500 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.194784 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.196271 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:08.198724 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:08.198915 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.199152 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:08.199316 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.238538 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:35503
I20260709 13:10:08.238626 29698 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:35503 every 8 connection(s)
I20260709 13:10:08.243312 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.250388 29703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.251248 29704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.253492 29706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.254455 28565 server_base.cc:1061] running on GCE node
I20260709 13:10:08.255538 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:08.255738 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.255911 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602608255891 us; error 0 us; skew 500 ppm
I20260709 13:10:08.256417 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.258877 28565 webserver.cc:533] Webserver started at http://127.27.229.66:41717/ using document root <none> and password file <none>
I20260709 13:10:08.259347 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.259536 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.259804 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.261206 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "42c443079435463daa8845e244cec9d3"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-twc1"
I20260709 13:10:08.261447 29699 heartbeater.cc:344] Connected to a master server at 127.27.229.126:42083
I20260709 13:10:08.261829 29699 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.262576 29699 heartbeater.cc:507] Master 127.27.229.126:42083 requested a full tablet report, sending...
I20260709 13:10:08.264768 29572 ts_manager.cc:194] Registered new tserver with Master: a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:08.266265 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:08.266817 29572 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50490
I20260709 13:10:08.269795 29711 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.270608 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:08.270887 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "42c443079435463daa8845e244cec9d3"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-twc1"
I20260709 13:10:08.271148 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.280577 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.281790 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.283262 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:08.285415 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:08.285614 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.285842 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:08.286057 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:10:08.324126 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:46333
I20260709 13:10:08.324226 29773 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:46333 every 8 connection(s)
I20260709 13:10:08.328747 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:08.336071 29777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.337828 29778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:08.340960 29780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:08.341245 28565 server_base.cc:1061] running on GCE node
I20260709 13:10:08.342159 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:08.342381 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:08.342403 29774 heartbeater.cc:344] Connected to a master server at 127.27.229.126:42083
I20260709 13:10:08.342634 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602608342616 us; error 0 us; skew 500 ppm
I20260709 13:10:08.342820 29774 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.343253 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:08.343578 29774 heartbeater.cc:507] Master 127.27.229.126:42083 requested a full tablet report, sending...
I20260709 13:10:08.345634 29572 ts_manager.cc:194] Registered new tserver with Master: 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:08.345896 28565 webserver.cc:533] Webserver started at http://127.27.229.67:42797/ using document root <none> and password file <none>
I20260709 13:10:08.346427 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:08.346612 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:08.346849 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:08.347131 29572 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50496
I20260709 13:10:08.348069 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "389c080a49494f8fb56c53fa7e6087f3"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-twc1"
I20260709 13:10:08.352622 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:10:08.355899 29785 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.356619 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:08.356909 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "389c080a49494f8fb56c53fa7e6087f3"
format_stamp: "Formatted at 2026-07-09 13:10:08 on dist-test-slave-twc1"
I20260709 13:10:08.357184 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:08.373021 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:08.374228 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:08.375715 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:08.378083 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:08.378286 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.378520 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:08.378669 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:08.418289 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:34899
I20260709 13:10:08.418381 29847 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:34899 every 8 connection(s)
I20260709 13:10:08.431527 29848 heartbeater.cc:344] Connected to a master server at 127.27.229.126:42083
I20260709 13:10:08.431893 29848 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:08.432618 29848 heartbeater.cc:507] Master 127.27.229.126:42083 requested a full tablet report, sending...
I20260709 13:10:08.434494 29572 ts_manager.cc:194] Registered new tserver with Master: 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:08.434803 28565 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013437372s
I20260709 13:10:08.435822 29572 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50500
I20260709 13:10:08.460034 29572 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50502:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:08.465956 29572 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:08.657374 29739 tablet_service.cc:1511] Processing CreateTablet for tablet e0af93d90eed4483befb4778a68e7b7c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:08.658950 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0af93d90eed4483befb4778a68e7b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.660187 29737 tablet_service.cc:1511] Processing CreateTablet for tablet 924dd112e90f41f492fd016c204c1a21 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:08.661599 29737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924dd112e90f41f492fd016c204c1a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.661689 29735 tablet_service.cc:1511] Processing CreateTablet for tablet 1689d69ba5ba4e52b2fc43a53054f310 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:08.663064 29738 tablet_service.cc:1511] Processing CreateTablet for tablet 63d505aa7c824fe884968612bdceec56 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:08.658960 29736 tablet_service.cc:1511] Processing CreateTablet for tablet c5fd36b246f24922bf4e9f9658c19013 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:08.666219 29735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1689d69ba5ba4e52b2fc43a53054f310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.668109 29736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5fd36b246f24922bf4e9f9658c19013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.672411 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d505aa7c824fe884968612bdceec56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.679109 29812 tablet_service.cc:1511] Processing CreateTablet for tablet 63d505aa7c824fe884968612bdceec56 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:08.680580 29812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d505aa7c824fe884968612bdceec56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.683159 29810 tablet_service.cc:1511] Processing CreateTablet for tablet c5fd36b246f24922bf4e9f9658c19013 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:08.684628 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5fd36b246f24922bf4e9f9658c19013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.687121 29809 tablet_service.cc:1511] Processing CreateTablet for tablet 1689d69ba5ba4e52b2fc43a53054f310 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:08.688535 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1689d69ba5ba4e52b2fc43a53054f310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.692155 29811 tablet_service.cc:1511] Processing CreateTablet for tablet 924dd112e90f41f492fd016c204c1a21 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:08.693933 29813 tablet_service.cc:1511] Processing CreateTablet for tablet e0af93d90eed4483befb4778a68e7b7c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:08.695299 29813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0af93d90eed4483befb4778a68e7b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.701265 29811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924dd112e90f41f492fd016c204c1a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.701519 29736 tablet_service.cc:1511] Processing CreateTablet for tablet 8c959a6f0c6345c9b312b54d4090ba28 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:08.702997 29736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c959a6f0c6345c9b312b54d4090ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.703747 29808 tablet_service.cc:1511] Processing CreateTablet for tablet fb08df13591747d7bf91993e76665808 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:08.705343 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb08df13591747d7bf91993e76665808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.700081 29735 tablet_service.cc:1511] Processing CreateTablet for tablet fb08df13591747d7bf91993e76665808 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:08.708546 29735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb08df13591747d7bf91993e76665808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.708858 29664 tablet_service.cc:1511] Processing CreateTablet for tablet e0af93d90eed4483befb4778a68e7b7c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:10:08.710357 29664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0af93d90eed4483befb4778a68e7b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.712296 29663 tablet_service.cc:1511] Processing CreateTablet for tablet 63d505aa7c824fe884968612bdceec56 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:10:08.713784 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63d505aa7c824fe884968612bdceec56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.717741 29807 tablet_service.cc:1511] Processing CreateTablet for tablet 8c959a6f0c6345c9b312b54d4090ba28 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:08.719236 29807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c959a6f0c6345c9b312b54d4090ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.719070 29661 tablet_service.cc:1511] Processing CreateTablet for tablet c5fd36b246f24922bf4e9f9658c19013 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:10:08.720400 29661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5fd36b246f24922bf4e9f9658c19013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.722980 29660 tablet_service.cc:1511] Processing CreateTablet for tablet 1689d69ba5ba4e52b2fc43a53054f310 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:10:08.726820 29662 tablet_service.cc:1511] Processing CreateTablet for tablet 924dd112e90f41f492fd016c204c1a21 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:10:08.725459 29659 tablet_service.cc:1511] Processing CreateTablet for tablet fb08df13591747d7bf91993e76665808 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:10:08.731314 29660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1689d69ba5ba4e52b2fc43a53054f310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.734807 29662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924dd112e90f41f492fd016c204c1a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.735069 29806 tablet_service.cc:1511] Processing CreateTablet for tablet 44b63ddac1a74c0c852d0c1d433ae7c4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:08.736510 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b63ddac1a74c0c852d0c1d433ae7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.738258 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb08df13591747d7bf91993e76665808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.739753 29805 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1f4e71b89146369180189f4402f3db (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:08.740499 29658 tablet_service.cc:1511] Processing CreateTablet for tablet 8c959a6f0c6345c9b312b54d4090ba28 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:10:08.741078 29805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1f4e71b89146369180189f4402f3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.743225 29657 tablet_service.cc:1511] Processing CreateTablet for tablet 44b63ddac1a74c0c852d0c1d433ae7c4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:08.746250 29658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c959a6f0c6345c9b312b54d4090ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.745988 29735 tablet_service.cc:1511] Processing CreateTablet for tablet 44b63ddac1a74c0c852d0c1d433ae7c4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:10:08.746070 29656 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1f4e71b89146369180189f4402f3db (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:08.747437 29656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1f4e71b89146369180189f4402f3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.750267 29657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b63ddac1a74c0c852d0c1d433ae7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.755034 29735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44b63ddac1a74c0c852d0c1d433ae7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.759599 29804 tablet_service.cc:1511] Processing CreateTablet for tablet abb12790de164e0a8286849b02b1dc26 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:08.761063 29804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb12790de164e0a8286849b02b1dc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.767114 29655 tablet_service.cc:1511] Processing CreateTablet for tablet abb12790de164e0a8286849b02b1dc26 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:08.768460 29655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb12790de164e0a8286849b02b1dc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.772105 29736 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1f4e71b89146369180189f4402f3db (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:10:08.782135 29736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1f4e71b89146369180189f4402f3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.801227 29737 tablet_service.cc:1511] Processing CreateTablet for tablet abb12790de164e0a8286849b02b1dc26 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:10:08.802608 29737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb12790de164e0a8286849b02b1dc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.806675 29738 tablet_service.cc:1511] Processing CreateTablet for tablet 43661428e7964263870fe7a8e07bf265 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:08.808205 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43661428e7964263870fe7a8e07bf265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.812222 29734 tablet_service.cc:1511] Processing CreateTablet for tablet dff620b2062c4139940ec520664442a1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:08.813808 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff620b2062c4139940ec520664442a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.815994 29733 tablet_service.cc:1511] Processing CreateTablet for tablet fba8307a3fdc4b40993f8208111c67f1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:08.817442 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8307a3fdc4b40993f8208111c67f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.819109 29732 tablet_service.cc:1511] Processing CreateTablet for tablet f6262c59cea24959ab0dd23d4279895c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:08.820604 29732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6262c59cea24959ab0dd23d4279895c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.802726 29863 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:08.827935 29865 tablet_bootstrap.cc:492] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:08.828150 29730 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:08.832402 29731 tablet_service.cc:1511] Processing CreateTablet for tablet 247648c6c3c549fcb98f79d8df339536 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:08.837821 29739 tablet_service.cc:1511] Processing CreateTablet for tablet 5444d738efbb44128f4f34da83448b15 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:08.839037 29730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.843886 29731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247648c6c3c549fcb98f79d8df339536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.846321 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5444d738efbb44128f4f34da83448b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.846671 29664 tablet_service.cc:1511] Processing CreateTablet for tablet 43661428e7964263870fe7a8e07bf265 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:08.848145 29664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43661428e7964263870fe7a8e07bf265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.858999 29805 tablet_service.cc:1511] Processing CreateTablet for tablet 43661428e7964263870fe7a8e07bf265 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:10:08.860394 29805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43661428e7964263870fe7a8e07bf265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.861634 29657 tablet_service.cc:1511] Processing CreateTablet for tablet fba8307a3fdc4b40993f8208111c67f1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:08.863083 29657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8307a3fdc4b40993f8208111c67f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.864687 29865 tablet_bootstrap.cc:654] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.865706 29807 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:08.867992 29806 tablet_service.cc:1511] Processing CreateTablet for tablet dff620b2062c4139940ec520664442a1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:08.873194 29808 tablet_service.cc:1511] Processing CreateTablet for tablet fba8307a3fdc4b40993f8208111c67f1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:10:08.873598 29807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.874482 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff620b2062c4139940ec520664442a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.875797 29660 tablet_service.cc:1511] Processing CreateTablet for tablet 247648c6c3c549fcb98f79d8df339536 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:08.877043 29660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247648c6c3c549fcb98f79d8df339536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.871881 29664 tablet_service.cc:1511] Processing CreateTablet for tablet f6262c59cea24959ab0dd23d4279895c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:08.878161 29664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6262c59cea24959ab0dd23d4279895c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.884950 29655 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:10:08.893052 29809 tablet_service.cc:1511] Processing CreateTablet for tablet f6262c59cea24959ab0dd23d4279895c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:10:08.908533 29806 tablet_service.cc:1511] Processing CreateTablet for tablet 247648c6c3c549fcb98f79d8df339536 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:10:08.910326 29737 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc2bf2df3534ed4bb09dedb2cec3002 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:08.908533 29657 tablet_service.cc:1511] Processing CreateTablet for tablet 5444d738efbb44128f4f34da83448b15 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:08.911553 29737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc2bf2df3534ed4bb09dedb2cec3002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.913465 29864 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:08.915503 29813 tablet_service.cc:1511] Processing CreateTablet for tablet 5444d738efbb44128f4f34da83448b15 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:10:08.927635 29865 tablet_bootstrap.cc:492] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:08.928208 29865 ts_tablet_manager.cc:1403] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.000s
I20260709 13:10:08.933071 29661 tablet_service.cc:1511] Processing CreateTablet for tablet dff620b2062c4139940ec520664442a1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:10:08.933867 29656 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc2bf2df3534ed4bb09dedb2cec3002 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:08.934402 29661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff620b2062c4139940ec520664442a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.937813 29807 tablet_service.cc:1511] Processing CreateTablet for tablet d7943a6965d54826a2eee391b1459b90 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:08.938871 29662 tablet_service.cc:1511] Processing CreateTablet for tablet d7943a6965d54826a2eee391b1459b90 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:08.935773 29810 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc2bf2df3534ed4bb09dedb2cec3002 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:10:08.940101 29662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7943a6965d54826a2eee391b1459b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.942101 29656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc2bf2df3534ed4bb09dedb2cec3002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.947059 29657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5444d738efbb44128f4f34da83448b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.948478 29735 tablet_service.cc:1511] Processing CreateTablet for tablet 11a95760a1b04359956b38a1861eeca2 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:08.950290 29736 tablet_service.cc:1511] Processing CreateTablet for tablet 15438e4033d048dfa9c154db86242bc3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:08.951838 29735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a95760a1b04359956b38a1861eeca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.952212 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8307a3fdc4b40993f8208111c67f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.957463 29863 tablet_bootstrap.cc:654] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.959584 29663 tablet_service.cc:1511] Processing CreateTablet for tablet 0dba966d409c4e37bce58c7db358ebbb (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:08.959995 29664 tablet_service.cc:1511] Processing CreateTablet for tablet 11a95760a1b04359956b38a1861eeca2 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:08.959995 29864 tablet_bootstrap.cc:654] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:08.961628 29655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.941726 29659 tablet_service.cc:1511] Processing CreateTablet for tablet 15438e4033d048dfa9c154db86242bc3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:08.966612 29813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5444d738efbb44128f4f34da83448b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.970219 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247648c6c3c549fcb98f79d8df339536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.971072 29733 tablet_service.cc:1511] Processing CreateTablet for tablet 0dba966d409c4e37bce58c7db358ebbb (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:08.972604 29664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a95760a1b04359956b38a1861eeca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.972728 29807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7943a6965d54826a2eee391b1459b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.975260 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dba966d409c4e37bce58c7db358ebbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.975441 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc2bf2df3534ed4bb09dedb2cec3002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.977865 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6262c59cea24959ab0dd23d4279895c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.979370 29738 tablet_service.cc:1511] Processing CreateTablet for tablet d7943a6965d54826a2eee391b1459b90 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:10:08.980660 29736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15438e4033d048dfa9c154db86242bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.982632 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dba966d409c4e37bce58c7db358ebbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.985992 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7943a6965d54826a2eee391b1459b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.986703 29804 tablet_service.cc:1511] Processing CreateTablet for tablet 15438e4033d048dfa9c154db86242bc3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:10:08.988010 29804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15438e4033d048dfa9c154db86242bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:08.999918 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15438e4033d048dfa9c154db86242bc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.008975 29734 tablet_service.cc:1511] Processing CreateTablet for tablet b5bb27f7a1364209b951570c1c03f996 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:09.010288 29863 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:09.010366 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bb27f7a1364209b951570c1c03f996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.010928 29863 ts_tablet_manager.cc:1403] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.209s	user 0.006s	sys 0.009s
I20260709 13:10:09.013962 29863 raft_consensus.cc:359] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.014721 29863 raft_consensus.cc:385] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.014458 29812 tablet_service.cc:1511] Processing CreateTablet for tablet 11a95760a1b04359956b38a1861eeca2 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:10:09.015044 29863 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.015825 29863 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.024029 29864 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:09.024570 29864 ts_tablet_manager.cc:1403] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.181s	user 0.012s	sys 0.000s
I20260709 13:10:09.027869 29864 raft_consensus.cc:359] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.035658 29863 ts_tablet_manager.cc:1434] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.006s
I20260709 13:10:09.036463 29848 heartbeater.cc:499] Master 127.27.229.126:42083 was elected leader, sending a full tablet report...
I20260709 13:10:09.015887 29812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a95760a1b04359956b38a1861eeca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.050539 29730 tablet_service.cc:1511] Processing CreateTablet for tablet 917259a5b1e94566bb501796d8c4740d (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:09.051939 29730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 917259a5b1e94566bb501796d8c4740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.053527 29658 tablet_service.cc:1511] Processing CreateTablet for tablet b5bb27f7a1364209b951570c1c03f996 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:09.054904 29658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bb27f7a1364209b951570c1c03f996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.062083 29656 tablet_service.cc:1511] Processing CreateTablet for tablet b85eaa84d2104a8aa1d25054d069fd33 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:09.063446 29656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85eaa84d2104a8aa1d25054d069fd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.064165 29734 tablet_service.cc:1511] Processing CreateTablet for tablet b85eaa84d2104a8aa1d25054d069fd33 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:09.068840 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85eaa84d2104a8aa1d25054d069fd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.071220 29739 tablet_service.cc:1511] Processing CreateTablet for tablet 955eae6c53474f8a9c1673dbd294937e (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:09.067485 29657 tablet_service.cc:1511] Processing CreateTablet for tablet 917259a5b1e94566bb501796d8c4740d (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:09.061731 29805 tablet_service.cc:1511] Processing CreateTablet for tablet b5bb27f7a1364209b951570c1c03f996 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:10:09.075968 29805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bb27f7a1364209b951570c1c03f996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.076033 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 955eae6c53474f8a9c1673dbd294937e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.079514 29732 tablet_service.cc:1511] Processing CreateTablet for tablet e0f895f1660a4065920da71ac5df9433 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:09.081889 29657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 917259a5b1e94566bb501796d8c4740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.103657 29656 tablet_service.cc:1511] Processing CreateTablet for tablet 3147da791a394c9da4f7b521dd52a560 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:09.085373 29732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f895f1660a4065920da71ac5df9433. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:09.087425 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:09.105042 29656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3147da791a394c9da4f7b521dd52a560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.033344 29864 raft_consensus.cc:385] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.107319 29864 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.091454 29661 tablet_service.cc:1511] Processing CreateTablet for tablet 955eae6c53474f8a9c1673dbd294937e (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:09.092439 29659 tablet_service.cc:1511] Processing CreateTablet for tablet e0f895f1660a4065920da71ac5df9433 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:09.112068 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f895f1660a4065920da71ac5df9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.112826 29661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 955eae6c53474f8a9c1673dbd294937e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.006495 29865 raft_consensus.cc:359] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:09.120304 29730 tablet_service.cc:1511] Processing CreateTablet for tablet 2c09d4b0feb04ea0b3d0bf11a0fd4094 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:09.120926 29865 raft_consensus.cc:385] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.121248 29865 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.121577 29730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c09d4b0feb04ea0b3d0bf11a0fd4094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.122010 29865 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:09.021531 29811 tablet_service.cc:1511] Processing CreateTablet for tablet 0dba966d409c4e37bce58c7db358ebbb (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:10:09.123975 29811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dba966d409c4e37bce58c7db358ebbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.099905 29813 tablet_service.cc:1511] Processing CreateTablet for tablet b85eaa84d2104a8aa1d25054d069fd33 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:10:09.093257 29733 tablet_service.cc:1511] Processing CreateTablet for tablet 3147da791a394c9da4f7b521dd52a560 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:09.126803 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3147da791a394c9da4f7b521dd52a560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.114182 29864 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.116686 29738 tablet_service.cc:1511] Processing CreateTablet for tablet 1f520c8b2a9e4af1a8676180d2dd96f4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:09.130585 29863 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:09.134649 29813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85eaa84d2104a8aa1d25054d069fd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.133378 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f520c8b2a9e4af1a8676180d2dd96f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.150038 29731 tablet_service.cc:1511] Processing CreateTablet for tablet f0d5a34ce22a44e2a4882baa5443f81e (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:09.151388 29731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d5a34ce22a44e2a4882baa5443f81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.151494 29810 tablet_service.cc:1511] Processing CreateTablet for tablet 917259a5b1e94566bb501796d8c4740d (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:10:09.152779 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 917259a5b1e94566bb501796d8c4740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.199764 29865 ts_tablet_manager.cc:1434] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.271s	user 0.002s	sys 0.012s
I20260709 13:10:09.204979 29655 tablet_service.cc:1511] Processing CreateTablet for tablet 1f520c8b2a9e4af1a8676180d2dd96f4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:09.206357 29655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f520c8b2a9e4af1a8676180d2dd96f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.207069 29808 tablet_service.cc:1511] Processing CreateTablet for tablet e0f895f1660a4065920da71ac5df9433 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:10:09.208356 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f895f1660a4065920da71ac5df9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.210466 29809 tablet_service.cc:1511] Processing CreateTablet for tablet 955eae6c53474f8a9c1673dbd294937e (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:10:09.211807 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 955eae6c53474f8a9c1673dbd294937e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.212270 29863 tablet_bootstrap.cc:654] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.218427 29774 heartbeater.cc:499] Master 127.27.229.126:42083 was elected leader, sending a full tablet report...
I20260709 13:10:09.225478 29657 tablet_service.cc:1511] Processing CreateTablet for tablet 2c09d4b0feb04ea0b3d0bf11a0fd4094 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:09.230173 29657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c09d4b0feb04ea0b3d0bf11a0fd4094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.237092 29656 tablet_service.cc:1511] Processing CreateTablet for tablet f0d5a34ce22a44e2a4882baa5443f81e (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:09.246243 29699 heartbeater.cc:499] Master 127.27.229.126:42083 was elected leader, sending a full tablet report...
I20260709 13:10:09.249790 29656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d5a34ce22a44e2a4882baa5443f81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.251652 29807 tablet_service.cc:1511] Processing CreateTablet for tablet 1f520c8b2a9e4af1a8676180d2dd96f4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:10:09.253027 29807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f520c8b2a9e4af1a8676180d2dd96f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.259591 29804 tablet_service.cc:1511] Processing CreateTablet for tablet 2c09d4b0feb04ea0b3d0bf11a0fd4094 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:10:09.260998 29804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c09d4b0feb04ea0b3d0bf11a0fd4094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.273867 29806 tablet_service.cc:1511] Processing CreateTablet for tablet 3147da791a394c9da4f7b521dd52a560 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:10:09.272128 29805 tablet_service.cc:1511] Processing CreateTablet for tablet f0d5a34ce22a44e2a4882baa5443f81e (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:10:09.281687 29865 tablet_bootstrap.cc:492] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:09.283247 29734 tablet_service.cc:1511] Processing CreateTablet for tablet 4abf8e3126194219b6a68c724a22f711 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:09.286644 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3147da791a394c9da4f7b521dd52a560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.295154 29661 tablet_service.cc:1511] Processing CreateTablet for tablet 4abf8e3126194219b6a68c724a22f711 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:09.297964 29811 tablet_service.cc:1511] Processing CreateTablet for tablet 4abf8e3126194219b6a68c724a22f711 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:10:09.329442 29811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abf8e3126194219b6a68c724a22f711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.331108 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abf8e3126194219b6a68c724a22f711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.331250 29805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d5a34ce22a44e2a4882baa5443f81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.306275 29864 ts_tablet_manager.cc:1434] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.281s	user 0.025s	sys 0.007s
I20260709 13:10:09.312806 29730 tablet_service.cc:1511] Processing CreateTablet for tablet fc29718e51d549e395e72e7bff383425 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:09.313143 29662 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb4a6fd13164dbcbc05c397d0b009b5 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:09.309609 29809 tablet_service.cc:1511] Processing CreateTablet for tablet fc29718e51d549e395e72e7bff383425 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:09.313138 29739 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb4a6fd13164dbcbc05c397d0b009b5 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:09.355312 29864 tablet_bootstrap.cc:492] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:09.355643 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb4a6fd13164dbcbc05c397d0b009b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.356419 29730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc29718e51d549e395e72e7bff383425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.317770 29804 tablet_service.cc:1511] Processing CreateTablet for tablet 7fb4a6fd13164dbcbc05c397d0b009b5 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:10:09.320726 29655 tablet_service.cc:1511] Processing CreateTablet for tablet 5cafd7309bc64f839076e213c80b391c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:09.322695 29659 tablet_service.cc:1511] Processing CreateTablet for tablet fc29718e51d549e395e72e7bff383425 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:10:09.323637 29810 tablet_service.cc:1511] Processing CreateTablet for tablet 5cafd7309bc64f839076e213c80b391c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:09.325201 29738 tablet_service.cc:1511] Processing CreateTablet for tablet 5cafd7309bc64f839076e213c80b391c (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:10:09.358639 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cafd7309bc64f839076e213c80b391c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.328526 29661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4abf8e3126194219b6a68c724a22f711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.366282 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc29718e51d549e395e72e7bff383425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.367524 29865 tablet_bootstrap.cc:654] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.367595 29863 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:09.368121 29863 ts_tablet_manager.cc:1403] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.238s	user 0.019s	sys 0.042s
I20260709 13:10:09.370265 29655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cafd7309bc64f839076e213c80b391c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.372268 29662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb4a6fd13164dbcbc05c397d0b009b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.379551 29869 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.380151 29869 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.381942 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc29718e51d549e395e72e7bff383425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.385685 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cafd7309bc64f839076e213c80b391c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.409148 29804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb4a6fd13164dbcbc05c397d0b009b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.424402 29663 tablet_service.cc:1511] Processing CreateTablet for tablet 69b5d0bcdd3a4027b3e5abda839ab825 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:09.394579 29869 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:09.426219 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b5d0bcdd3a4027b3e5abda839ab825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.434991 29734 tablet_service.cc:1511] Processing CreateTablet for tablet 69b5d0bcdd3a4027b3e5abda839ab825 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:09.436335 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b5d0bcdd3a4027b3e5abda839ab825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.408002 29863 raft_consensus.cc:359] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.446671 29863 raft_consensus.cc:385] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.446982 29863 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.447746 29863 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.450317 29663 tablet_service.cc:1511] Processing CreateTablet for tablet b03ee62645904e089f0f2c4dffb22b40 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:09.451800 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ee62645904e089f0f2c4dffb22b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.454077 29731 tablet_service.cc:1511] Processing CreateTablet for tablet b03ee62645904e089f0f2c4dffb22b40 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:09.455472 29731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ee62645904e089f0f2c4dffb22b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.482604 29863 ts_tablet_manager.cc:1434] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.002s
I20260709 13:10:09.489749 29864 tablet_bootstrap.cc:654] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.506737 29871 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.507367 29871 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.511786 29865 tablet_bootstrap.cc:492] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:09.512346 29865 ts_tablet_manager.cc:1403] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.231s	user 0.017s	sys 0.057s
I20260709 13:10:09.512598 29871 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:09.519891 29865 raft_consensus.cc:359] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.520653 29865 raft_consensus.cc:385] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.520939 29865 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.518846 29863 tablet_bootstrap.cc:492] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:09.542414 29870 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.542932 29870 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:09.555200 29806 tablet_service.cc:1511] Processing CreateTablet for tablet 69b5d0bcdd3a4027b3e5abda839ab825 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:10:09.555419 29739 tablet_service.cc:1511] Processing CreateTablet for tablet f96ce2eb1d674d2faf1a6340807d4961 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:09.556484 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69b5d0bcdd3a4027b3e5abda839ab825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.556788 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96ce2eb1d674d2faf1a6340807d4961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.547873 29870 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:09.531530 29865 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.555419 29811 tablet_service.cc:1511] Processing CreateTablet for tablet b03ee62645904e089f0f2c4dffb22b40 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:10:09.568265 29865 ts_tablet_manager.cc:1434] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.002s
I20260709 13:10:09.569321 29865 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:09.575748 29865 tablet_bootstrap.cc:654] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.579020 29811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ee62645904e089f0f2c4dffb22b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.581362 29864 tablet_bootstrap.cc:492] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:09.583971 29863 tablet_bootstrap.cc:654] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.610781 29864 ts_tablet_manager.cc:1403] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.256s	user 0.010s	sys 0.006s
I20260709 13:10:09.624402 29731 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3e1085d9ad4120b3284dbd3939b5e4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:09.627264 29661 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3e1085d9ad4120b3284dbd3939b5e4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:09.628901 29661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3e1085d9ad4120b3284dbd3939b5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.634377 29864 raft_consensus.cc:359] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.635210 29864 raft_consensus.cc:385] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.635525 29864 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.636478 29864 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.638713 29864 ts_tablet_manager.cc:1434] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:10:09.625852 29731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3e1085d9ad4120b3284dbd3939b5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.618036 29659 tablet_service.cc:1511] Processing CreateTablet for tablet f96ce2eb1d674d2faf1a6340807d4961 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:09.666400 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96ce2eb1d674d2faf1a6340807d4961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.678905 29863 tablet_bootstrap.cc:492] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:09.679536 29863 ts_tablet_manager.cc:1403] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.196s	user 0.023s	sys 0.027s
I20260709 13:10:09.680375 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:09.693843 29639 leader_election.cc:343] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.695820 29656 tablet_service.cc:1511] Processing CreateTablet for tablet f35983a3f0f340da8a2b9daae61af306 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:09.697098 29656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35983a3f0f340da8a2b9daae61af306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.697904 29734 tablet_service.cc:1511] Processing CreateTablet for tablet f35983a3f0f340da8a2b9daae61af306 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:09.699234 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35983a3f0f340da8a2b9daae61af306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.705243 29663 tablet_service.cc:1511] Processing CreateTablet for tablet c996471e869b4dc78487f6b92d7bb586 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:09.707643 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c996471e869b4dc78487f6b92d7bb586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.710592 29863 raft_consensus.cc:359] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.711328 29863 raft_consensus.cc:385] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.711594 29863 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.712337 29863 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.722033 29864 tablet_bootstrap.cc:492] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:09.723778 29733 tablet_service.cc:1511] Processing CreateTablet for tablet 0801ed5c1b69497e8182bfe2461cdbf3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:09.725099 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0801ed5c1b69497e8182bfe2461cdbf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.727069 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:09.731402 29787 leader_election.cc:343] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.739328 29658 tablet_service.cc:1511] Processing CreateTablet for tablet 0801ed5c1b69497e8182bfe2461cdbf3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:09.740926 29658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0801ed5c1b69497e8182bfe2461cdbf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.740551 29730 tablet_service.cc:1511] Processing CreateTablet for tablet c996471e869b4dc78487f6b92d7bb586 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:09.748752 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:09.750092 29638 leader_election.cc:343] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.750608 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:09.755750 29871 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.759817 29865 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:09.760325 29865 ts_tablet_manager.cc:1403] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.191s	user 0.034s	sys 0.041s
I20260709 13:10:09.762013 29863 ts_tablet_manager.cc:1434] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.082s	user 0.003s	sys 0.004s
I20260709 13:10:09.763103 29863 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:09.764359 29864 tablet_bootstrap.cc:654] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.764583 29662 tablet_service.cc:1511] Processing CreateTablet for tablet a191ecb8137c4add8a89d6a240470f6b (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:09.754055 29730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c996471e869b4dc78487f6b92d7bb586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.767565 29810 tablet_service.cc:1511] Processing CreateTablet for tablet f96ce2eb1d674d2faf1a6340807d4961 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:10:09.768931 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96ce2eb1d674d2faf1a6340807d4961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.770926 29806 tablet_service.cc:1511] Processing CreateTablet for tablet 7b3e1085d9ad4120b3284dbd3939b5e4 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:10:09.772152 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3e1085d9ad4120b3284dbd3939b5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.774243 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:09.775897 29715 leader_election.cc:343] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.782373 29804 tablet_service.cc:1511] Processing CreateTablet for tablet f35983a3f0f340da8a2b9daae61af306 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:10:09.783710 29805 tablet_service.cc:1511] Processing CreateTablet for tablet a191ecb8137c4add8a89d6a240470f6b (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:09.783738 29804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35983a3f0f340da8a2b9daae61af306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.782362 29809 tablet_service.cc:1511] Processing CreateTablet for tablet 0801ed5c1b69497e8182bfe2461cdbf3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:10:09.786337 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0801ed5c1b69497e8182bfe2461cdbf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.790271 29805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a191ecb8137c4add8a89d6a240470f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.794291 29662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a191ecb8137c4add8a89d6a240470f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.769846 29863 tablet_bootstrap.cc:654] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.802966 29811 tablet_service.cc:1511] Processing CreateTablet for tablet c996471e869b4dc78487f6b92d7bb586 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:10:09.804333 29811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c996471e869b4dc78487f6b92d7bb586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.787616 29865 raft_consensus.cc:359] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.805543 29865 raft_consensus.cc:385] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.807015 29865 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.809576 29865 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.813759 29869 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.814297 29869 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.814810 29663 tablet_service.cc:1511] Processing CreateTablet for tablet 57815098d70a4f2bb7a308d71da6ef9a (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:09.816347 29869 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:09.816107 29733 tablet_service.cc:1511] Processing CreateTablet for tablet 57815098d70a4f2bb7a308d71da6ef9a (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:09.817394 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57815098d70a4f2bb7a308d71da6ef9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.820981 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:09.816097 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57815098d70a4f2bb7a308d71da6ef9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:09.824707 29787 leader_election.cc:343] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.825160 29659 tablet_service.cc:1511] Processing CreateTablet for tablet 7df971e435c648008d74c7352ccea2d9 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:09.825620 29734 tablet_service.cc:1511] Processing CreateTablet for tablet 69d6f3febc834e4aa68fd4b032f83332 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:09.826026 29738 tablet_service.cc:1511] Processing CreateTablet for tablet 7df971e435c648008d74c7352ccea2d9 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:09.826623 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df971e435c648008d74c7352ccea2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.826916 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6f3febc834e4aa68fd4b032f83332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.829595 29732 tablet_service.cc:1511] Processing CreateTablet for tablet fc891e1e674747fda6007601f64c4341 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:09.830926 29732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc891e1e674747fda6007601f64c4341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.831369 29655 tablet_service.cc:1511] Processing CreateTablet for tablet fc891e1e674747fda6007601f64c4341 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:09.833091 29655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc891e1e674747fda6007601f64c4341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.834245 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df971e435c648008d74c7352ccea2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.836570 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:09.826911 29865 ts_tablet_manager.cc:1434] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.004s
I20260709 13:10:09.838898 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:09.839424 29661 tablet_service.cc:1511] Processing CreateTablet for tablet 222c2ac209fd4c24a1f636fff5c13739 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:09.840080 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:09.840734 29661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222c2ac209fd4c24a1f636fff5c13739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.842432 29809 tablet_service.cc:1511] Processing CreateTablet for tablet 307badafd0e64a4c87993caa003f0e2a (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:09.843724 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307badafd0e64a4c87993caa003f0e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.843427 29735 tablet_service.cc:1511] Processing CreateTablet for tablet 222c2ac209fd4c24a1f636fff5c13739 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:09.844641 29735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222c2ac209fd4c24a1f636fff5c13739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.848270 29865 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:09.850174 29736 tablet_service.cc:1511] Processing CreateTablet for tablet 950ba8523bd4460bb0db3a8ae291f1ca (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:09.851486 29736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950ba8523bd4460bb0db3a8ae291f1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.851655 29812 tablet_service.cc:1511] Processing CreateTablet for tablet 69d6f3febc834e4aa68fd4b032f83332 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:09.851929 29807 tablet_service.cc:1511] Processing CreateTablet for tablet 7df971e435c648008d74c7352ccea2d9 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:10:09.852931 29812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6f3febc834e4aa68fd4b032f83332. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:09.853415 29789 leader_election.cc:343] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.854884 29810 tablet_service.cc:1511] Processing CreateTablet for tablet 57815098d70a4f2bb7a308d71da6ef9a (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:10:09.855996 29807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df971e435c648008d74c7352ccea2d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.854948 29813 tablet_service.cc:1511] Processing CreateTablet for tablet fc891e1e674747fda6007601f64c4341 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:10:09.857086 29813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc891e1e674747fda6007601f64c4341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.862275 29657 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef48e8ba554972a5c426adeff23599 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:09.862468 29664 tablet_service.cc:1511] Processing CreateTablet for tablet 1638cc6362e14d898e868b6d6927b9c1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:09.863636 29664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1638cc6362e14d898e868b6d6927b9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.864342 29657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef48e8ba554972a5c426adeff23599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.865226 29737 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef48e8ba554972a5c426adeff23599 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:09.866463 29737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef48e8ba554972a5c426adeff23599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.854884 29808 tablet_service.cc:1511] Processing CreateTablet for tablet 222c2ac209fd4c24a1f636fff5c13739 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:10:09.866895 29660 tablet_service.cc:1511] Processing CreateTablet for tablet 950ba8523bd4460bb0db3a8ae291f1ca (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:09.867883 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57815098d70a4f2bb7a308d71da6ef9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.868225 29660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950ba8523bd4460bb0db3a8ae291f1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.874040 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222c2ac209fd4c24a1f636fff5c13739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.875746 29863 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:09.866874 29656 tablet_service.cc:1511] Processing CreateTablet for tablet 69d6f3febc834e4aa68fd4b032f83332 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:10:09.901775 29656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69d6f3febc834e4aa68fd4b032f83332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.903105 29863 ts_tablet_manager.cc:1403] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.140s	user 0.011s	sys 0.001s
I20260709 13:10:09.903739 29869 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.904225 29869 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.906279 29869 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:09.912187 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:09.880997 29731 tablet_service.cc:1511] Processing CreateTablet for tablet a191ecb8137c4add8a89d6a240470f6b (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:10:09.853864 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:09.914067 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 60821.9us
W20260709 13:10:09.914848 29789 leader_election.cc:343] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.915263 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:09.894574 29739 tablet_service.cc:1511] Processing CreateTablet for tablet 307badafd0e64a4c87993caa003f0e2a (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:09.916826 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307badafd0e64a4c87993caa003f0e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.918722 29869 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:09.919222 29787 leader_election.cc:343] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:09.919361 29869 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:09.898800 29658 tablet_service.cc:1511] Processing CreateTablet for tablet 307badafd0e64a4c87993caa003f0e2a (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:10:09.920710 29658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307badafd0e64a4c87993caa003f0e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.923353 29805 tablet_service.cc:1511] Processing CreateTablet for tablet 950ba8523bd4460bb0db3a8ae291f1ca (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:10:09.924729 29805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950ba8523bd4460bb0db3a8ae291f1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.927450 29731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a191ecb8137c4add8a89d6a240470f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.953536 29808 tablet_service.cc:1511] Processing CreateTablet for tablet 1638cc6362e14d898e868b6d6927b9c1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:09.955152 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1638cc6362e14d898e868b6d6927b9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.960987 29806 tablet_service.cc:1511] Processing CreateTablet for tablet aa5a096f6b164ab5849280a34b19d3b7 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:09.961707 29735 tablet_service.cc:1511] Processing CreateTablet for tablet aa5a096f6b164ab5849280a34b19d3b7 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:09.963104 29735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5a096f6b164ab5849280a34b19d3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.906443 29863 raft_consensus.cc:359] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.966543 29863 raft_consensus.cc:385] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:09.966964 29863 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:09.967396 29865 tablet_bootstrap.cc:654] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:09.968041 29863 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.978077 29870 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.978700 29870 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:09.979784 29806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5a096f6b164ab5849280a34b19d3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.980983 29870 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:09.961254 29733 tablet_service.cc:1511] Processing CreateTablet for tablet 1638cc6362e14d898e868b6d6927b9c1 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:10:09.994738 29738 tablet_service.cc:1511] Processing CreateTablet for tablet c538253e68554f7b82c0f993198e47d3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:09.997082 29807 tablet_service.cc:1511] Processing CreateTablet for tablet 27ef48e8ba554972a5c426adeff23599 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:10:09.997690 29738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538253e68554f7b82c0f993198e47d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.997541 29660 tablet_service.cc:1511] Processing CreateTablet for tablet aa5a096f6b164ab5849280a34b19d3b7 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:10:09.998588 29807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef48e8ba554972a5c426adeff23599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.998835 29660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5a096f6b164ab5849280a34b19d3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.001511 29863 ts_tablet_manager.cc:1434] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 13:10:10.002596 29863 tablet_bootstrap.cc:492] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.003504 29864 tablet_bootstrap.cc:492] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.004096 29864 ts_tablet_manager.cc:1403] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.020s
I20260709 13:10:10.001533 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:10.010222 29715 leader_election.cc:343] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.011946 29864 raft_consensus.cc:359] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:10.012953 29733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1638cc6362e14d898e868b6d6927b9c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.014942 29736 tablet_service.cc:1511] Processing CreateTablet for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:10.016258 29736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.023032 29661 tablet_service.cc:1511] Processing CreateTablet for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:10.023854 29655 tablet_service.cc:1511] Processing CreateTablet for tablet c538253e68554f7b82c0f993198e47d3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:10.023032 29812 tablet_service.cc:1511] Processing CreateTablet for tablet c538253e68554f7b82c0f993198e47d3 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:10:10.024374 29662 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc4f503726e4efd8620c27deea0b183 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:10.025791 29812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538253e68554f7b82c0f993198e47d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.029035 29863 tablet_bootstrap.cc:654] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.029645 29871 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.030156 29871 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.032269 29871 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.033885 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.033835 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:10.035534 29639 leader_election.cc:343] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:10.036192 29638 leader_election.cc:343] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.036329 29737 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc4f503726e4efd8620c27deea0b183 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:10.036640 29638 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:10.036806 29663 tablet_service.cc:1511] Processing CreateTablet for tablet a9aef678cd634050a9cbee4fe1f83abc (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:10.037645 29737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc4f503726e4efd8620c27deea0b183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.037681 29871 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.048724 29734 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:10.050191 29734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.042980 29657 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:10:10.014078 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 99263.2us
W20260709 13:10:10.054657 29714 leader_election.cc:343] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.055152 29714 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.056241 29870 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.056556 29732 tablet_service.cc:1511] Processing CreateTablet for tablet a40195a1eb8d422f8e2cec6f836a23ee (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:10.024458 29661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.061872 29655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538253e68554f7b82c0f993198e47d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.064031 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.066438 29808 tablet_service.cc:1511] Processing CreateTablet for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:10:10.066740 29813 tablet_service.cc:1511] Processing CreateTablet for tablet 1cc4f503726e4efd8620c27deea0b183 (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:10:10.067349 29809 tablet_service.cc:1511] Processing CreateTablet for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:10:10.068012 29808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.044221 29864 raft_consensus.cc:385] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.058473 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.069633 29811 tablet_service.cc:1511] Processing CreateTablet for tablet a40195a1eb8d422f8e2cec6f836a23ee (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:10.070658 29864 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.069182 29810 tablet_service.cc:1511] Processing CreateTablet for tablet a9aef678cd634050a9cbee4fe1f83abc (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:10:10.070895 29714 leader_election.cc:343] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.071416 29714 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.071756 29813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc4f503726e4efd8620c27deea0b183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.072600 29870 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:10.073870 29789 leader_election.cc:343] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.074398 29789 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.075357 29891 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.077673 29810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9aef678cd634050a9cbee4fe1f83abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.045523 29659 tablet_service.cc:1511] Processing CreateTablet for tablet a40195a1eb8d422f8e2cec6f836a23ee (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:10:10.080920 29809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.094347 29811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40195a1eb8d422f8e2cec6f836a23ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.102032 29732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40195a1eb8d422f8e2cec6f836a23ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.080013 29864 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:10.105321 29864 ts_tablet_manager.cc:1434] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.000s
W20260709 13:10:10.108069 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:10.106983 29663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9aef678cd634050a9cbee4fe1f83abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.117130 29865 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.117712 29865 ts_tablet_manager.cc:1403] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.270s	user 0.017s	sys 0.000s
I20260709 13:10:10.074617 29739 tablet_service.cc:1511] Processing CreateTablet for tablet a9aef678cd634050a9cbee4fe1f83abc (DEFAULT_TABLE table=test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:10:10.118979 29739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9aef678cd634050a9cbee4fe1f83abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.119056 29659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40195a1eb8d422f8e2cec6f836a23ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.120718 29865 raft_consensus.cc:359] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.122270 29662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc4f503726e4efd8620c27deea0b183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.123778 29864 tablet_bootstrap.cc:492] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.121501 29865 raft_consensus.cc:385] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.126233 29865 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.131863 29657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.134167 29865 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.136619 29865 ts_tablet_manager.cc:1434] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:10:10.137827 29865 tablet_bootstrap.cc:492] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.144263 29865 tablet_bootstrap.cc:654] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.170445 29863 tablet_bootstrap.cc:492] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.171821 29863 ts_tablet_manager.cc:1403] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.169s	user 0.026s	sys 0.015s
I20260709 13:10:10.174780 29863 raft_consensus.cc:359] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.175637 29863 raft_consensus.cc:385] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.175956 29863 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.176759 29863 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.183495 29864 tablet_bootstrap.cc:654] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.195693 29863 ts_tablet_manager.cc:1434] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:10:10.196736 29863 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.199240 29865 tablet_bootstrap.cc:492] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.199780 29865 ts_tablet_manager.cc:1403] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.012s
I20260709 13:10:10.206874 29865 raft_consensus.cc:359] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.210132 29865 raft_consensus.cc:385] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.210487 29865 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.210958 29864 tablet_bootstrap.cc:492] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.211460 29864 ts_tablet_manager.cc:1403] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.088s	user 0.023s	sys 0.009s
I20260709 13:10:10.211300 29865 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.207885 29863 tablet_bootstrap.cc:654] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.213599 29865 ts_tablet_manager.cc:1434] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:10:10.214627 29864 raft_consensus.cc:359] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.215852 29864 raft_consensus.cc:385] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.216325 29864 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.216562 29865 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.217237 29864 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.225327 29865 tablet_bootstrap.cc:654] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.226668 29864 ts_tablet_manager.cc:1434] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:10:10.227794 29864 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.230028 29863 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.230521 29863 ts_tablet_manager.cc:1403] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.002s
I20260709 13:10:10.233400 29863 raft_consensus.cc:359] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.234308 29863 raft_consensus.cc:385] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.234627 29863 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.235450 29863 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.237797 29863 ts_tablet_manager.cc:1434] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:10:10.235355 29864 tablet_bootstrap.cc:654] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.238008 29865 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.238610 29865 ts_tablet_manager.cc:1403] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 13:10:10.239172 29863 tablet_bootstrap.cc:492] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.242089 29865 raft_consensus.cc:359] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.243011 29865 raft_consensus.cc:385] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.243359 29865 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.244197 29865 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.247040 29865 ts_tablet_manager.cc:1434] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:10.248384 29863 tablet_bootstrap.cc:654] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.250288 29864 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.250830 29864 ts_tablet_manager.cc:1403] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:10:10.253245 29865 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.253801 29864 raft_consensus.cc:359] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.254565 29864 raft_consensus.cc:385] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.254875 29864 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.255590 29864 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.256981 29863 tablet_bootstrap.cc:492] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.257535 29863 ts_tablet_manager.cc:1403] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.001s
I20260709 13:10:10.257817 29864 ts_tablet_manager.cc:1434] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:10.259588 29864 tablet_bootstrap.cc:492] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.261029 29865 tablet_bootstrap.cc:654] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.261581 29870 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.262753 29870 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.264911 29870 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.265933 29864 tablet_bootstrap.cc:654] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.262264 29891 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.268386 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:10.272356 29714 leader_election.cc:343] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.269945 29891 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.270572 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:10.278677 29715 leader_election.cc:343] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.279215 29715 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.281467 29870 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.281498 29869 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.282658 29869 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.283401 29863 raft_consensus.cc:359] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:10.284260 29863 raft_consensus.cc:385] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.284729 29863 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.285187 29869 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.285670 29863 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:10.288360 29863 ts_tablet_manager.cc:1434] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.002s
I20260709 13:10:10.289536 29863 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.281009 29891 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.300684 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.301993 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.302758 29863 tablet_bootstrap.cc:654] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.303644 29870 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.304183 29870 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:10.304461 29789 leader_election.cc:343] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.305365 29871 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.306762 29871 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:10.307022 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:10.308449 29789 leader_election.cc:343] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.309729 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.310019 29870 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.310295 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.310479 29748 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:10.310947 29823 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:10.312021 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.312336 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.305388 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.313045 29749 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
W20260709 13:10:10.315840 29715 leader_election.cc:343] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.308513 29871 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.316121 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:10.312486 29787 leader_election.cc:343] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.317710 29823 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.318269 29787 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.317692 29871 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.319038 29871 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.319413 29871 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.319276 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.319867 29787 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.320437 29870 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.320801 29870 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.320880 29869 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.321043 29864 tablet_bootstrap.cc:492] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.321177 29870 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.321591 29864 ts_tablet_manager.cc:1403] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.062s	user 0.033s	sys 0.024s
I20260709 13:10:10.317692 29891 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.324805 29864 raft_consensus.cc:359] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.325738 29864 raft_consensus.cc:385] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.325451 29891 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.326130 29864 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.327116 29864 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.328053 29891 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.327724 29865 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.328645 29891 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.328895 29865 ts_tablet_manager.cc:1403] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.019s
I20260709 13:10:10.329021 29891 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.330902 29891 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.329409 29864 ts_tablet_manager.cc:1434] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:10.332316 29864 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.335206 29870 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.337117 29865 raft_consensus.cc:359] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.338027 29865 raft_consensus.cc:385] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.338307 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.338459 29865 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.338924 29864 tablet_bootstrap.cc:654] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:10.339921 29715 leader_election.cc:343] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.339653 29865 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.330025 29871 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:10.345376 29902 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.345937 29902 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.347424 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.348111 29823 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.348526 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.349170 29674 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:10.349293 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.350354 29865 ts_tablet_manager.cc:1434] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.009s
W20260709 13:10:10.350703 29639 leader_election.cc:343] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.350948 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:10.351550 29749 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.352049 29902 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.352968 29870 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.354053 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.354665 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.355741 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.356498 29869 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.356873 29869 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.357203 29869 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:10.362157 29638 leader_election.cc:343] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.362799 29638 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:10.363716 29902 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.364670 29865 tablet_bootstrap.cc:492] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.367223 29749 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:10.373590 29823 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:10.374962 29639 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.376004 29902 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.380201 29869 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:10.382088 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 62314.6us
I20260709 13:10:10.382836 29865 tablet_bootstrap.cc:654] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.383472 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.384002 29864 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.384066 29674 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.386408 29864 ts_tablet_manager.cc:1403] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.020s
I20260709 13:10:10.389057 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.389894 29749 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:10.392025 29674 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:10.392894 29871 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.389396 29864 raft_consensus.cc:359] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.393431 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.393985 29864 raft_consensus.cc:385] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.394287 29864 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.394798 29863 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.395128 29904 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.395743 29902 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:10.396100 29869 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.395313 29863 ts_tablet_manager.cc:1403] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.106s	user 0.022s	sys 0.010s
I20260709 13:10:10.396874 29865 tablet_bootstrap.cc:492] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.396618 29902 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:10.397449 29865 ts_tablet_manager.cc:1403] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.013s
I20260709 13:10:10.397591 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:10.398372 29749 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.399750 29863 raft_consensus.cc:359] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.400453 29863 raft_consensus.cc:385] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.400919 29863 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.400418 29864 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.400568 29865 raft_consensus.cc:359] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.401616 29865 raft_consensus.cc:385] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.402009 29865 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.401739 29863 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.403337 29864 ts_tablet_manager.cc:1434] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:10:10.402963 29865 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.403739 29863 ts_tablet_manager.cc:1434] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:10.404392 29864 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.404640 29863 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.394811 29891 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.407191 29822 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:10.409643 29865 ts_tablet_manager.cc:1434] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:10:10.411096 29863 tablet_bootstrap.cc:654] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.413388 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.414175 29865 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.414821 29905 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.411096 29864 tablet_bootstrap.cc:654] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.419668 29570 catalog_manager.cc:5697] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.421028 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:10.421859 29748 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:10.422942 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.423432 29891 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.424070 29904 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:10:10.424660 29789 leader_election.cc:343] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.425225 29789 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.425035 29904 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.427663 29891 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.429729 29865 tablet_bootstrap.cc:654] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.405786 29749 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:10.438722 29902 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.439287 29902 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.442622 29902 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.443440 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.443666 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:10.444814 29638 leader_election.cc:343] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.445699 29865 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.446345 29863 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.446801 29863 ts_tablet_manager.cc:1403] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.000s
W20260709 13:10:10.448045 29639 leader_election.cc:343] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.448868 29639 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:10.449632 29902 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.446372 29865 ts_tablet_manager.cc:1403] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.010s
I20260709 13:10:10.449452 29863 raft_consensus.cc:359] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.450878 29863 raft_consensus.cc:385] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.451288 29863 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.452267 29863 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.453006 29865 raft_consensus.cc:359] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.455065 29865 raft_consensus.cc:385] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.455073 29863 ts_tablet_manager.cc:1434] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:10.455474 29865 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.455811 29864 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.456246 29864 ts_tablet_manager.cc:1403] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.018s
I20260709 13:10:10.456403 29863 tablet_bootstrap.cc:492] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.456334 29865 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.457227 29569 catalog_manager.cc:5697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:10.458180 29902 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.458369 29865 ts_tablet_manager.cc:1434] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:10.458685 29902 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.459213 29865 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.460733 29902 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.461638 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.462328 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:10.463759 29639 leader_election.cc:343] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.465013 29865 tablet_bootstrap.cc:654] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.465584 29863 tablet_bootstrap.cc:654] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:10.467180 29638 leader_election.cc:343] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.465262 29864 raft_consensus.cc:359] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.467682 29638 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:10.467935 29864 raft_consensus.cc:385] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.468302 29864 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.469247 29902 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.469161 29864 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.471822 29864 ts_tablet_manager.cc:1434] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:10:10.472885 29864 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.473691 29863 tablet_bootstrap.cc:492] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.474269 29863 ts_tablet_manager.cc:1403] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:10:10.476666 29863 raft_consensus.cc:359] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.477195 29863 raft_consensus.cc:385] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.477437 29863 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.478085 29863 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.479056 29864 tablet_bootstrap.cc:654] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.479688 29863 ts_tablet_manager.cc:1434] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:10:10.480540 29863 tablet_bootstrap.cc:492] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.485808 29865 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.486438 29865 ts_tablet_manager.cc:1403] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.017s
I20260709 13:10:10.489028 29865 raft_consensus.cc:359] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.489717 29865 raft_consensus.cc:385] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.490018 29865 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.490636 29863 tablet_bootstrap.cc:654] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.485808 29864 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.491258 29864 ts_tablet_manager.cc:1403] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:10:10.493083 29902 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.493530 29902 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.493800 29864 raft_consensus.cc:359] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.494513 29864 raft_consensus.cc:385] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.494779 29864 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.495743 29902 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.496417 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.490648 29865 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.495566 29864 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.497242 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:10.497752 29638 leader_election.cc:343] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.498699 29865 ts_tablet_manager.cc:1434] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:10.498999 29864 ts_tablet_manager.cc:1434] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:10.497843 29822 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:10.499919 29864 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.500913 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:10.501608 29865 tablet_bootstrap.cc:492] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.506135 29902 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.506659 29902 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.507005 29902 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.509469 29864 tablet_bootstrap.cc:654] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.509740 29865 tablet_bootstrap.cc:654] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.514972 29863 tablet_bootstrap.cc:492] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.515475 29863 ts_tablet_manager.cc:1403] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.002s
I20260709 13:10:10.523463 29863 raft_consensus.cc:359] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.524170 29863 raft_consensus.cc:385] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.524456 29863 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.525089 29863 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.527276 29863 ts_tablet_manager.cc:1434] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:10.528657 29863 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.532822 29902 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.533974 29863 tablet_bootstrap.cc:654] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.537197 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:10.537452 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.537969 29822 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:10.538691 29638 leader_election.cc:343] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.539348 29904 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.539815 29904 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.541863 29904 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.542431 29905 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.542954 29905 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.543764 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:10.545219 29787 leader_election.cc:343] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.545327 29905 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.546546 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.547880 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.548233 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.548944 29673 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.550251 29822 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:10.550371 29715 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.551187 29870 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.551522 29902 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.551623 29870 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.548972 29823 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.553527 29905 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.553977 29905 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.554092 29870 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.554453 29905 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:10.554729 29789 leader_election.cc:343] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.555173 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.555927 29904 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.557099 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:10.557904 29902 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.558807 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.558892 29902 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:10.559475 29673 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.560060 29902 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.561030 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.561641 29823 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.562084 29905 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.562840 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.564483 29905 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.565171 29905 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.565549 29905 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.565899 29905 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.565999 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.566720 29823 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.570133 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.570819 29673 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.573669 29905 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.577656 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.578394 29674 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.583848 29864 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.584041 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.584455 29864 ts_tablet_manager.cc:1403] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.085s	user 0.029s	sys 0.048s
I20260709 13:10:10.584625 29822 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.585786 29905 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.588125 29674 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.591436 29864 raft_consensus.cc:359] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.592159 29864 raft_consensus.cc:385] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.592267 29673 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.592792 29864 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.592406 29822 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.593374 29907 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.593550 29864 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.593876 29907 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.596269 29823 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.596379 29864 ts_tablet_manager.cc:1434] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.006s
I20260709 13:10:10.597568 29864 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.597713 29907 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.598163 29714 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:10.598973 29905 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.601208 29905 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:10.599167 29714 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:10.601691 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.602392 29870 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.602442 29905 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.602380 29749 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:10.606099 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.606769 29823 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:10.607394 29865 tablet_bootstrap.cc:492] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.607538 29638 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.608314 29865 ts_tablet_manager.cc:1403] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.036s
I20260709 13:10:10.613574 29870 raft_consensus.cc:697] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:10.614746 29870 consensus_queue.cc:237] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.616379 29865 raft_consensus.cc:359] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.617100 29865 raft_consensus.cc:385] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.617386 29865 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.616343 29864 tablet_bootstrap.cc:654] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.617427 29570 catalog_manager.cc:5697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.619113 29865 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.620643 29926 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.621217 29863 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.622968 29863 ts_tablet_manager.cc:1403] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.004s
I20260709 13:10:10.622886 29926 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.619096 29902 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.624625 29902 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.625005 29902 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.625735 29863 raft_consensus.cc:359] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.626446 29863 raft_consensus.cc:385] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.626344 29926 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.622347 29865 ts_tablet_manager.cc:1434] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:10:10.626850 29863 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.627915 29865 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.627763 29863 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.628695 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.629351 29673 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.631546 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.633563 29863 ts_tablet_manager.cc:1434] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
W20260709 13:10:10.633493 29714 leader_election.cc:343] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.634895 29863 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.635062 29715 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:10.636543 29905 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.636960 29905 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.637292 29905 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.644249 29865 tablet_bootstrap.cc:654] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.645987 29572 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.649973 29902 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.654034 29864 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.654552 29864 ts_tablet_manager.cc:1403] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.006s
I20260709 13:10:10.656008 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:10.656602 29749 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.657259 29864 raft_consensus.cc:359] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.657905 29864 raft_consensus.cc:385] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.658200 29864 raft_consensus.cc:740] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.658866 29864 consensus_queue.cc:260] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.660524 29905 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.660833 29864 ts_tablet_manager.cc:1434] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:10.661983 29864 tablet_bootstrap.cc:492] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.662957 29905 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.664485 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:10.665712 29714 leader_election.cc:343] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.666107 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.666569 29673 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.668732 29572 catalog_manager.cc:5697] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.672894 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.673481 29823 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.674818 29749 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:10.676126 29638 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.676971 29907 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.677433 29907 raft_consensus.cc:697] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:10.678256 29907 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.681452 29673 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.683096 29863 tablet_bootstrap.cc:654] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.685194 29864 tablet_bootstrap.cc:654] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.688478 29715 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:10.671972 29902 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.689353 29905 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.690896 29905 raft_consensus.cc:697] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:10.691943 29905 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.693205 29823 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:10.702549 29572 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.706678 29865 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.707204 29865 ts_tablet_manager.cc:1403] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.079s	user 0.017s	sys 0.014s
I20260709 13:10:10.708969 29864 tablet_bootstrap.cc:492] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.709491 29864 ts_tablet_manager.cc:1403] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.000s
I20260709 13:10:10.710265 29865 raft_consensus.cc:359] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.710959 29865 raft_consensus.cc:385] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.711231 29865 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.711916 29865 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.712586 29864 raft_consensus.cc:359] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.713579 29864 raft_consensus.cc:385] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.713887 29865 ts_tablet_manager.cc:1434] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:10.713907 29864 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.715173 29865 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.715214 29864 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.713953 29863 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.717478 29864 ts_tablet_manager.cc:1434] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:10:10.717388 29863 ts_tablet_manager.cc:1403] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.007s
I20260709 13:10:10.717826 29905 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.718324 29905 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.720433 29905 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.720225 29863 raft_consensus.cc:359] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.720909 29863 raft_consensus.cc:385] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.721187 29863 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.721661 29865 tablet_bootstrap.cc:654] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.721835 29863 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.723668 29864 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.724836 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.725549 29673 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.726984 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.723196 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.727991 29823 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.730173 29864 tablet_bootstrap.cc:654] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.730556 29863 ts_tablet_manager.cc:1434] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:10.731520 29863 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.722880 29572 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.737138 29863 tablet_bootstrap.cc:654] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.738823 29905 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.739544 29905 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.739864 29905 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.743257 29864 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:10.743739 29864 ts_tablet_manager.cc:1403] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.005s
I20260709 13:10:10.746490 29864 raft_consensus.cc:359] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.747157 29864 raft_consensus.cc:385] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.747419 29864 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.747849 29905 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.748060 29864 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.750358 29864 ts_tablet_manager.cc:1434] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:10.750720 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.751336 29864 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.751271 29673 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.755192 29905 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.760051 29865 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:10.760462 29865 ts_tablet_manager.cc:1403] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.010s
I20260709 13:10:10.761404 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.762094 29823 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.764060 29673 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.764124 29865 raft_consensus.cc:359] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.764884 29865 raft_consensus.cc:385] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.765148 29865 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.765424 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.765777 29865 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.767724 29870 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.768188 29870 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:10.768949 29870 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.770977 29823 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.774492 29904 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.775115 29865 ts_tablet_manager.cc:1434] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:10:10.775554 29904 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.775945 29905 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.776227 29865 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.776440 29905 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.777760 29904 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.778411 29864 tablet_bootstrap.cc:654] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.778514 29905 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.778980 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.779772 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.779939 29749 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:10.780366 29673 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:10.781209 29907 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.781363 29787 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:10.781679 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.782371 29904 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.782292 29907 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.782874 29904 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.783372 29904 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.783806 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.784521 29907 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:10.785429 29714 leader_election.cc:343] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.782339 29674 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:10.787747 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:10.787408 29572 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.789052 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.790196 29863 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:10.790009 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.790611 29749 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:10.790552 29870 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.791316 29870 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.791656 29870 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.792029 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.792860 29907 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.792641 29904 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.793228 29907 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.793596 29907 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.796871 29865 tablet_bootstrap.cc:654] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.798302 29823 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:10.802821 29863 ts_tablet_manager.cc:1403] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.007s
I20260709 13:10:10.803278 29870 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.806190 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.806768 29674 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.806932 29902 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.807528 29863 raft_consensus.cc:359] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.808248 29863 raft_consensus.cc:385] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.808511 29863 raft_consensus.cc:740] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.809226 29863 consensus_queue.cc:260] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.811409 29863 ts_tablet_manager.cc:1434] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:10.815637 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.815795 29674 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:10.817130 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.818050 29905 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.818539 29905 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:10.819111 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:10.819725 29748 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.819365 29905 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.822552 29891 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.823101 29891 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.824169 29907 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.825380 29891 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.826588 29673 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:10.826934 29907 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.830361 29870 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.831394 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:10.831728 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.832504 29823 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:10.833461 29863 tablet_bootstrap.cc:492] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:10.833232 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.834511 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:10.831400 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.835484 29673 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
W20260709 13:10:10.838104 29714 leader_election.cc:343] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.839017 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:10.840037 29864 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
W20260709 13:10:10.840642 29787 leader_election.cc:343] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.841976 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:10.861829 29902 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:10.863969 29748 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:10.842336 29863 tablet_bootstrap.cc:654] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:10.843532 29864 ts_tablet_manager.cc:1403] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.023s
I20260709 13:10:10.848975 29870 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.854229 29891 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.865621 29904 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.865716 29891 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.860191 29907 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.866192 29891 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.871248 29787 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:10.872416 29904 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:10.872906 29904 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:10.873169 29870 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.873732 29904 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.876207 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.876335 29891 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.879830 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:10.880451 29673 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.882164 29864 raft_consensus.cc:359] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.886508 29864 raft_consensus.cc:385] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.887037 29864 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.891331 29864 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.895895 29870 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.897437 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.903082 29822 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:10.902920 29909 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.908684 29864 ts_tablet_manager.cc:1434] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:10:10.909889 29864 tablet_bootstrap.cc:492] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:10.909391 29570 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:10.914121 29909 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.919189 29673 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:10.922894 29909 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.924371 29891 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:10.926317 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:10.929785 29787 leader_election.cc:343] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.930721 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.931412 29749 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:10.933212 29787 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:10.934126 29891 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.938767 29909 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.939376 29909 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.939774 29909 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.968367 29870 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.968895 29870 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.973320 29870 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.975119 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:10.976472 29865 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
W20260709 13:10:10.976637 29715 leader_election.cc:343] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:10.976985 29865 ts_tablet_manager.cc:1403] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.201s	user 0.040s	sys 0.077s
I20260709 13:10:10.977864 29909 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.979694 29871 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.979686 29865 raft_consensus.cc:359] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.980494 29865 raft_consensus.cc:385] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:10.980463 29871 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.982877 29871 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:10.980672 29907 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:10.980996 29865 raft_consensus.cc:740] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:10.984104 29865 consensus_queue.cc:260] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:10.985857 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:10.986220 29865 ts_tablet_manager.cc:1434] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:10:10.986843 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:10.987054 29823 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:10.987624 29865 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:10.987529 29748 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:10.989236 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:10.990648 29907 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:10.991106 29907 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.991495 29907 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:10.994349 29865 tablet_bootstrap.cc:654] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.000633 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.001367 29748 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.007771 29865 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.008325 29865 ts_tablet_manager.cc:1403] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:10:11.011286 29865 raft_consensus.cc:359] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.012065 29865 raft_consensus.cc:385] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.012360 29865 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.013537 29865 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.015632 29865 ts_tablet_manager.cc:1434] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:11.017151 29865 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.018992 29746 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.024370 29865 tablet_bootstrap.cc:654] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.025524 29863 tablet_bootstrap.cc:492] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.027086 29863 ts_tablet_manager.cc:1403] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.194s	user 0.027s	sys 0.023s
I20260709 13:10:11.030340 29871 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.032112 29572 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.033110 29863 raft_consensus.cc:359] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.034806 29863 raft_consensus.cc:385] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.035162 29863 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.036186 29909 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.036077 29863 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.038561 29863 ts_tablet_manager.cc:1434] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:10:11.043467 29865 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.038851 29907 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.043632 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.043953 29865 ts_tablet_manager.cc:1403] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.011s
I20260709 13:10:11.042749 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.044512 29673 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:11.044922 29870 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.045213 29909 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.045519 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.046415 29674 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:11.012233 29748 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.047082 29863 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.049120 29787 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:11.050122 29904 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.050659 29904 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:11.050714 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:11.051764 29891 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.051623 29904 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.052245 29891 raft_consensus.cc:697] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:11.052484 29870 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.053193 29891 consensus_queue.cc:237] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.048293 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:11.054085 29909 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.056133 29909 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.057394 29863 tablet_bootstrap.cc:654] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.049877 29865 raft_consensus.cc:359] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.057874 29865 raft_consensus.cc:385] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.058736 29865 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.059402 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.060659 29748 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:11.057735 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.062772 29865 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.063354 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.064160 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:11.064944 29674 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:11.065951 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.066468 29871 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.067709 29870 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.068215 29870 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.069379 29865 ts_tablet_manager.cc:1434] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:10:11.046463 29907 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.070565 29870 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.071867 29865 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.072880 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:11.074848 29715 leader_election.cc:343] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.081035 29891 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.082824 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.083710 29870 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.084211 29870 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.085908 29863 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.086015 29865 tablet_bootstrap.cc:654] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.086612 29863 ts_tablet_manager.cc:1403] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.040s	user 0.020s	sys 0.014s
I20260709 13:10:11.087174 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.087981 29674 raft_consensus.cc:2393] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:11.089591 29870 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.092896 29863 raft_consensus.cc:359] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.093343 29891 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.097337 29865 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.093843 29863 raft_consensus.cc:385] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.097831 29865 ts_tablet_manager.cc:1403] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.001s
I20260709 13:10:11.097987 29863 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.098845 29863 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.099895 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.103498 29822 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:11.100549 29865 raft_consensus.cc:359] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.104390 29865 raft_consensus.cc:385] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.096938 29569 catalog_manager.cc:5697] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.104578 29863 ts_tablet_manager.cc:1434] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:11.105680 29863 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.105515 29569 catalog_manager.cc:5697] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.102598 29891 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.106370 29907 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:11.106606 29714 leader_election.cc:343] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.107033 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.107097 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.106997 29907 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.108295 29870 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.057816 29864 tablet_bootstrap.cc:654] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.109302 29907 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.110873 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:11.111467 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:11.111680 29749 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:11.113353 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.108819 29865 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.114619 29821 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:11.115698 29865 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.115998 29639 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:11.116415 29863 tablet_bootstrap.cc:654] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.117133 29907 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.117573 29865 ts_tablet_manager.cc:1434] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:10:11.118402 29865 tablet_bootstrap.cc:492] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.124070 29907 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.125293 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.126427 29870 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.126807 29870 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.127130 29870 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.127170 29714 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.128396 29905 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.154904 29907 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.156515 29905 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.172538 29864 tablet_bootstrap.cc:492] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:11.172024 29905 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.174676 29864 ts_tablet_manager.cc:1403] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.265s	user 0.022s	sys 0.019s
I20260709 13:10:11.175916 29870 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.178031 29864 raft_consensus.cc:359] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.180796 29864 raft_consensus.cc:385] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.181036 29864 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.179425 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.182062 29864 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.186800 29865 tablet_bootstrap.cc:654] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.187552 29864 ts_tablet_manager.cc:1434] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:10:11.187808 29964 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:10:11.189277 29715 leader_election.cc:343] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.189651 29864 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:11.190923 29902 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.191533 29870 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.192742 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:11.195422 29823 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.184165 29967 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:10:11.210071 29863 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.210503 29863 ts_tablet_manager.cc:1403] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.008s
I20260709 13:10:11.213349 29902 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.213891 29902 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.227250 29902 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.229341 29823 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:11.231415 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.232132 29821 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:11.233060 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.234822 29639 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:11.235450 29638 leader_election.cc:343] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.232811 29863 raft_consensus.cc:359] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.239136 29863 raft_consensus.cc:385] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.239472 29863 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.241115 29871 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.241611 29871 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.241993 29871 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.240178 29863 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.244828 29863 ts_tablet_manager.cc:1434] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.004s
I20260709 13:10:11.245869 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.246951 29964 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.247515 29964 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:11.255208 29964 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.259022 29863 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.262610 29967 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.267616 29864 tablet_bootstrap.cc:654] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.268213 29863 tablet_bootstrap.cc:654] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.272121 29865 tablet_bootstrap.cc:492] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.272578 29865 ts_tablet_manager.cc:1403] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.154s	user 0.025s	sys 0.011s
I20260709 13:10:11.275444 29865 raft_consensus.cc:359] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.276070 29865 raft_consensus.cc:385] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.276361 29865 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.277009 29865 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.279135 29865 ts_tablet_manager.cc:1434] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:11.280014 29865 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.287518 29967 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.289888 29871 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.296602 29967 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.297499 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.297694 29871 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.297948 29905 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:11.307088 29638 leader_election.cc:343] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.307679 29865 tablet_bootstrap.cc:654] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.299538 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:11.308568 29822 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.311226 29864 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:11.311733 29864 ts_tablet_manager.cc:1403] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.012s
I20260709 13:10:11.314821 29864 raft_consensus.cc:359] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.315717 29864 raft_consensus.cc:385] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.315996 29864 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.321249 29822 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:11.326875 29865 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.330906 29865 ts_tablet_manager.cc:1403] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.004s
I20260709 13:10:11.330333 29571 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.338109 29639 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:11.331727 29864 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.339568 29955 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.340019 29955 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:11.334923 29865 raft_consensus.cc:359] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.340996 29865 raft_consensus.cc:385] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.340875 29955 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.338050 29822 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.341399 29865 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.340898 29864 ts_tablet_manager.cc:1434] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:10:11.349171 29863 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.349247 29864 tablet_bootstrap.cc:492] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:11.349789 29863 ts_tablet_manager.cc:1403] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.010s
I20260709 13:10:11.349756 29865 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.351789 29865 ts_tablet_manager.cc:1434] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:10:11.352756 29865 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.352784 29863 raft_consensus.cc:359] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.353788 29905 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.356842 29863 raft_consensus.cc:385] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.358081 29863 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.358438 29870 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.358902 29863 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.359561 29865 tablet_bootstrap.cc:654] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.357182 29905 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.361371 29905 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.361835 29863 ts_tablet_manager.cc:1434] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:10:11.362785 29863 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.363185 29864 tablet_bootstrap.cc:654] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.363086 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:11.364823 29715 leader_election.cc:343] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.368538 29863 tablet_bootstrap.cc:654] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.372081 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:11.375186 29714 leader_election.cc:343] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.375834 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.377146 29967 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.385383 29865 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.385975 29865 ts_tablet_manager.cc:1403] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.011s
I20260709 13:10:11.388216 29864 tablet_bootstrap.cc:492] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:11.388761 29864 ts_tablet_manager.cc:1403] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 13:10:11.388677 29865 raft_consensus.cc:359] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.389453 29865 raft_consensus.cc:385] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.389741 29865 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.390352 29865 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.392161 29864 raft_consensus.cc:359] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.392670 29865 ts_tablet_manager.cc:1434] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:11.393057 29864 raft_consensus.cc:385] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.393446 29864 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.394420 29864 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.395721 29870 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.397346 29864 ts_tablet_manager.cc:1434] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:10:11.398766 29864 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:11.403774 29865 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.406906 29864 tablet_bootstrap.cc:654] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.413486 29865 tablet_bootstrap.cc:654] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.416222 29863 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.416729 29863 ts_tablet_manager.cc:1403] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.012s
I20260709 13:10:11.419353 29863 raft_consensus.cc:359] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.420034 29863 raft_consensus.cc:385] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.420300 29863 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.421033 29863 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.423302 29863 ts_tablet_manager.cc:1434] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:11.424206 29863 tablet_bootstrap.cc:492] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.429693 29863 tablet_bootstrap.cc:654] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.433095 29864 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:11.436784 29864 ts_tablet_manager.cc:1403] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.015s
I20260709 13:10:11.438416 29571 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.439415 29864 raft_consensus.cc:359] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.440143 29864 raft_consensus.cc:385] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.440423 29864 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.441206 29864 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.443212 29864 ts_tablet_manager.cc:1434] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:11.444100 29864 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:11.456271 29863 tablet_bootstrap.cc:492] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.456768 29863 ts_tablet_manager.cc:1403] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:10:11.459889 29904 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.461335 29904 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.461653 29865 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.462158 29865 ts_tablet_manager.cc:1403] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.013s
I20260709 13:10:11.464555 29865 raft_consensus.cc:359] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.465229 29865 raft_consensus.cc:385] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.465514 29865 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.459821 29863 raft_consensus.cc:359] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.466292 29863 raft_consensus.cc:385] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.466581 29863 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.467238 29863 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.459599 29864 tablet_bootstrap.cc:654] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.469215 29863 ts_tablet_manager.cc:1434] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:10:11.469714 29865 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.470156 29891 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.471863 29865 ts_tablet_manager.cc:1434] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.001s
I20260709 13:10:11.473042 29863 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.475169 29865 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.474761 29955 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.476070 29955 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.481734 29955 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.483305 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.484215 29822 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:11.485059 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.485687 29746 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:11.486671 29891 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.485638 29639 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:11.491204 29955 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.493249 29955 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.495565 29955 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.504686 29863 tablet_bootstrap.cc:654] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.508769 29955 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.511125 29955 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.513360 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.513938 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:11.514104 29749 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.514524 29822 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.521085 29904 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.521694 29749 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:11.521623 29904 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.521588 29822 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:11.527196 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.527902 29749 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:11.523901 29638 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:11.530634 29871 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.531098 29871 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:11.525463 29904 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.532403 29871 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.532202 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.533558 29672 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:11.535148 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:11.536530 29904 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.536931 29904 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.537792 29904 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.549597 29864 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:11.550108 29864 ts_tablet_manager.cc:1403] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.004s
I20260709 13:10:11.552099 29865 tablet_bootstrap.cc:654] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.555619 29891 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.556124 29891 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.558139 29891 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.552924 29864 raft_consensus.cc:359] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.558570 29864 raft_consensus.cc:385] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.558864 29864 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.559499 29864 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.560309 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.561497 29864 ts_tablet_manager.cc:1434] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
W20260709 13:10:11.561684 29789 leader_election.cc:343] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.562445 29864 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:11.565608 29904 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.567627 29904 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.568648 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.569340 29674 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.569828 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.571540 29748 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:11.575347 29863 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.576004 29863 ts_tablet_manager.cc:1403] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.002s
I20260709 13:10:11.575297 29571 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.578699 29863 raft_consensus.cc:359] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.579370 29863 raft_consensus.cc:385] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.579633 29863 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.580868 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.581445 29674 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.581808 29949 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.582185 29949 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.582477 29949 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.584726 29871 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.585232 29871 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.586043 29864 tablet_bootstrap.cc:654] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.586678 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:11.587419 29871 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.588994 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.589259 29949 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.589452 29904 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:11.590477 29638 leader_election.cc:343] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.591703 29949 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.592043 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.591740 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.592600 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.593262 29748 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:11.593343 29639 leader_election.cc:343] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.594272 29639 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:11.591266 29904 raft_consensus.cc:697] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:10:11.593740 29789 leader_election.cc:343] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.597849 29871 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.599874 29865 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.600359 29865 ts_tablet_manager.cc:1403] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.014s
I20260709 13:10:11.601027 29748 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.593267 29863 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.602968 29865 raft_consensus.cc:359] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.603652 29865 raft_consensus.cc:385] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.603911 29865 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.604672 29863 ts_tablet_manager.cc:1434] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:10:11.604712 29865 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.605703 29863 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.606527 29870 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.606709 29891 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.607010 29870 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.607630 29891 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.608574 29949 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.609579 29891 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.610590 29870 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.611642 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.612452 29748 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.612563 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.612920 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.613047 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.613605 29822 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
W20260709 13:10:11.613911 29715 leader_election.cc:343] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.612020 29865 ts_tablet_manager.cc:1434] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:10:11.618722 29865 tablet_bootstrap.cc:492] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.619386 29714 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.620548 29870 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.620909 29870 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.621246 29870 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.621162 29904 consensus_queue.cc:237] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.624074 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.628243 29748 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.628435 29870 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:11.619486 29789 leader_election.cc:343] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.630550 29891 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.631631 29865 tablet_bootstrap.cc:654] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.635317 29863 tablet_bootstrap.cc:654] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.635128 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:11.636639 29715 leader_election.cc:343] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.640313 29870 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.640522 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:11.641214 29822 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.647861 29822 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:11.643599 29749 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:11.648989 29714 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.651186 29905 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.651683 29905 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:11.652518 29905 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.652885 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.654006 29949 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.654449 29949 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:11.655228 29949 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.662525 29787 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.663560 30007 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.664959 29871 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.665455 29871 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.667819 29871 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.668999 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:11.669826 29822 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:11.671964 29870 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.672663 29870 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.675122 29863 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.675618 29863 ts_tablet_manager.cc:1403] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:10:11.677405 29571 catalog_manager.cc:5697] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.678947 29863 raft_consensus.cc:359] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.681488 29865 tablet_bootstrap.cc:492] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.682111 29865 ts_tablet_manager.cc:1403] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.003s
I20260709 13:10:11.682992 29863 raft_consensus.cc:385] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.686362 29865 raft_consensus.cc:359] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.687188 29865 raft_consensus.cc:385] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.687470 29865 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.688602 29865 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.689847 29864 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:11.690415 29864 ts_tablet_manager.cc:1403] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.128s	user 0.008s	sys 0.023s
I20260709 13:10:11.683369 29863 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.692754 29863 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.694294 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:11.696851 29714 leader_election.cc:343] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.698031 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.709450 29870 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.710225 29904 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.710727 29904 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.714186 29863 ts_tablet_manager.cc:1434] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:10:11.715081 29865 ts_tablet_manager.cc:1434] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.001s
I20260709 13:10:11.716635 29863 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.717324 29865 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.669843 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.720153 29904 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.721599 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.722827 29672 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:11.722980 29909 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.723424 29909 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.724596 29864 raft_consensus.cc:359] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.725286 29864 raft_consensus.cc:385] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.725395 29909 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.725562 29864 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.726606 29789 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:11.726438 29864 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.727617 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.728111 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.728228 29746 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
W20260709 13:10:11.731560 29789 leader_election.cc:343] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.732142 29674 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:11.733604 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:11.735148 29967 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.735584 29967 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.735908 29967 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.742981 29864 ts_tablet_manager.cc:1434] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:10:11.737145 29909 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.743870 29864 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:11.746138 29748 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.742800 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.750389 29746 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:11.752818 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.754046 29949 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.754488 29949 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.754726 29863 tablet_bootstrap.cc:654] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.754904 29949 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.743917 29909 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.756707 29909 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.761708 29865 tablet_bootstrap.cc:654] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.764140 29569 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.765254 29638 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:11.765336 29949 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.766316 29871 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.766044 29909 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.768565 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.769132 29748 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.770048 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.770578 29949 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.774510 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.772996 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.774641 29907 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:11.771333 29746 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.777896 29967 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.779145 29673 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:11.779397 29789 leader_election.cc:343] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.779388 29570 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.784323 29746 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.785936 29787 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:11.774195 29871 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.770933 29909 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.787981 29909 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.788581 29748 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.789733 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.792665 29863 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:11.793121 29949 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.793596 29949 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:11.794167 29673 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.794847 30007 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.795307 30007 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.792414 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.796504 29863 ts_tablet_manager.cc:1403] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.001s
I20260709 13:10:11.788606 29909 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:11.798064 29674 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.798615 30007 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.799131 29967 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:11.800081 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:11.794384 29949 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.800843 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:11.801309 29748 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:11.802358 29787 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:11.802637 29864 tablet_bootstrap.cc:654] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.798754 29909 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.808254 29863 raft_consensus.cc:359] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.808898 29863 raft_consensus.cc:385] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.809084 29863 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.809587 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:11.810823 29907 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.805034 30007 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.815454 30007 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.815809 30007 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.817167 29863 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.818274 29822 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.819667 29674 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:11.822932 29865 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:11.823503 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:11.823443 29865 ts_tablet_manager.cc:1403] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.003s
I20260709 13:10:11.824456 29905 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.824295 29926 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.825482 29905 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:11.826388 29905 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:11.830143 29789 leader_election.cc:343] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.831212 29865 raft_consensus.cc:359] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.831907 29865 raft_consensus.cc:385] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.832185 29865 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.833156 29865 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.841881 29865 ts_tablet_manager.cc:1434] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:11.842880 29865 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:11.845120 29822 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:11.851007 30007 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.846124 29870 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:11.859097 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:11.860359 29863 ts_tablet_manager.cc:1434] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
W20260709 13:10:11.860517 29789 leader_election.cc:343] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.862525 29863 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:11.865756 30007 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:11.867434 29864 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:11.867839 29864 ts_tablet_manager.cc:1403] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.000s
I20260709 13:10:11.867193 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:11.872186 29749 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.882213 29570 catalog_manager.cc:5697] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.880065 29864 raft_consensus.cc:359] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.884272 29864 raft_consensus.cc:385] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.884644 29864 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.884037 29570 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.885895 29864 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.892436 29864 ts_tablet_manager.cc:1434] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:10:11.892866 29749 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:11.893402 29864 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:11.894598 29787 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:11.896744 30007 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.897301 30007 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:11.898221 30007 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:11.936076 29572 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.966821 29863 tablet_bootstrap.cc:654] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.991346 29570 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.995765 29864 tablet_bootstrap.cc:654] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.004665 29865 tablet_bootstrap.cc:654] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.011832 29865 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.012243 29865 ts_tablet_manager.cc:1403] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.170s	user 0.004s	sys 0.007s
I20260709 13:10:12.014528 29865 raft_consensus.cc:359] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.015192 29865 raft_consensus.cc:385] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.015435 29865 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.016029 29865 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.017797 29863 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.018286 29863 ts_tablet_manager.cc:1403] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.038s
I20260709 13:10:12.019344 29865 ts_tablet_manager.cc:1434] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:10:12.019418 29909 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.019920 29909 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.020380 29865 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.020846 29863 raft_consensus.cc:359] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.021479 29863 raft_consensus.cc:385] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.021724 29863 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.022365 29863 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.021854 29909 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.024152 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.024842 29749 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:12.026079 29864 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.026463 29864 ts_tablet_manager.cc:1403] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.007s
I20260709 13:10:12.026563 29865 tablet_bootstrap.cc:654] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.027945 29787 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:12.028884 30007 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:12.029227 29864 raft_consensus.cc:359] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.029982 29864 raft_consensus.cc:385] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.030267 29864 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.030627 29949 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.030989 29864 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.029287 30007 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.033190 30007 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.033272 29864 ts_tablet_manager.cc:1434] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:12.024390 29863 ts_tablet_manager.cc:1434] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:12.035094 29863 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.036141 29864 tablet_bootstrap.cc:492] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.041405 30007 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.032634 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.046312 29673 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:12.046777 29863 tablet_bootstrap.cc:654] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.047894 29865 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.048454 29865 ts_tablet_manager.cc:1403] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.002s
I20260709 13:10:12.047931 29907 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.049237 30007 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.053233 29907 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.055970 29864 tablet_bootstrap.cc:654] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.058126 29955 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.059676 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:12.056741 29907 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.055768 29865 raft_consensus.cc:359] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.060369 29905 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.066027 29865 raft_consensus.cc:385] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.066421 29865 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.066476 29905 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.067476 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.067323 29865 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.068953 29905 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.070119 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.070333 29865 ts_tablet_manager.cc:1434] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 13:10:12.070297 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.071472 29865 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
W20260709 13:10:12.071640 29714 leader_election.cc:343] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:12.072528 29638 leader_election.cc:343] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.060428 29674 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:12.073086 29639 leader_election.cc:343] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.058981 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:12.075831 29749 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.075390 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:12.078797 29907 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.079842 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.080567 29671 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:12.081877 29715 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:12.083473 29905 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.083986 29905 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.084388 29905 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.091655 29749 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:12.093971 29674 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:12.093611 29905 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.106144 29863 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.106787 29863 ts_tablet_manager.cc:1403] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.034s
I20260709 13:10:12.111515 29789 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.115397 29909 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:12.115940 29909 raft_consensus.cc:697] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:12.116849 29909 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.118402 29905 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.120759 29864 tablet_bootstrap.cc:492] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.121239 29864 ts_tablet_manager.cc:1403] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.000s
I20260709 13:10:12.121366 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:12.126025 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:12.126716 29671 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:12.131798 29714 leader_election.cc:343] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.132484 29864 raft_consensus.cc:359] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.133157 29864 raft_consensus.cc:385] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.133425 29864 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.134450 29955 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:12.138451 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:12.134070 29864 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.141743 29863 raft_consensus.cc:359] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.142500 29863 raft_consensus.cc:385] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.142794 29863 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.143441 29863 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.145553 29863 ts_tablet_manager.cc:1434] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.000s
I20260709 13:10:12.146519 29863 tablet_bootstrap.cc:492] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.147008 29864 ts_tablet_manager.cc:1434] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:10:12.148136 29864 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.155138 29865 tablet_bootstrap.cc:654] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.159010 30007 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.159572 30007 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.159837 29671 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:12.164215 29715 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:12.165053 29905 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.165475 29905 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:10:12.165789 29715 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.166296 29905 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.168505 30007 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.169757 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.170425 29673 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:12.171945 29789 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.172899 30007 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.173345 30007 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.173702 30007 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.173780 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.174202 29891 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.174525 29748 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:12.176370 29864 tablet_bootstrap.cc:654] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.183645 29571 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.186820 30007 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.198205 29865 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.198995 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:12.200122 29673 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.204340 29863 tablet_bootstrap.cc:654] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.205157 29865 ts_tablet_manager.cc:1403] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.134s	user 0.013s	sys 0.001s
I20260709 13:10:12.208587 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:12.209210 29748 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.212522 29865 raft_consensus.cc:359] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.214938 29673 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:12.215008 30007 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.216529 29789 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.219144 29891 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.219614 29891 raft_consensus.cc:697] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:12.220424 29891 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.221680 29748 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:12.215373 29865 raft_consensus.cc:385] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.222613 29865 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.223332 29865 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.218133 29863 tablet_bootstrap.cc:492] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.224726 30007 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.226290 29865 ts_tablet_manager.cc:1434] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:10:12.224694 29863 ts_tablet_manager.cc:1403] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.000s
I20260709 13:10:12.227283 29865 tablet_bootstrap.cc:492] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.229471 29863 raft_consensus.cc:359] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.230219 29863 raft_consensus.cc:385] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.230504 29863 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.231208 29570 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.232935 29863 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.233834 29865 tablet_bootstrap.cc:654] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.234769 29891 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:12.240556 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.242422 29863 ts_tablet_manager.cc:1434] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:10:12.243466 29863 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.247856 29571 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.250088 29864 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.250591 29864 ts_tablet_manager.cc:1403] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.103s	user 0.009s	sys 0.008s
I20260709 13:10:12.253309 29864 raft_consensus.cc:359] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.253974 29863 tablet_bootstrap.cc:654] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.254016 29864 raft_consensus.cc:385] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.254654 29864 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.255488 29864 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.257558 29864 ts_tablet_manager.cc:1434] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:12.259351 29905 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.266315 29864 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.273362 29865 tablet_bootstrap.cc:492] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.273886 29865 ts_tablet_manager.cc:1403] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260709 13:10:12.280815 29909 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:12.289534 29789 consensus_peers.cc:597] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.294855 29865 raft_consensus.cc:359] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.295660 29865 raft_consensus.cc:385] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.295702 29909 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.296018 29865 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.298589 29865 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.300621 29865 ts_tablet_manager.cc:1434] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.004s
I20260709 13:10:12.301581 29865 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.301692 29863 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.302181 29863 ts_tablet_manager.cc:1403] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.001s
I20260709 13:10:12.304661 29863 raft_consensus.cc:359] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.318679 29863 raft_consensus.cc:385] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.319856 29863 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.311249 29865 tablet_bootstrap.cc:654] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.311676 29864 tablet_bootstrap.cc:654] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.321789 29863 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.326012 29863 ts_tablet_manager.cc:1434] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:10:12.327033 29863 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.333294 29863 tablet_bootstrap.cc:654] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.345070 29865 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.345548 29865 ts_tablet_manager.cc:1403] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 13:10:12.345808 29864 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.346325 29864 ts_tablet_manager.cc:1403] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.011s
I20260709 13:10:12.348542 29864 raft_consensus.cc:359] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.348964 29865 raft_consensus.cc:359] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.349763 29865 raft_consensus.cc:385] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.350018 29864 raft_consensus.cc:385] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.350116 29865 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.350329 29864 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.350914 29865 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.352044 29864 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.352988 29865 ts_tablet_manager.cc:1434] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:10:12.354270 29865 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.355341 29864 ts_tablet_manager.cc:1434] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:10:12.356313 29864 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.361716 29865 tablet_bootstrap.cc:654] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.367496 29863 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.370692 29863 ts_tablet_manager.cc:1403] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.013s
I20260709 13:10:12.367607 29870 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:10:12.370738 29864 tablet_bootstrap.cc:654] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.379559 29870 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.373819 29863 raft_consensus.cc:359] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.382727 29863 raft_consensus.cc:385] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.383018 29863 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.383733 29863 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.386451 29863 ts_tablet_manager.cc:1434] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:12.387549 29863 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.398581 29909 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.417126 29955 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.417707 29955 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.418421 29673 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.425235 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.426098 29821 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:12.427249 29639 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.428120 29907 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.428491 29907 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.428812 29907 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.433576 30007 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.437881 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.438714 29748 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:12.440117 29955 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.447695 29870 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.448225 29870 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.449272 29865 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.449765 29865 ts_tablet_manager.cc:1403] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.013s
I20260709 13:10:12.450335 29870 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.450978 29907 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.452716 29865 raft_consensus.cc:359] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.453474 29865 raft_consensus.cc:385] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.453760 29865 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.454454 29865 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.455595 29907 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.456501 29865 ts_tablet_manager.cc:1434] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:12.457417 29865 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.458230 29863 tablet_bootstrap.cc:654] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.462220 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:12.462857 29822 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.464367 29864 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.464918 29864 ts_tablet_manager.cc:1403] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.109s	user 0.036s	sys 0.036s
I20260709 13:10:12.452818 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.468339 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.469758 29821 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:12.470575 29907 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.471298 29865 tablet_bootstrap.cc:654] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.471098 29907 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:12.471623 29715 leader_election.cc:343] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.473601 29907 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.468083 29864 raft_consensus.cc:359] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.469117 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:12.474553 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.475101 29864 raft_consensus.cc:385] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.475250 29749 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:12.475418 29864 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.476472 29638 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.476270 29864 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.474678 29748 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.477361 29871 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.485433 29822 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:12.485852 29871 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.486384 29871 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.488770 29863 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.489259 29863 ts_tablet_manager.cc:1403] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.020s
I20260709 13:10:12.491544 30007 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.491776 29639 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.492050 30007 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.492694 29907 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.493206 29907 raft_consensus.cc:697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:12.492877 29871 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.494153 30007 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.491834 29863 raft_consensus.cc:359] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.494689 29863 raft_consensus.cc:385] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.494434 29907 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.494967 29863 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.496280 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.496412 29863 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.498519 29863 ts_tablet_manager.cc:1434] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:10:12.478134 29714 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.499504 29905 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.478609 29864 ts_tablet_manager.cc:1434] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:10:12.481973 29865 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.499953 29905 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.500278 29865 ts_tablet_manager.cc:1403] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.000s
I20260709 13:10:12.500348 29905 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.500661 29864 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.481487 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.502296 29823 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:12.502986 29865 raft_consensus.cc:359] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.503688 29865 raft_consensus.cc:385] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.503943 29865 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.504608 29865 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.506479 29865 ts_tablet_manager.cc:1434] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:12.507393 29865 tablet_bootstrap.cc:492] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.499042 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.509310 29749 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:12.512391 29748 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:12.513562 29671 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:12.499585 29863 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.515372 30007 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.515684 29787 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:12.516641 29949 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.517017 29949 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.517341 29949 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.520735 29863 tablet_bootstrap.cc:654] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.521404 29864 tablet_bootstrap.cc:654] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.522702 29865 tablet_bootstrap.cc:654] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.528308 29871 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.528760 29674 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:12.529855 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:12.538651 29863 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.539348 29863 ts_tablet_manager.cc:1403] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.004s
I20260709 13:10:12.539824 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:12.540505 29749 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.542248 29863 raft_consensus.cc:359] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.543068 29863 raft_consensus.cc:385] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.537519 29949 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.543359 29863 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.544317 29821 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:12.544145 29863 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.547636 29891 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.548105 29891 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.550691 29891 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.552356 29863 ts_tablet_manager.cc:1434] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:12.553375 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.554916 29746 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:12.555241 29863 tablet_bootstrap.cc:492] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
W20260709 13:10:12.554926 29789 leader_election.cc:343] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.558777 30007 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.563721 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:12.564545 29674 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:12.569970 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.570883 29746 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:12.572590 29863 tablet_bootstrap.cc:654] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.585191 29863 tablet_bootstrap.cc:492] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.585736 29863 ts_tablet_manager.cc:1403] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.003s
I20260709 13:10:12.590698 29863 raft_consensus.cc:359] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.591523 29863 raft_consensus.cc:385] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.590940 29572 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.591825 29863 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.592620 29863 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.594887 29863 ts_tablet_manager.cc:1434] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:10:12.595876 29863 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.603901 29787 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.605190 29949 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.606462 29949 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.609516 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:12.610584 29749 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:12.611716 29863 tablet_bootstrap.cc:654] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.612399 29638 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:12.613252 29907 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.613722 29907 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:12.614563 29907 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.615712 29905 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.620939 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:12.609762 29949 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.621541 29821 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.620939 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:12.623267 29715 leader_election.cc:343] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.628539 29863 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.629110 29863 ts_tablet_manager.cc:1403] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 13:10:12.634626 29863 raft_consensus.cc:359] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.635408 29863 raft_consensus.cc:385] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.635687 29863 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.636421 29863 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.636900 29787 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.637609 29905 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.628718 29821 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:12.643227 29909 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.645351 29714 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.647480 29905 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.648242 29905 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:12.654323 29967 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.655051 29905 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.660719 29949 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.676630 29865 tablet_bootstrap.cc:492] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.677161 29865 ts_tablet_manager.cc:1403] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.170s	user 0.023s	sys 0.060s
I20260709 13:10:12.653493 29864 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.678421 29864 ts_tablet_manager.cc:1403] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.178s	user 0.041s	sys 0.075s
I20260709 13:10:12.680176 29865 raft_consensus.cc:359] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.649863 29863 ts_tablet_manager.cc:1434] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:10:12.680859 29864 raft_consensus.cc:359] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.681618 29864 raft_consensus.cc:385] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.681965 29863 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.681886 29864 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.682649 29864 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.684626 29864 ts_tablet_manager.cc:1434] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:12.685528 29864 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.691192 29864 tablet_bootstrap.cc:654] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.691380 29863 tablet_bootstrap.cc:654] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.680863 29865 raft_consensus.cc:385] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.693953 29865 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.694607 29949 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.694657 29865 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.696805 29865 ts_tablet_manager.cc:1434] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.001s
I20260709 13:10:12.697239 29909 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.697777 29865 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.697798 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:12.696702 29949 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.699643 29671 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.704403 29865 tablet_bootstrap.cc:654] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.707438 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:12.708979 29749 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.715167 29865 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.715668 29865 ts_tablet_manager.cc:1403] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.002s
I20260709 13:10:12.719825 29865 raft_consensus.cc:359] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.720577 29865 raft_consensus.cc:385] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.720845 29865 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.721460 29865 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.722282 29863 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.722744 29863 ts_tablet_manager.cc:1403] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.014s
I20260709 13:10:12.723337 29672 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.723471 29865 ts_tablet_manager.cc:1434] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:10:12.724391 29865 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.725206 29863 raft_consensus.cc:359] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.725867 29863 raft_consensus.cc:385] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.727365 29863 raft_consensus.cc:740] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.728049 29863 consensus_queue.cc:260] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.730064 29863 ts_tablet_manager.cc:1434] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:12.730352 29865 tablet_bootstrap.cc:654] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.734427 29821 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.740134 29909 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:12.741416 29949 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.729065 29572 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.741937 29949 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.743939 29949 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.744351 29926 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.748075 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:12.750326 29789 leader_election.cc:343] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.752076 29863 tablet_bootstrap.cc:492] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.708117 29671 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:12.755396 29864 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.756685 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.757061 29864 ts_tablet_manager.cc:1403] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.008s
I20260709 13:10:12.758227 29904 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.758814 29904 raft_consensus.cc:697] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:12.759723 29904 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.762293 29870 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.762858 29870 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.760054 29864 raft_consensus.cc:359] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.765542 29864 raft_consensus.cc:385] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.766925 29864 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.766319 29749 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:12.767036 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.767210 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.771585 29864 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.773818 29746 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:12.765652 29870 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.777381 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:12.778509 29714 leader_election.cc:343] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.778728 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:10:12.780040 29715 leader_election.cc:343] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.780613 29715 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.781817 29870 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.780937 29864 ts_tablet_manager.cc:1434] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260709 13:10:12.782779 29904 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.783416 29904 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.783813 29904 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.785382 29864 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.790285 29570 catalog_manager.cc:5697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.791831 29863 tablet_bootstrap.cc:654] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.794972 29865 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.795429 29865 ts_tablet_manager.cc:1403] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.071s	user 0.031s	sys 0.034s
I20260709 13:10:12.799428 29865 raft_consensus.cc:359] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.800068 29865 raft_consensus.cc:385] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.800328 29865 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.801896 29865 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.804164 29865 ts_tablet_manager.cc:1434] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:10:12.805343 29865 tablet_bootstrap.cc:492] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.805388 29904 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.814076 29864 tablet_bootstrap.cc:654] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.814862 29904 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.816011 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:12.816673 29748 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.817958 29865 tablet_bootstrap.cc:654] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.818500 29571 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.815589 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:12.821529 29789 leader_election.cc:343] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.828753 29748 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:12.831724 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.832912 29904 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.833400 29904 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:12.834227 29904 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.830579 29864 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.837852 29864 ts_tablet_manager.cc:1403] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.005s
I20260709 13:10:12.841998 29863 tablet_bootstrap.cc:492] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.842546 29863 ts_tablet_manager.cc:1403] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.012s
I20260709 13:10:12.843364 29864 raft_consensus.cc:359] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.845062 29864 raft_consensus.cc:385] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.845789 29864 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.848685 29863 raft_consensus.cc:359] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.849473 29863 raft_consensus.cc:385] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.847285 29864 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.853595 29864 ts_tablet_manager.cc:1434] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:10:12.856626 29864 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.849761 29863 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.860072 29865 tablet_bootstrap.cc:492] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.859812 29863 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.860538 29865 ts_tablet_manager.cc:1403] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.010s
I20260709 13:10:12.862540 29863 ts_tablet_manager.cc:1434] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:10:12.863469 29863 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.863600 29865 raft_consensus.cc:359] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.864254 29865 raft_consensus.cc:385] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.864537 29865 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.865305 29865 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.867568 29865 ts_tablet_manager.cc:1434] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:10:12.869138 29865 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.869287 29863 tablet_bootstrap.cc:654] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.873817 29864 tablet_bootstrap.cc:654] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.874445 29955 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.875264 29865 tablet_bootstrap.cc:654] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.874922 29955 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.877100 29863 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.877615 29863 ts_tablet_manager.cc:1403] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.001s
I20260709 13:10:12.880479 29863 raft_consensus.cc:359] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.881228 29863 raft_consensus.cc:385] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.881528 29863 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.882262 29863 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.884611 29863 ts_tablet_manager.cc:1434] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:12.885509 29863 tablet_bootstrap.cc:492] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.886404 29864 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.887313 29864 ts_tablet_manager.cc:1403] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.003s
I20260709 13:10:12.888453 29909 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.888545 29926 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.888679 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.888993 29909 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.889583 29823 raft_consensus.cc:2393] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:12.889248 29926 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.881021 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.891052 29909 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.891355 29926 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.893069 29639 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:12.893079 29864 raft_consensus.cc:359] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.895169 29864 raft_consensus.cc:385] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.877030 29955 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.895246 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.896682 29823 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:12.897953 29863 tablet_bootstrap.cc:654] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.898017 29714 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:12.898979 29926 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.899353 29926 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.899667 29926 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.901067 29864 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.902107 29907 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.905297 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.906893 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:12.909328 29789 leader_election.cc:343] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.904146 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.915395 29907 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.917833 29870 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.924244 29870 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.926312 29870 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.926537 29865 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:12.927280 29865 ts_tablet_manager.cc:1403] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.007s
I20260709 13:10:12.927780 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:12.929562 29714 leader_election.cc:343] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.930346 29865 raft_consensus.cc:359] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.918843 29864 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:12.919921 29715 leader_election.cc:343] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.931049 29865 raft_consensus.cc:385] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.931402 29865 raft_consensus.cc:740] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.929636 29571 catalog_manager.cc:5697] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.932137 29865 consensus_queue.cc:260] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.934965 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.922577 29926 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.937747 29926 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.939563 29748 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:12.941140 29787 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.941952 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:12.942312 29904 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:12.944190 29715 leader_election.cc:343] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.944684 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.945982 29905 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.948418 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:12.949055 29904 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.951289 29863 tablet_bootstrap.cc:492] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:12.952029 29863 ts_tablet_manager.cc:1403] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.017s
I20260709 13:10:12.952420 29864 ts_tablet_manager.cc:1434] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.000s
I20260709 13:10:12.951427 29955 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.953058 29955 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:12.952696 29715 leader_election.cc:343] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:12.954607 29865 ts_tablet_manager.cc:1434] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.001s
I20260709 13:10:12.955699 29864 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.955528 29863 raft_consensus.cc:359] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.956022 29823 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:12.956398 29863 raft_consensus.cc:385] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.956740 29863 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.957540 29863 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.957731 29714 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.959353 29870 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:12.959854 29870 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:12.960121 29863 ts_tablet_manager.cc:1434] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:12.960649 29870 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.961302 29864 tablet_bootstrap.cc:654] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.961627 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.960145 29955 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.955521 29865 tablet_bootstrap.cc:492] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:12.964962 29926 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.965435 29926 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.967708 29926 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.971675 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:12.972366 29863 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:12.972302 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.974367 29674 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:12.972676 29909 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.976161 29715 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:12.977317 29905 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:12.977700 29905 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.978057 29905 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.979838 29864 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:12.980331 29864 ts_tablet_manager.cc:1403] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 13:10:12.975428 29909 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.981670 29863 tablet_bootstrap.cc:654] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.982892 29864 raft_consensus.cc:359] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.983361 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.983570 29864 raft_consensus.cc:385] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:12.983983 29864 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:12.985093 29864 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.986128 29823 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:12.986389 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:12.987282 29955 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.987277 29864 ts_tablet_manager.cc:1434] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:10:12.988555 29905 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.989202 29864 tablet_bootstrap.cc:492] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:12.990419 29905 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:12.990196 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.991212 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:12.991768 29748 raft_consensus.cc:2393] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:12.991837 29674 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.992161 29904 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.992604 29865 tablet_bootstrap.cc:654] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:12.987372 29909 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.995410 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:12.992641 29904 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.996848 29789 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:12.997432 29904 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:12.997978 29904 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.998598 29955 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.998657 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:12.999163 29955 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:12.994589 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:12.999374 29748 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:13.005219 29787 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:13.006402 29909 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.006786 29909 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.006853 29955 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:13.007120 29909 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.008523 29674 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:13.010557 29715 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:13.010767 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:13.011379 29905 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.011868 29905 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:13.012615 29905 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.014043 29904 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.016121 29909 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.018448 29674 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.022183 29864 tablet_bootstrap.cc:654] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.024375 29909 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.025390 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:13.026022 29748 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.034886 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.037405 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:13.042409 29789 leader_election.cc:343] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.044706 29823 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:13.045331 29863 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:13.045830 29863 ts_tablet_manager.cc:1403] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.012s
I20260709 13:10:13.047451 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:13.047833 29638 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:13.052204 29748 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:13.052008 29863 raft_consensus.cc:359] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.052762 29863 raft_consensus.cc:385] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:13.053017 29789 leader_election.cc:343] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.054957 29871 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.053037 29863 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.056550 29863 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.050583 29865 tablet_bootstrap.cc:492] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:13.059059 29865 ts_tablet_manager.cc:1403] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.015s
I20260709 13:10:13.060511 29863 ts_tablet_manager.cc:1434] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:10:13.062268 29865 raft_consensus.cc:359] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.062824 29863 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:13.063912 29787 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.065040 29909 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.065536 29909 raft_consensus.cc:697] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:13.066368 29909 consensus_queue.cc:237] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.062952 29865 raft_consensus.cc:385] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.073179 29865 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.063743 29569 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.073858 29955 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.074782 29569 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.073855 29865 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.084966 29865 ts_tablet_manager.cc:1434] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:10:13.086143 29865 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:13.162663 29865 tablet_bootstrap.cc:654] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.207780 29864 tablet_bootstrap.cc:492] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:13.207986 29863 tablet_bootstrap.cc:654] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.208297 29864 ts_tablet_manager.cc:1403] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.219s	user 0.018s	sys 0.027s
W20260709 13:10:13.209862 30091 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.056s	user 0.003s	sys 0.006s
I20260709 13:10:13.214593 29904 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.215147 29904 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.217119 29904 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.218079 29926 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.223358 29904 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.224030 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.223878 29904 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:13.226856 29789 leader_election.cc:343] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.231149 29891 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.225960 29904 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.246978 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:13.247078 29864 raft_consensus.cc:359] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.247795 29864 raft_consensus.cc:385] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.248103 29864 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.249154 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.251006 29905 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.251480 29905 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.247730 29748 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:13.253371 29905 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:13.250775 29926 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.255188 29871 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.257643 29864 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.260763 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.264097 29891 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.264618 29891 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.260816 29672 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:13.266738 29891 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.269114 29863 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:13.269589 29863 ts_tablet_manager.cc:1403] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.207s	user 0.009s	sys 0.004s
I20260709 13:10:13.271064 30083 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.275281 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:13.275965 29822 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:13.279613 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:13.279950 29865 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:13.279210 29569 catalog_manager.cc:5697] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.280493 29865 ts_tablet_manager.cc:1403] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.195s	user 0.011s	sys 0.003s
I20260709 13:10:13.284571 29864 ts_tablet_manager.cc:1434] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:10:13.280494 29926 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.285645 29926 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.288661 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:13.288959 29864 tablet_bootstrap.cc:492] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:13.286026 29926 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:13.288666 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:13.291235 29746 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:13.305275 29863 raft_consensus.cc:359] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.305781 29863 raft_consensus.cc:385] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.306098 29863 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.306782 29863 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.307024 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:13.307658 29749 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:13.308360 29789 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:13.310140 29863 ts_tablet_manager.cc:1434] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:10:13.311682 29863 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
W20260709 13:10:13.304005 29715 leader_election.cc:343] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.296525 30083 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:10:13.313514 29907 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.315155 29907 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.311720 29904 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.317251 29904 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.317586 29907 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:13.317665 29904 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.319036 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:13.321250 29865 raft_consensus.cc:359] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.321748 29865 raft_consensus.cc:385] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.322001 29865 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.322806 29865 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.320371 29823 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:13.310135 29787 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.327466 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.330950 29949 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.331068 29673 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.331439 29949 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.331975 29865 ts_tablet_manager.cc:1434] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:10:13.332098 29949 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.336185 29926 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.339282 29926 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:13.339542 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:13.341403 29821 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.344255 29949 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.350858 29865 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:13.359073 29904 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.364181 29904 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:13.373291 29789 leader_election.cc:343] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.374116 29787 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.375245 29949 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.381229 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:13.393635 29863 tablet_bootstrap.cc:654] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.394078 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:13.396102 29864 tablet_bootstrap.cc:654] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.396719 30100 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.401546 29891 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.402127 29891 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.404599 29865 tablet_bootstrap.cc:654] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.397153 30100 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.406314 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:13.406919 29715 leader_election.cc:343] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.407255 29891 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.408900 29821 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:13.410101 29671 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.418191 29905 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.421420 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:13.422079 29672 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.415356 30100 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.431782 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:13.431888 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.433243 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:13.433845 29746 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.434343 29905 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.434793 29905 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:13.435484 29905 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.436869 29747 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.433104 30103 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:13.479487 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:13.483655 29865 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:13.484288 29865 ts_tablet_manager.cc:1403] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.134s	user 0.016s	sys 0.007s
I20260709 13:10:13.478801 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.485643 29746 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:13.493607 29905 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.490415 29747 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:13.501192 29864 tablet_bootstrap.cc:492] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:13.501727 29864 ts_tablet_manager.cc:1403] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.213s	user 0.013s	sys 0.007s
I20260709 13:10:13.504364 29864 raft_consensus.cc:359] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.505054 29864 raft_consensus.cc:385] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.505354 29864 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
W20260709 13:10:13.507375 29787 leader_election.cc:343] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.506569 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:13.508092 29787 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:13.508759 29672 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:13.516117 29864 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.526830 30007 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.527426 30007 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:13.528290 30007 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.529707 29905 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.530501 29787 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:13.531625 29904 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.532135 29904 raft_consensus.cc:697] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:13.533020 29904 consensus_queue.cc:237] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.542368 29865 raft_consensus.cc:359] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.545467 29864 ts_tablet_manager.cc:1434] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:10:13.545408 29907 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.550036 29863 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:13.550503 29863 ts_tablet_manager.cc:1403] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.239s	user 0.026s	sys 0.014s
I20260709 13:10:13.552305 29863 raft_consensus.cc:359] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.553336 29863 raft_consensus.cc:385] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.553723 29863 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.543933 30103 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:10:13.554598 29863 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.555912 29865 raft_consensus.cc:385] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.556262 29865 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.558666 30100 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.557847 29865 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.561794 29863 ts_tablet_manager.cc:1434] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:13.562791 29863 tablet_bootstrap.cc:492] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:13.565135 29864 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:13.572525 29865 ts_tablet_manager.cc:1434] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.088s	user 0.003s	sys 0.003s
I20260709 13:10:13.573573 29865 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
W20260709 13:10:13.576804 29789 leader_election.cc:343] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.582688 30100 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:13.586303 29789 consensus_peers.cc:597] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.584985 29569 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:13.590080 29789 leader_election.cc:343] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.590499 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.595041 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:13.600873 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:13.601565 29745 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.593665 30100 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:13.610715 29789 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:13.611294 29789 leader_election.cc:343] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.602093 29967 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:10:13.648780 29745 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:13.650564 29863 tablet_bootstrap.cc:654] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.651610 29571 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.653822 29787 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.654825 30103 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:13.655323 29571 catalog_manager.cc:5697] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.657341 30103 raft_consensus.cc:697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:13.658603 30103 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.665060 29864 tablet_bootstrap.cc:654] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.673975 30103 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.676249 29865 tablet_bootstrap.cc:654] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.718885 29571 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:13.730441 29865 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:13.730970 29865 ts_tablet_manager.cc:1403] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.158s	user 0.007s	sys 0.025s
I20260709 13:10:13.731906 29863 tablet_bootstrap.cc:492] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:13.732368 29863 ts_tablet_manager.cc:1403] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.170s	user 0.013s	sys 0.030s
I20260709 13:10:13.734781 29864 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:13.733568 29865 raft_consensus.cc:359] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.735689 29865 raft_consensus.cc:385] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.735994 29865 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.734846 29863 raft_consensus.cc:359] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.735316 29864 ts_tablet_manager.cc:1403] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.008s
I20260709 13:10:13.739912 29863 raft_consensus.cc:385] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.736584 29865 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.740267 29863 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.740918 29863 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.741961 29865 ts_tablet_manager.cc:1434] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:10:13.742134 29864 raft_consensus.cc:359] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.742619 29864 raft_consensus.cc:385] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.742789 29864 raft_consensus.cc:740] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.742897 29865 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:13.742991 29863 ts_tablet_manager.cc:1434] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:10:13.743305 29864 consensus_queue.cc:260] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.743835 29863 tablet_bootstrap.cc:492] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:13.744827 29864 ts_tablet_manager.cc:1434] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:10:13.745486 29864 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:13.751201 29863 tablet_bootstrap.cc:654] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.753412 29864 tablet_bootstrap.cc:654] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.758174 29865 tablet_bootstrap.cc:654] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.770501 29865 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:13.771063 29865 ts_tablet_manager.cc:1403] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.011s
I20260709 13:10:13.772725 29863 tablet_bootstrap.cc:492] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:13.773200 29863 ts_tablet_manager.cc:1403] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.011s
I20260709 13:10:13.773856 29865 raft_consensus.cc:359] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.779996 29865 raft_consensus.cc:385] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.780435 29865 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.781164 29865 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.783731 29865 ts_tablet_manager.cc:1434] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 13:10:13.784729 29865 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:13.788461 29863 raft_consensus.cc:359] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.789192 29863 raft_consensus.cc:385] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.789494 29863 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.790117 29863 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.791608 29865 tablet_bootstrap.cc:654] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.797132 29863 ts_tablet_manager.cc:1434] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:10:13.798074 29863 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:13.800105 29864 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:13.800665 29864 ts_tablet_manager.cc:1403] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.007s
I20260709 13:10:13.813863 29967 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.813903 29864 raft_consensus.cc:359] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.814756 29864 raft_consensus.cc:385] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.814555 29967 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.815018 29864 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.815690 29864 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.816608 29967 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:13.817260 29864 ts_tablet_manager.cc:1434] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.002s
I20260709 13:10:13.818248 29864 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:13.819237 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.819248 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:13.820760 29715 leader_election.cc:343] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:13.821273 29714 leader_election.cc:343] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.821673 29714 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.822340 29863 tablet_bootstrap.cc:654] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.822288 29967 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.824455 29865 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:13.825022 29865 ts_tablet_manager.cc:1403] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.004s
I20260709 13:10:13.827715 29865 raft_consensus.cc:359] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.828380 29864 tablet_bootstrap.cc:654] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.828457 29865 raft_consensus.cc:385] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.828910 29865 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.829648 29865 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.832073 29865 ts_tablet_manager.cc:1434] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:13.833068 29865 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:13.834662 29863 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:13.835121 29863 ts_tablet_manager.cc:1403] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:10:13.837699 29863 raft_consensus.cc:359] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.839145 29865 tablet_bootstrap.cc:654] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.839262 29863 raft_consensus.cc:385] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.841790 29863 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.842696 29863 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.843248 29864 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:13.843710 29864 ts_tablet_manager.cc:1403] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:10:13.845045 29863 ts_tablet_manager.cc:1434] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:13.846095 29864 raft_consensus.cc:359] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.846801 29864 raft_consensus.cc:385] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.847060 29864 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.847759 29864 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.854518 29864 ts_tablet_manager.cc:1434] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:13.849327 29863 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:13.851490 29673 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.852596 29865 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:13.857092 29865 ts_tablet_manager.cc:1403] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 13:10:13.860038 29864 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:13.859762 29865 raft_consensus.cc:359] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.860577 29865 raft_consensus.cc:385] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:13.860931 29865 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:13.862056 30100 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.861632 29865 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.862535 30100 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.864125 29865 ts_tablet_manager.cc:1434] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:13.864563 30100 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.865185 29865 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:13.867549 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.868531 29864 tablet_bootstrap.cc:654] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.868963 29863 tablet_bootstrap.cc:654] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:13.869230 29789 leader_election.cc:343] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.871505 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:13.872167 29746 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:13.875633 29865 tablet_bootstrap.cc:654] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:13.877724 29926 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.878223 29926 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.880641 29926 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:13.883072 29787 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.883592 29891 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.884063 29891 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.884371 30103 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.884826 30103 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.885226 30103 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.886210 29891 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.887522 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.888159 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:13.889657 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:13.890864 29715 leader_election.cc:343] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:13.891180 29789 leader_election.cc:343] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.894318 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:13.898425 29787 leader_election.cc:343] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.898891 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.900617 29891 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:13.904795 29714 leader_election.cc:343] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.907070 29714 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:13.907945 29967 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:13.923251 29670 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:13.925200 29904 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.933094 29967 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.939256 29891 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.939812 29891 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:13.940574 29967 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:13.943233 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:13.945086 29789 leader_election.cc:343] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:13.947088 29891 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:13.992314 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:14.007377 30102 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.010438 30083 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:14.011106 30083 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.018128 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:14.023020 30083 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.042366 29891 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.042973 29891 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.046098 29891 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:14.046708 30083 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.047254 30083 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.056584 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:14.058010 29639 leader_election.cc:343] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:14.058743 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 51849.9us
W20260709 13:10:14.059585 29787 leader_election.cc:343] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.061002 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:13.911089 30103 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.094055 30083 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.096736 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:14.099550 29672 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:14.102385 29789 leader_election.cc:343] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:14.119136 29789 leader_election.cc:343] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.059999 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.120868 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:14.122565 29891 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:14.122723 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 63176.8us
I20260709 13:10:14.132741 30103 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:14.134310 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:14.135076 29746 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
W20260709 13:10:14.136224 29789 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.137305 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:14.139081 29926 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.139660 29926 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.143479 29926 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.144153 30083 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.145370 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:14.147073 29715 leader_election.cc:343] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.151836 29967 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.152510 29967 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.155426 29967 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.163209 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:14.164402 29822 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:14.174693 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:14.175489 29747 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:14.181713 29714 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.183073 29967 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:14.183475 29967 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.183841 29967 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.186360 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:14.196591 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:14.198173 29715 leader_election.cc:343] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.199144 29926 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.199756 29926 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.202231 29926 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:14.241552 29714 leader_election.cc:343] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.242097 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.242909 29926 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.247331 29638 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:14.258502 29955 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:14.259011 29955 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.259370 29955 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:14.284284 29789 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.285307 29891 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:14.289180 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 55927.7us
I20260709 13:10:14.293329 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:14.294800 29715 leader_election.cc:343] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.298274 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:14.298996 29822 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:14.300657 29787 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.301645 30100 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:14.302088 30100 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.302450 30100 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.315179 29714 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.324400 29865 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:14.325124 29865 ts_tablet_manager.cc:1403] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.460s	user 0.213s	sys 0.198s
I20260709 13:10:14.325764 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:14.326350 29749 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.320024 29926 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:14.328912 29926 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.334969 29926 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.342430 29955 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.345124 29955 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.350200 29864 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:14.350654 29864 ts_tablet_manager.cc:1403] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.491s	user 0.114s	sys 0.189s
I20260709 13:10:14.352941 29749 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:14.369146 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:14.369741 29749 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.378747 29864 raft_consensus.cc:359] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.379484 29864 raft_consensus.cc:385] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.379748 29864 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.381954 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:14.383778 29639 leader_election.cc:343] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.383502 29926 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.368747 29967 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.385671 29926 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.389616 30100 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.380383 29864 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.391348 29864 ts_tablet_manager.cc:1434] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.002s
I20260709 13:10:14.391603 30100 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:14.392231 29864 tablet_bootstrap.cc:492] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:14.393172 29863 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:14.393636 29863 ts_tablet_manager.cc:1403] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.545s	user 0.132s	sys 0.242s
I20260709 13:10:14.397020 29749 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:14.403288 29864 tablet_bootstrap.cc:654] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.403846 29638 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:14.408409 29967 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.412122 29863 raft_consensus.cc:359] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.412827 29863 raft_consensus.cc:385] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.413077 29863 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.413656 29863 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.405864 30144 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:14.426378 30144 raft_consensus.cc:697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:10:14.430765 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 50974.5us
I20260709 13:10:14.431489 29863 ts_tablet_manager.cc:1434] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:10:14.432505 29863 tablet_bootstrap.cc:492] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:14.435370 29787 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.437453 29904 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.438532 30143 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:14.446924 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:14.449335 30144 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.452119 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:14.452765 29821 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.457399 29865 raft_consensus.cc:359] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.458120 29865 raft_consensus.cc:385] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.458393 29865 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.458871 30143 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:14.459756 30143 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.463611 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:14.463855 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:14.464402 29823 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:14.464561 29746 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:14.466168 29821 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:14.474001 29865 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.479652 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:14.484222 29865 ts_tablet_manager.cc:1434] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.000s
I20260709 13:10:14.487900 29865 tablet_bootstrap.cc:492] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
W20260709 13:10:14.489051 29789 leader_election.cc:343] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.489499 29789 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.532351 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:14.534861 29864 tablet_bootstrap.cc:492] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:14.535365 29864 ts_tablet_manager.cc:1403] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.143s	user 0.017s	sys 0.015s
I20260709 13:10:14.541289 29864 raft_consensus.cc:359] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.542241 29864 raft_consensus.cc:385] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.542528 29864 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.543249 29864 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.531764 30150 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.550407 29864 ts_tablet_manager.cc:1434] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 13:10:14.562193 29864 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:14.571903 29865 tablet_bootstrap.cc:654] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.582319 29570 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.587569 29863 tablet_bootstrap.cc:654] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.591464 29571 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:14.596920 29715 leader_election.cc:343] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.608019 29714 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.608767 29967 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:14.609694 29967 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:10:14.606513 29715 leader_election.cc:343] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.610522 29967 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.613329 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.615686 30149 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.621002 29865 tablet_bootstrap.cc:492] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:14.621366 29864 tablet_bootstrap.cc:654] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.621505 29865 ts_tablet_manager.cc:1403] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.134s	user 0.012s	sys 0.004s
W20260709 13:10:14.621014 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:14.626987 29863 tablet_bootstrap.cc:492] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:14.630435 29863 ts_tablet_manager.cc:1403] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.198s	user 0.014s	sys 0.002s
I20260709 13:10:14.630954 29865 raft_consensus.cc:359] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.635527 29865 raft_consensus.cc:385] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.635843 29865 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.638206 29863 raft_consensus.cc:359] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.638825 29863 raft_consensus.cc:385] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.639042 29863 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.639694 29863 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.641541 29863 ts_tablet_manager.cc:1434] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:10:14.642560 29863 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:14.636451 29865 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.645098 29865 ts_tablet_manager.cc:1434] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:10:14.645996 29865 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:14.651026 29864 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:14.651440 29864 ts_tablet_manager.cc:1403] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260709 13:10:14.654201 29864 raft_consensus.cc:359] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.655036 29864 raft_consensus.cc:385] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.655313 29864 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.655984 29864 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.658665 29569 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.667589 29864 ts_tablet_manager.cc:1434] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:10:14.668969 29864 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:14.676827 29865 tablet_bootstrap.cc:654] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.671195 29863 tablet_bootstrap.cc:654] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.696902 29865 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:14.697445 29865 ts_tablet_manager.cc:1403] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.003s
I20260709 13:10:14.699587 29864 tablet_bootstrap.cc:654] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.701429 29672 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.709775 29670 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.725581 29863 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:14.726203 29863 ts_tablet_manager.cc:1403] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.010s
I20260709 13:10:14.726583 29865 raft_consensus.cc:359] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.727357 29865 raft_consensus.cc:385] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.727628 29865 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.730867 29863 raft_consensus.cc:359] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.731549 29863 raft_consensus.cc:385] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.729245 29865 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.731796 29863 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.746500 29863 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.749280 29865 ts_tablet_manager.cc:1434] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:10:14.750248 29865 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:14.750452 29864 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:14.750870 29864 ts_tablet_manager.cc:1403] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.009s
I20260709 13:10:14.761143 29863 ts_tablet_manager.cc:1434] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.006s
I20260709 13:10:14.765031 29864 raft_consensus.cc:359] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.765439 29863 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:14.765764 29864 raft_consensus.cc:385] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.766093 29864 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.766705 29864 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.770752 29864 ts_tablet_manager.cc:1434] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:10:14.771662 29864 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:14.779685 29865 tablet_bootstrap.cc:654] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.780082 30102 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.781167 29863 tablet_bootstrap.cc:654] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.781334 30102 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.783406 30102 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:14.784833 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:14.785784 29745 raft_consensus.cc:2393] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:14.784837 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:14.788196 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.789021 30102 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.798092 30102 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.802510 29864 tablet_bootstrap.cc:654] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.811034 29865 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:14.811510 29865 ts_tablet_manager.cc:1403] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 13:10:14.814137 29865 raft_consensus.cc:359] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.814800 29865 raft_consensus.cc:385] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.815564 29865 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.816654 29865 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.822489 29864 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:14.823062 29864 ts_tablet_manager.cc:1403] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 13:10:14.825659 29864 raft_consensus.cc:359] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.826542 29864 raft_consensus.cc:385] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.826876 29864 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.827545 29864 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.828112 29865 ts_tablet_manager.cc:1434] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:10:14.829092 29865 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:14.829758 29864 ts_tablet_manager.cc:1434] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:10:14.834638 29865 tablet_bootstrap.cc:654] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.835767 29863 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:14.836256 29863 ts_tablet_manager.cc:1403] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.013s
I20260709 13:10:14.839044 29863 raft_consensus.cc:359] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.839773 29863 raft_consensus.cc:385] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.840032 29863 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.841387 29864 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:14.845628 29865 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:14.846144 29865 ts_tablet_manager.cc:1403] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:10:14.847522 29864 tablet_bootstrap.cc:654] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.851071 29863 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.853188 29863 ts_tablet_manager.cc:1434] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:10:14.855602 29863 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:14.848616 29865 raft_consensus.cc:359] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.857468 29865 raft_consensus.cc:385] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.857776 29865 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.858711 29865 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.861485 29863 tablet_bootstrap.cc:654] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.864989 29865 ts_tablet_manager.cc:1434] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:14.866106 29865 tablet_bootstrap.cc:492] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:14.874087 29967 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.874677 30150 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.874620 29967 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.875175 30150 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.877249 30150 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:14.879810 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:14.880004 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:14.881410 29787 leader_election.cc:343] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:14.882068 29714 leader_election.cc:343] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.882884 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:14.884150 29967 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.881335 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:14.885947 29715 leader_election.cc:343] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.886461 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.887458 29967 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:14.889804 29789 leader_election.cc:343] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.890311 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.891304 30102 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.884095 29905 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.893139 29905 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.895167 29905 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.896934 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:14.898447 29715 leader_election.cc:343] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.897260 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:14.903257 30145 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:14.904548 29714 leader_election.cc:343] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.905076 29714 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:14.906291 29905 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.918857 29864 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:14.919450 29864 ts_tablet_manager.cc:1403] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.002s
I20260709 13:10:14.922012 29864 raft_consensus.cc:359] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.922722 29864 raft_consensus.cc:385] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.925274 29864 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.925961 29864 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.928334 29864 ts_tablet_manager.cc:1434] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:14.929584 29864 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:14.925769 29865 tablet_bootstrap.cc:654] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.938623 29863 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:14.939112 29863 ts_tablet_manager.cc:1403] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.018s
I20260709 13:10:14.941895 29863 raft_consensus.cc:359] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.942572 29863 raft_consensus.cc:385] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.942826 29863 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.947695 30146 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.951234 29863 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.956903 29864 tablet_bootstrap.cc:654] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.960891 29863 ts_tablet_manager.cc:1434] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 13:10:14.961876 29863 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:14.966995 30145 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.978626 29672 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.980096 29905 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.980638 29905 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.985327 29905 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.987476 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:14.988145 29821 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:14.989492 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:14.989732 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:14.990998 29905 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:14.991385 29905 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:14.991490 29715 leader_election.cc:343] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:14.991787 29905 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.973541 30145 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.993342 30102 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.994264 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:14.995608 30145 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:14.998517 29905 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:14.999315 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.000093 29821 raft_consensus.cc:2393] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:15.001202 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:15.002189 30144 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.001199 29905 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.004943 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:15.005533 29821 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.018219 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:15.020763 30144 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:15.034003 29715 leader_election.cc:343] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.034005 30150 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.039497 30150 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.042615 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:15.043269 29674 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:15.043395 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.044831 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:15.045589 30102 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.045984 30102 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.042740 30150 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:15.046401 29787 leader_election.cc:343] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.046439 30102 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.047998 29863 tablet_bootstrap.cc:654] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.049057 29865 tablet_bootstrap.cc:492] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:15.049460 29865 ts_tablet_manager.cc:1403] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.184s	user 0.022s	sys 0.014s
I20260709 13:10:15.052729 29865 raft_consensus.cc:359] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.053414 29865 raft_consensus.cc:385] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.053694 29865 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.054591 29865 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.067287 29905 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.067739 29905 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.073032 29905 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.073362 29865 ts_tablet_manager.cc:1434] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:10:15.074234 29865 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:15.070444 29821 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:15.073017 30102 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.075738 29864 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:15.080749 29864 ts_tablet_manager.cc:1403] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.006s
I20260709 13:10:15.080698 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:15.077418 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.078289 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:15.083144 29714 leader_election.cc:343] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.083763 30149 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.083738 29864 raft_consensus.cc:359] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.084378 30149 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:15.084554 29864 raft_consensus.cc:385] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.084828 29864 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.085211 30149 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.085412 29864 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.089231 29864 ts_tablet_manager.cc:1434] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:10:15.090984 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:15.090333 30102 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:15.091323 29864 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:15.095619 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:15.091529 29674 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:15.091676 29715 leader_election.cc:343] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.106454 29715 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:15.107887 29870 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.111917 29865 tablet_bootstrap.cc:654] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.118042 29864 tablet_bootstrap.cc:654] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.127345 29863 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:15.127854 29863 ts_tablet_manager.cc:1403] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.015s
I20260709 13:10:15.128499 29674 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:15.129670 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:15.130393 29863 raft_consensus.cc:359] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.131923 30155 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.132371 29863 raft_consensus.cc:385] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.132712 29863 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
W20260709 13:10:15.132929 29787 leader_election.cc:343] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.133320 29863 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.130439 30102 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.136866 29863 ts_tablet_manager.cc:1434] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:15.137756 29863 tablet_bootstrap.cc:492] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:15.144528 30102 raft_consensus.cc:697] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:15.145591 30102 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.144553 29863 tablet_bootstrap.cc:654] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.161339 29570 catalog_manager.cc:5697] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.168310 29863 tablet_bootstrap.cc:492] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:15.168815 29863 ts_tablet_manager.cc:1403] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 13:10:15.171530 29863 raft_consensus.cc:359] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.172202 29863 raft_consensus.cc:385] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.172474 29863 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.173273 29863 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.180603 30143 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.181388 29865 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:15.181072 30143 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.181878 29865 ts_tablet_manager.cc:1403] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.000s
I20260709 13:10:15.183732 30144 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.183902 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:15.184175 30144 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.184190 30143 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:15.184880 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.185302 29863 ts_tablet_manager.cc:1434] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
W20260709 13:10:15.185407 29789 leader_election.cc:343] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.186290 30144 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:15.186862 29787 leader_election.cc:343] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.187333 29787 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:15.187916 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.188643 29821 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:15.189196 30155 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.188921 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.190268 29639 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:15.191270 30144 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:15.191561 29638 leader_election.cc:343] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.192750 29863 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:15.191570 29865 raft_consensus.cc:359] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.193905 29864 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:15.194166 29865 raft_consensus.cc:385] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.194440 29865 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.195601 29864 ts_tablet_manager.cc:1403] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.104s	user 0.021s	sys 0.024s
I20260709 13:10:15.195050 29865 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.191645 30144 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.196810 30144 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.204586 29905 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.205178 29905 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.208927 29865 ts_tablet_manager.cc:1434] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:10:15.209950 29865 tablet_bootstrap.cc:492] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:15.211272 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:15.211575 29864 raft_consensus.cc:359] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.212272 29864 raft_consensus.cc:385] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.212419 29905 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.213151 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.213763 29821 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:15.214915 29714 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:15.215817 29863 tablet_bootstrap.cc:654] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.216730 29864 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.216382 30149 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.217447 30102 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.217770 30149 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.218205 30149 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.218135 30102 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:15.218158 29715 leader_election.cc:343] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.221861 29905 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.221298 29864 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.225792 29864 ts_tablet_manager.cc:1434] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:10:15.226030 30102 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:15.229092 30149 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.233861 30144 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.236471 30144 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.237555 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:15.238279 29823 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.240540 30149 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.239738 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:15.241592 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:15.242061 29748 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.242331 29822 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.243105 29865 tablet_bootstrap.cc:654] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.244534 29571 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.244508 29823 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:15.248636 29864 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:15.249861 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:15.250806 29822 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:15.253782 29714 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:15.254571 30149 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.254974 29870 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.255443 29870 raft_consensus.cc:697] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:15.256187 29870 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.256671 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.258795 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:15.260193 29789 leader_election.cc:343] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.261044 29639 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:15.267278 29748 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
W20260709 13:10:15.272087 29715 leader_election.cc:343] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.273902 30144 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.274463 30144 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:15.275260 30144 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.290726 30102 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.291358 30102 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:15.298272 30187 log.cc:927] Time spent T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:10:15.307369 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:15.308686 29789 leader_election.cc:343] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.306696 30102 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:15.449512 29863 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:15.451201 29863 ts_tablet_manager.cc:1403] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.259s	user 0.040s	sys 0.050s
I20260709 13:10:15.460561 29864 tablet_bootstrap.cc:700] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Time spent opening tablet: real 0.103s	user 0.009s	sys 0.000s
I20260709 13:10:15.465328 29864 tablet_bootstrap.cc:654] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.471794 30145 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.475627 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:15.477543 30102 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.479516 30145 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.505571 29865 tablet_bootstrap.cc:492] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:15.513275 29865 ts_tablet_manager.cc:1403] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.304s	user 0.012s	sys 0.012s
I20260709 13:10:15.518337 29865 raft_consensus.cc:359] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.519223 29865 raft_consensus.cc:385] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.519582 29865 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.520347 29865 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.528832 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.530254 29745 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:15.539216 29863 raft_consensus.cc:359] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.540150 29863 raft_consensus.cc:385] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.541270 29905 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.541781 29905 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.544278 29905 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.549342 30149 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.550284 30149 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.551528 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:15.553583 29715 leader_election.cc:343] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.553853 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:15.540472 29863 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.555989 29863 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.557797 29863 ts_tablet_manager.cc:1434] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.005s
I20260709 13:10:15.559408 29863 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:15.559688 30145 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.563133 29905 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:15.563311 29715 leader_election.cc:343] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.563824 29905 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.557726 30149 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.580556 29905 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.581799 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:15.582639 29670 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:15.584836 29571 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:15.587110 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 263943us
I20260709 13:10:15.591136 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.633315 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.639513 29822 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:15.638329 29864 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:15.646095 29639 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:15.647173 30195 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.647615 30195 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.648001 30195 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.573954 30145 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.654500 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.655357 29819 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:15.604468 29715 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:15.658397 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.659178 29820 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:15.666373 30189 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:15.669396 29865 ts_tablet_manager.cc:1434] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.156s	user 0.013s	sys 0.001s
W20260709 13:10:15.671097 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 72473.3us
W20260709 13:10:15.671952 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.645407 29745 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:15.675117 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.684504 29822 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:15.688342 30201 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.689137 29714 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:15.691649 30145 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.693888 30145 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.697259 29864 ts_tablet_manager.cc:1403] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.449s	user 0.028s	sys 0.009s
I20260709 13:10:15.699234 29967 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.699643 29967 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.699995 29967 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.701227 29864 raft_consensus.cc:359] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.702457 29864 raft_consensus.cc:385] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.702739 29864 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.714494 29863 tablet_bootstrap.cc:654] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.715762 30201 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.716647 30201 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.719681 29569 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:15.728411 29715 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.727233 29864 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.734189 29865 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:15.742547 29714 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:15.746237 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.745297 30189 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:15.747865 29639 leader_election.cc:343] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.748204 30189 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.748623 30189 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.774652 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.775429 29864 ts_tablet_manager.cc:1434] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 13:10:15.775332 29745 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 0.
I20260709 13:10:15.751772 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:15.744724 29967 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.796886 30201 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.777791 30203 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.798298 29967 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.798715 30203 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.799134 30203 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.822075 30195 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.798223 30144 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.837280 30144 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.876753 30201 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.781002 30189 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.898945 30144 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.900077 30195 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:15.912324 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 167417us
I20260709 13:10:15.916668 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:15.917622 29821 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:15.922951 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:15.923247 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:15.923507 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:15.923874 29819 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.924074 29823 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:15.924624 29715 leader_election.cc:343] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.931118 29823 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:15.940172 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:15.940963 29749 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:15.942094 30189 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:15.946424 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:15.947326 29745 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:15.956888 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:15.942816 30203 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.959889 29714 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:15.961093 29905 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.961567 29905 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:15.962419 29905 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:15.963857 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:15.964717 29818 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:15.966795 30196 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:15.955533 29819 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:15.976413 29865 tablet_bootstrap.cc:654] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.978618 30204 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:15.981199 29863 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:15.982302 29863 ts_tablet_manager.cc:1403] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.423s	user 0.009s	sys 0.012s
I20260709 13:10:15.982445 29714 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:15.983021 29715 leader_election.cc:343] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.987818 29864 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:15.989624 30189 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.988679 29967 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:10:15.999219 30189 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:16.000154 30189 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.000890 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:16.004550 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:16.005163 29819 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.002660 30203 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:16.001865 29668 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 1: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:16.058350 29638 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:10:16.062580 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 99054.5us
I20260709 13:10:16.064276 30145 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.064718 30145 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.065060 30145 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.066431 29638 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:16.068578 29638 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:16.069888 30204 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:10:16.071754 29787 consensus_peers.cc:597] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.073659 30200 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:16.078866 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:16.070860 30144 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:10:16.088002 29864 tablet_bootstrap.cc:654] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.105964 30145 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.114817 30145 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.117537 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:16.119496 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:16.122370 29639 leader_election.cc:343] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.126583 29819 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:16.131989 29863 raft_consensus.cc:359] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.132656 29863 raft_consensus.cc:385] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.132875 29863 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.133116 30200 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.133483 29863 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:16.136489 29789 leader_election.cc:343] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.137804 29714 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.139657 30202 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.140141 30202 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:16.140609 29863 ts_tablet_manager.cc:1434] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.158s	user 0.003s	sys 0.004s
I20260709 13:10:16.147825 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:16.148435 29745 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.155455 29863 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:16.159006 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:16.159649 29748 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.140944 30202 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.137475 29570 catalog_manager.cc:5697] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.173242 29748 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:16.168654 29570 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.161671 29745 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:16.182559 29865 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:16.195175 29865 ts_tablet_manager.cc:1403] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.461s	user 0.036s	sys 0.058s
I20260709 13:10:16.207275 29865 raft_consensus.cc:359] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.207995 29865 raft_consensus.cc:385] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.208738 29865 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.233311 29865 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.235560 29865 ts_tablet_manager.cc:1434] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.040s	user 0.013s	sys 0.006s
I20260709 13:10:16.236601 29865 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:16.239660 29864 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:16.240085 29864 ts_tablet_manager.cc:1403] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.266s	user 0.030s	sys 0.012s
I20260709 13:10:16.244784 29863 tablet_bootstrap.cc:654] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.264209 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.266283 30198 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.266796 30198 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:16.267638 30198 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.280824 29638 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:16.283236 30214 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.284839 30214 raft_consensus.cc:697] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:16.289482 29864 raft_consensus.cc:359] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.290135 29864 raft_consensus.cc:385] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.290418 29864 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.285826 30214 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.296085 29744 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.290311 30149 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.298069 29864 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.297983 30149 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.300441 29864 ts_tablet_manager.cc:1434] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:10:16.301479 29864 tablet_bootstrap.cc:492] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:16.302253 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:16.302804 29823 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:16.303608 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:16.304198 29714 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:16.304241 29670 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:16.303037 30149 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.311230 29570 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.311147 30217 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:16.313268 30217 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.313633 30217 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.355181 29865 tablet_bootstrap.cc:654] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.359489 29863 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:16.360181 29863 ts_tablet_manager.cc:1403] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.219s	user 0.019s	sys 0.017s
I20260709 13:10:16.361753 29569 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.367172 30149 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:16.364629 30202 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:16.367813 30149 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.360770 29570 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.371471 30149 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.372817 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:16.378647 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:16.380394 29715 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.380853 29864 tablet_bootstrap.cc:654] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.382243 30189 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:16.362824 30217 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.402058 30149 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:10:16.403508 29863 raft_consensus.cc:359] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.404212 29863 raft_consensus.cc:385] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.404479 29863 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.409158 30217 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.419129 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:16.419891 29670 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.411932 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:16.438278 29863 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.440555 29863 ts_tablet_manager.cc:1434] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:10:16.441555 29863 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:16.426960 29816 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.458151 30198 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.458644 30198 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.459961 29670 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:16.460764 30198 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:16.461961 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:16.464323 29865 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:16.464805 29865 ts_tablet_manager.cc:1403] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.228s	user 0.015s	sys 0.000s
W20260709 13:10:16.465251 29789 leader_election.cc:343] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.464650 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:16.469069 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:16.469805 29744 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:16.470911 29787 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.471415 30217 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.471493 29816 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:16.471939 30217 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:16.481380 30217 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.472308 30198 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.484994 30198 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.485329 30198 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.492709 30198 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.473067 29864 tablet_bootstrap.cc:492] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:16.496934 29864 ts_tablet_manager.cc:1403] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.196s	user 0.022s	sys 0.010s
I20260709 13:10:16.499799 29864 raft_consensus.cc:359] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.500496 29864 raft_consensus.cc:385] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.500767 29864 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.474916 29865 raft_consensus.cc:359] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.502667 29865 raft_consensus.cc:385] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.502929 29865 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.503556 29865 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.474027 29863 tablet_bootstrap.cc:654] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.510604 29865 ts_tablet_manager.cc:1434] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:10:16.511852 29865 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:16.516124 30198 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:16.516137 30200 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.516881 30200 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.517601 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:16.518191 29744 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.501395 29864 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.522117 30200 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.559587 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:16.576822 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:16.579205 29746 raft_consensus.cc:2393] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:16.579241 30146 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.581359 29864 ts_tablet_manager.cc:1434] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 13:10:16.580190 30146 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.561036 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:16.592113 29967 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.592417 29863 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:16.592934 29863 ts_tablet_manager.cc:1403] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.152s	user 0.024s	sys 0.005s
I20260709 13:10:16.595844 29864 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:16.593503 30146 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.604857 29863 raft_consensus.cc:359] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.605728 29863 raft_consensus.cc:385] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.606104 29863 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.612330 29863 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.613875 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:16.614545 29863 ts_tablet_manager.cc:1434] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:10:16.617849 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:16.620126 30102 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.632872 30102 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.633599 30146 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.622874 29891 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.634394 29891 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.636216 29891 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:16.623304 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:16.625335 29863 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:16.639328 29638 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:16.641417 30195 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.627391 29865 tablet_bootstrap.cc:654] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:16.631011 29789 leader_election.cc:343] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.618494 29569 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.646462 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:16.611594 29744 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:16.662683 30102 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:16.663740 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:16.674165 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:16.672408 29789 leader_election.cc:343] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:16.675658 29787 leader_election.cc:343] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.676642 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.679147 29891 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.680598 29787 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.681367 30102 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.681852 30102 raft_consensus.cc:697] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:16.682905 29667 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.682716 30102 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:16.721135 29639 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.733323 30146 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:16.737890 29787 leader_election.cc:343] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.738505 29864 tablet_bootstrap.cc:654] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:16.735819 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 63443us
I20260709 13:10:16.751775 30217 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:16.761021 29715 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.764734 30217 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.765244 30217 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.767571 30217 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.768283 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:16.768833 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:16.770448 29715 leader_election.cc:343] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.772629 29865 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:16.773698 29865 ts_tablet_manager.cc:1403] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.262s	user 0.029s	sys 0.012s
I20260709 13:10:16.775064 29863 tablet_bootstrap.cc:654] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.775228 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:16.776060 29865 raft_consensus.cc:359] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.776561 29865 raft_consensus.cc:385] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.776819 29865 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
W20260709 13:10:16.776968 29789 leader_election.cc:343] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.777454 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.777469 29865 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.780025 29865 ts_tablet_manager.cc:1434] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:10:16.781093 29865 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:16.787691 29865 tablet_bootstrap.cc:654] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.789911 29864 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:16.790449 29864 ts_tablet_manager.cc:1403] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.003s
I20260709 13:10:16.792757 29865 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:16.793167 29865 ts_tablet_manager.cc:1403] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:16.792954 29864 raft_consensus.cc:359] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.793651 29864 raft_consensus.cc:385] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.793438 29569 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.796108 29863 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:16.795768 29865 raft_consensus.cc:359] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.796509 29865 raft_consensus.cc:385] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.796593 29863 ts_tablet_manager.cc:1403] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.171s	user 0.009s	sys 0.003s
I20260709 13:10:16.796804 29865 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.797605 29865 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.798197 30102 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.799130 29863 raft_consensus.cc:359] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.799810 29863 raft_consensus.cc:385] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.800062 29863 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.800516 29865 ts_tablet_manager.cc:1434] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:10:16.801666 29865 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:16.800690 29863 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:16.806205 29714 leader_election.cc:343] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.806659 29714 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.807343 30202 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.809561 29865 tablet_bootstrap.cc:654] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.811822 29863 ts_tablet_manager.cc:1434] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:16.793911 29864 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.813550 29863 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:16.813657 29864 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.815914 30202 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.819828 30143 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.823908 30197 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.828430 29864 ts_tablet_manager.cc:1434] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:10:16.829692 29864 tablet_bootstrap.cc:492] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:16.839232 30197 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.840880 30197 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.843513 30197 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:16.845569 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:16.849538 29863 tablet_bootstrap.cc:654] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.855805 29864 tablet_bootstrap.cc:654] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.859330 29865 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:16.859949 29865 ts_tablet_manager.cc:1403] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.011s
I20260709 13:10:16.861263 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:16.864712 29865 raft_consensus.cc:359] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.865456 29865 raft_consensus.cc:385] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.865731 29865 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.867354 29787 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.868445 30197 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.868772 29865 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.871089 29865 ts_tablet_manager.cc:1434] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:16.870995 30214 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.872130 29865 tablet_bootstrap.cc:492] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:16.875223 29864 tablet_bootstrap.cc:492] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:16.875741 29864 ts_tablet_manager.cc:1403] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.005s
I20260709 13:10:16.882192 29865 tablet_bootstrap.cc:654] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.884487 29864 raft_consensus.cc:359] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.885135 29864 raft_consensus.cc:385] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.885408 29864 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.888553 29863 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:16.889055 29863 ts_tablet_manager.cc:1403] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.003s
I20260709 13:10:16.887192 29864 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.893340 29863 raft_consensus.cc:359] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.894130 29863 raft_consensus.cc:385] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.894318 29863 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.895352 29863 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.906869 29864 ts_tablet_manager.cc:1434] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:10:16.907994 29864 tablet_bootstrap.cc:492] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:16.912875 30202 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.913417 30202 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.923805 29864 tablet_bootstrap.cc:654] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.926844 29863 ts_tablet_manager.cc:1434] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:10:16.928478 29863 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:16.938834 30202 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:16.942843 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:16.944835 29715 leader_election.cc:343] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.947031 29823 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:16.948514 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:16.951200 30217 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:16.955282 29714 leader_election.cc:343] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.955677 29714 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:16.956665 30217 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.960410 29865 tablet_bootstrap.cc:492] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:16.960906 29865 ts_tablet_manager.cc:1403] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.033s
I20260709 13:10:16.967041 29865 raft_consensus.cc:359] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.970095 29865 raft_consensus.cc:385] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.970419 29865 raft_consensus.cc:740] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.971097 29865 consensus_queue.cc:260] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:16.972874 29863 tablet_bootstrap.cc:654] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.973264 29865 ts_tablet_manager.cc:1434] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:10:16.974480 29865 tablet_bootstrap.cc:492] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:16.981878 29864 tablet_bootstrap.cc:492] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:16.983738 29864 ts_tablet_manager.cc:1403] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.005s
I20260709 13:10:16.996798 29669 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:16.999269 29870 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:17.026147 29864 raft_consensus.cc:359] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.026859 29864 raft_consensus.cc:385] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.027130 29864 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.027731 29864 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.030025 29863 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:17.030508 29863 ts_tablet_manager.cc:1403] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.102s	user 0.011s	sys 0.025s
I20260709 13:10:17.030876 29865 tablet_bootstrap.cc:654] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.033109 29863 raft_consensus.cc:359] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.033661 29863 raft_consensus.cc:385] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.033866 29863 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.042117 29864 ts_tablet_manager.cc:1434] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.001s
I20260709 13:10:17.042515 29863 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.043305 29864 tablet_bootstrap.cc:492] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.049319 29863 ts_tablet_manager.cc:1434] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:10:17.057761 29864 tablet_bootstrap.cc:654] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.059290 29863 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:17.065126 30197 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.065660 30197 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.068442 30197 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:17.071346 29865 tablet_bootstrap.cc:492] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
I20260709 13:10:17.071187 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.071810 29865 ts_tablet_manager.cc:1403] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.003s
I20260709 13:10:17.074951 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.075661 29870 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.076996 29870 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.071858 29744 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:17.078856 29870 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.080375 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.080991 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:17.081701 29715 leader_election.cc:343] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.082648 29787 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:17.083396 30102 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.083741 30102 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.084086 30102 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:17.084971 29789 leader_election.cc:343] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.082787 29865 raft_consensus.cc:359] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.081653 29819 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:17.091806 29865 raft_consensus.cc:385] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.092115 29865 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.092622 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:17.092759 29865 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.095271 30237 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.095654 30237 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.095979 30237 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.100771 29863 tablet_bootstrap.cc:654] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.096130 30102 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.103185 30237 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.146435 29865 ts_tablet_manager.cc:1434] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.002s
I20260709 13:10:17.148631 30102 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:17.152842 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:17.153492 29744 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.153654 30195 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.154443 30195 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.156457 30195 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.157466 29865 tablet_bootstrap.cc:492] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: Bootstrap starting.
I20260709 13:10:17.162774 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.163380 30237 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.164554 29865 tablet_bootstrap.cc:654] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.166883 29744 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:17.171489 29870 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.185549 29870 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.186219 29787 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:17.186913 30143 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.187364 29870 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.171773 30235 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.176123 29865 tablet_bootstrap.cc:492] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: No bootstrap required, opened a new log
W20260709 13:10:17.176748 29620 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:17.188254 29865 ts_tablet_manager.cc:1403] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.002s
I20260709 13:10:17.188033 30235 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.189646 29863 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:17.189930 30235 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.190125 29863 ts_tablet_manager.cc:1403] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.131s	user 0.012s	sys 0.007s
I20260709 13:10:17.176581 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:17.177518 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 72549.2us
I20260709 13:10:17.187366 30143 raft_consensus.cc:697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:17.179726 29864 tablet_bootstrap.cc:492] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.182914 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.183486 29669 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.182792 29967 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.193773 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.192191 30143 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.194207 29967 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.193068 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.193730 29864 ts_tablet_manager.cc:1403] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.151s	user 0.026s	sys 0.012s
I20260709 13:10:17.198025 29863 raft_consensus.cc:359] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.203413 29863 raft_consensus.cc:385] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.200730 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:17.203691 29863 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.204118 29819 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.204401 29863 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.205559 29967 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.205708 29864 raft_consensus.cc:359] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.193315 29865 raft_consensus.cc:359] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.206503 29864 raft_consensus.cc:385] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.206557 29865 raft_consensus.cc:385] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.206928 29865 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.207520 29865 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.207975 29863 ts_tablet_manager.cc:1434] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:17.208964 29865 ts_tablet_manager.cc:1434] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:10:17.206842 29864 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
W20260709 13:10:17.202795 29714 leader_election.cc:343] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.210018 29863 tablet_bootstrap.cc:492] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:17.209757 29864 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:17.211629 29714 leader_election.cc:343] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.212294 29864 ts_tablet_manager.cc:1434] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:17.213325 29864 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.214852 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.215485 29823 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:17.226624 30102 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:17.243294 29864 tablet_bootstrap.cc:654] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.244182 30102 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.244705 30102 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.246435 29863 tablet_bootstrap.cc:654] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.246697 30102 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:17.247123 30200 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.247637 30200 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.249644 30200 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.251438 29714 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:17.252847 29870 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.253295 29870 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.253664 29870 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.258544 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.259415 29745 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:17.264629 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.266353 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.266709 29863 tablet_bootstrap.cc:492] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:17.267186 29863 ts_tablet_manager.cc:1403] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.005s
I20260709 13:10:17.269117 29870 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:17.270725 29715 leader_election.cc:343] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.271229 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:17.270206 29863 raft_consensus.cc:359] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.291544 30197 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.291791 29863 raft_consensus.cc:385] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.291996 30197 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.292150 29863 raft_consensus.cc:740] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.292414 30197 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.292845 29863 consensus_queue.cc:260] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.295400 29863 ts_tablet_manager.cc:1434] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:10:17.296439 29863 tablet_bootstrap.cc:492] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: Bootstrap starting.
I20260709 13:10:17.303996 29863 tablet_bootstrap.cc:654] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.303984 30197 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.305785 29870 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.272295 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:17.274520 29817 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.277828 29819 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:17.278942 29864 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.280800 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.282280 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.305312 29570 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.310549 29864 ts_tablet_manager.cc:1403] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.003s
I20260709 13:10:17.320130 30146 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.321133 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:17.322853 29789 leader_election.cc:343] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.322141 29864 raft_consensus.cc:359] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.323308 29864 raft_consensus.cc:385] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.323586 29864 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
W20260709 13:10:17.323750 29789 leader_election.cc:343] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:17.325088 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 52875us
I20260709 13:10:17.326438 29670 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.330739 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.337977 29864 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.340420 29864 ts_tablet_manager.cc:1434] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:10:17.341428 29864 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.343032 30143 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.343529 30143 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.346665 30143 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:17.354943 29789 leader_election.cc:343] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.356212 30197 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:17.358453 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.359136 29670 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:17.359628 29864 tablet_bootstrap.cc:654] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.360939 29666 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.367210 29864 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.367704 29864 ts_tablet_manager.cc:1403] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.006s
I20260709 13:10:17.370296 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.371351 30102 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.372993 29870 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.371150 29864 raft_consensus.cc:359] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.373515 29864 raft_consensus.cc:385] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.373443 29870 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.373858 29864 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.374135 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:17.374531 29864 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.375078 30237 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.375288 29870 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.375595 30237 raft_consensus.cc:697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:17.376628 29864 ts_tablet_manager.cc:1434] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.002s
I20260709 13:10:17.376392 30237 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.377595 29864 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.384159 29864 tablet_bootstrap.cc:654] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.396004 29864 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.396421 29864 ts_tablet_manager.cc:1403] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:10:17.398516 29864 raft_consensus.cc:359] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.399163 29864 raft_consensus.cc:385] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.399423 29864 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.399377 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.400118 29666 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:17.400415 29864 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.403700 29864 ts_tablet_manager.cc:1434] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:17.404654 29864 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.410259 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:17.410876 29819 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.425041 29819 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:17.425976 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.428506 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:17.429140 29744 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.429136 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.432977 29748 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:17.435055 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.435691 29670 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:17.437502 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.438186 29819 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:17.438973 29864 tablet_bootstrap.cc:654] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.442028 29666 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.443739 29744 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:17.446521 29787 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:17.450441 30102 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.450886 30102 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.451248 30102 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.440747 29569 catalog_manager.cc:5697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:17.456095 29715 leader_election.cc:343] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.456542 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:17.458047 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:17.458995 29870 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.459789 29967 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:10:17.459898 29715 leader_election.cc:343] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.460191 29967 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.461817 29967 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:17.465438 29715 leader_election.cc:343] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.467965 29864 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.468561 29864 ts_tablet_manager.cc:1403] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.003s
I20260709 13:10:17.467962 29967 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.470603 29967 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.471761 29864 raft_consensus.cc:359] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.472949 29864 raft_consensus.cc:385] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.473220 29864 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.473606 29715 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:17.474623 30235 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.474980 30235 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.475327 30235 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.484892 30146 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.485553 30146 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.487839 30146 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.488624 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.489367 29744 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:17.489319 29639 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:17.488379 30102 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.491847 30102 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:17.491571 30235 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.492448 30200 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.489856 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:17.495325 30235 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.500572 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.501987 29819 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:17.473830 29864 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.504025 30146 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.504558 30146 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.506187 30266 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.507993 30266 raft_consensus.cc:697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:17.509280 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.509485 30146 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.513602 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.514346 29669 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.519939 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:17.520771 29745 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:17.524827 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:17.525974 29817 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.525615 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:17.527264 29816 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 1: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:17.527660 29863 tablet_bootstrap.cc:492] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: No bootstrap required, opened a new log
I20260709 13:10:17.528187 29863 ts_tablet_manager.cc:1403] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: Time spent bootstrapping tablet: real 0.232s	user 0.062s	sys 0.099s
I20260709 13:10:17.524933 29669 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:17.530949 29863 raft_consensus.cc:359] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.544499 29863 raft_consensus.cc:385] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.544822 29863 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.545436 29863 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.533007 29864 ts_tablet_manager.cc:1434] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.001s
I20260709 13:10:17.514360 30266 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.537974 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:17.547499 30235 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.538380 29817 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:17.538764 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.540041 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.549592 29819 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:17.550432 29669 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.553193 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.553795 29864 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.541618 29639 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:17.543504 29714 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:17.548007 30235 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:17.555465 30235 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.557719 29870 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.557513 29669 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:17.560906 29870 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:17.561863 30146 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.561700 29870 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.562202 29639 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:17.566560 30195 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.569775 29715 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:17.570446 29864 tablet_bootstrap.cc:654] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.573012 30146 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.575730 30276 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.579994 30276 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:17.580945 30276 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.573060 30195 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.603978 29863 ts_tablet_manager.cc:1434] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 13:10:17.604689 29569 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.601125 29570 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.615670 29789 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:17.617282 30102 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:17.618752 29864 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.619511 29864 ts_tablet_manager.cc:1403] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.008s
I20260709 13:10:17.622109 29864 raft_consensus.cc:359] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.625808 29864 raft_consensus.cc:385] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.626189 29864 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.627619 29864 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.629710 29864 ts_tablet_manager.cc:1434] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:17.630769 29864 tablet_bootstrap.cc:492] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.636710 29864 tablet_bootstrap.cc:654] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.646135 29864 tablet_bootstrap.cc:492] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.646519 29864 ts_tablet_manager.cc:1403] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:10:17.646659 29571 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.648406 29864 raft_consensus.cc:359] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.648402 29571 catalog_manager.cc:5697] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.649184 29864 raft_consensus.cc:385] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.649503 29864 raft_consensus.cc:740] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.650138 29864 consensus_queue.cc:260] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.654109 29864 ts_tablet_manager.cc:1434] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:17.655073 29864 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.660810 30266 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.662608 29864 tablet_bootstrap.cc:654] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.676460 29864 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.676954 29864 ts_tablet_manager.cc:1403] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:10:17.679450 29864 raft_consensus.cc:359] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.680114 29864 raft_consensus.cc:385] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.680729 29864 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.681198 30277 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.681357 29864 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.681685 30277 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.683422 29864 ts_tablet_manager.cc:1434] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:17.685591 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:17.687040 29715 leader_election.cc:343] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:17.683913 30277 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.689322 29864 tablet_bootstrap.cc:492] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: Bootstrap starting.
I20260709 13:10:17.685655 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:17.690548 29817 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 0.
I20260709 13:10:17.691785 29714 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:17.692750 30277 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.693208 30277 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.693610 30277 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.695746 29864 tablet_bootstrap.cc:654] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:17.692821 29670 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.702965 29864 tablet_bootstrap.cc:492] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: No bootstrap required, opened a new log
I20260709 13:10:17.703399 29864 ts_tablet_manager.cc:1403] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.005s
I20260709 13:10:17.705874 29864 raft_consensus.cc:359] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.706586 29864 raft_consensus.cc:385] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:17.707294 29864 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Initialized, Role: FOLLOWER
I20260709 13:10:17.708118 29864 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.710271 29864 ts_tablet_manager.cc:1434] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:10:17.709014 30197 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:10:17.706306 30277 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.726161 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.726541 30277 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:17.726773 29666 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.743579 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:17.744165 29817 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.752334 29666 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:17.753453 29715 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:17.754139 30277 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.754669 30277 raft_consensus.cc:697] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:17.755456 30277 consensus_queue.cc:237] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.756804 29817 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:17.767097 29571 catalog_manager.cc:5697] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.778502 30197 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.778935 30197 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.780771 30197 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:17.782119 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:17.782087 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:17.782891 29669 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:17.782924 29744 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 0.
I20260709 13:10:17.783973 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:17.784732 30197 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:17.785076 30197 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:17.785396 30197 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.790184 30197 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.792776 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:17.792971 30197 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:17.793455 29669 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.793449 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:17.794910 29748 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:17.798336 29669 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:17.799407 29748 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:17.799407 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:17.800637 30266 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:17.801077 30266 raft_consensus.cc:697] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:17.801892 30266 consensus_queue.cc:237] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:17.812641 29569 catalog_manager.cc:5697] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.819387 29967 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.831957 29967 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:10:17.862334 29700 tablet.cc:2406] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:17.963871 30276 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:17.973642 29967 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.002518 30146 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.002991 30146 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:18.004643 30146 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:18.005368 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:18.005553 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:18.006289 29819 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 1: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:18.007228 29639 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:18.007844 30146 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:18.012408 30146 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:18.017901 30266 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.030153 30266 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.131618 29967 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.149539 30149 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.161137 30276 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.168980 30235 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.187219 29967 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.209824 29967 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.221540 30143 consensus_queue.cc:1048] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.226199 30266 consensus_queue.cc:1048] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:18.785223 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:18.819831 30307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:18.819833 30305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:18.820325 30304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:18.824651 28565 server_base.cc:1061] running on GCE node
I20260709 13:10:18.826520 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:18.826778 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:18.827004 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602618826982 us; error 0 us; skew 500 ppm
I20260709 13:10:18.827723 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:18.830991 28565 webserver.cc:533] Webserver started at http://127.27.229.68:41493/ using document root <none> and password file <none>
I20260709 13:10:18.831506 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:18.831733 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:18.832125 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:18.833501 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-3-root/instance:
uuid: "121060c6c5b14502957b76fd1dfc7b2d"
format_stamp: "Formatted at 2026-07-09 13:10:18 on dist-test-slave-twc1"
I20260709 13:10:18.837970 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:10:18.841578 30312 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:18.842448 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:18.842782 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-3-root
uuid: "121060c6c5b14502957b76fd1dfc7b2d"
format_stamp: "Formatted at 2026-07-09 13:10:18 on dist-test-slave-twc1"
I20260709 13:10:18.843070 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:18.874531 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:18.875910 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:18.877455 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:18.879885 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:18.880096 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:18.880352 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:18.880522 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:18.948969 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.68:42165
I20260709 13:10:18.949142 30374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.68:42165 every 8 connection(s)
I20260709 13:10:18.955457 28565 auto_leader_rebalancer-test.cc:384] add a tserver: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:18.968505 30375 heartbeater.cc:344] Connected to a master server at 127.27.229.126:42083
I20260709 13:10:18.968957 30375 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:18.969905 30375 heartbeater.cc:507] Master 127.27.229.126:42083 requested a full tablet report, sending...
I20260709 13:10:18.972074 29569 ts_manager.cc:194] Registered new tserver with Master: 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:18.973984 29569 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42502
I20260709 13:10:19.401803 29819 consensus_queue.cc:237] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:19.408650 29744 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.410063 30143 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.410580 29666 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.412242 30102 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:19.425622 29789 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc29718e51d549e395e72e7bff383425. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.431739 30102 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.435175 29666 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.440115 29748 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.459631 29570 catalog_manager.cc:5697] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.470824 29666 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:19.493989 29819 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.496435 29748 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.496330 30200 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.504106 30146 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:19.511144 29640 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f520c8b2a9e4af1a8676180d2dd96f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.529578 30200 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.543134 29748 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.544588 29819 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.553025 29817 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:19.563788 29748 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.567046 30102 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.569523 29569 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:19.573035 29789 consensus_peers.cc:597] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 247648c6c3c549fcb98f79d8df339536. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.575982 29669 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.579391 30143 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.591459 30102 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.596549 29666 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.606535 29817 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:19.612103 29569 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.619745 29748 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:10:19.635043 29789 consensus_peers.cc:597] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c996471e869b4dc78487f6b92d7bb586. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.638803 29669 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.639134 29748 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.641547 30143 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.642683 30300 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.658263 30102 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.660867 29748 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.670066 29669 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.675984 29569 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:19.950519 30403 ts_tablet_manager.cc:933] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:19.952373 30403 tablet_copy_client.cc:323] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:10:19.974395 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet fc29718e51d549e395e72e7bff383425 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:10:19.974877 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet fc29718e51d549e395e72e7bff383425 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-fc29718e51d549e395e72e7bff383425
I20260709 13:10:19.977106 30375 heartbeater.cc:499] Master 127.27.229.126:42083 was elected leader, sending a full tablet report...
I20260709 13:10:19.985996 29833 tablet_copy_source_session.cc:215] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:19.989908 30403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc29718e51d549e395e72e7bff383425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.003762 30403 tablet_copy_client.cc:806] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.004449 30403 tablet_copy_client.cc:670] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.008891 30403 tablet_copy_client.cc:538] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.020334 30403 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:20.033186 30408 ts_tablet_manager.cc:933] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:20.035125 30407 ts_tablet_manager.cc:933] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:20.038059 30407 tablet_copy_client.cc:323] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:10:20.038852 30408 tablet_copy_client.cc:323] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:10:20.046916 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet c996471e869b4dc78487f6b92d7bb586 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:10:20.047498 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet c996471e869b4dc78487f6b92d7bb586 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-c996471e869b4dc78487f6b92d7bb586
I20260709 13:10:20.056663 29833 tablet_copy_source_session.cc:215] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:20.061250 30408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c996471e869b4dc78487f6b92d7bb586. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.072256 30403 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.073385 30403 tablet_bootstrap.cc:492] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:20.074129 30403 ts_tablet_manager.cc:1403] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.013s
I20260709 13:10:20.078155 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet 1f520c8b2a9e4af1a8676180d2dd96f4 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:10:20.078838 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet 1f520c8b2a9e4af1a8676180d2dd96f4 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-1f520c8b2a9e4af1a8676180d2dd96f4
I20260709 13:10:20.080621 30408 tablet_copy_client.cc:806] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.081200 30408 tablet_copy_client.cc:670] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.082226 30403 raft_consensus.cc:359] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.083150 30403 raft_consensus.cc:740] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:20.085857 30408 tablet_copy_client.cc:538] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.086799 29684 tablet_copy_source_session.cc:215] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:20.088635 30403 consensus_queue.cc:260] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.098111 30407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f520c8b2a9e4af1a8676180d2dd96f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.099438 30403 ts_tablet_manager.cc:1434] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 13:10:20.101243 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fc29718e51d549e395e72e7bff383425 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:10:20.101734 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fc29718e51d549e395e72e7bff383425 on tablet fc29718e51d549e395e72e7bff383425 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:20.105732 30408 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:20.115671 30407 tablet_copy_client.cc:806] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.116248 30407 tablet_copy_client.cc:670] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.120288 30407 tablet_copy_client.cc:538] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.124109 30408 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.124852 30408 tablet_bootstrap.cc:492] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:20.125381 30408 ts_tablet_manager.cc:1403] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:10:20.128329 30408 raft_consensus.cc:359] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.129144 30408 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:20.129822 30408 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.129269 30407 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:20.140477 30408 ts_tablet_manager.cc:1434] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:10:20.147786 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-c996471e869b4dc78487f6b92d7bb586 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:10:20.148236 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-c996471e869b4dc78487f6b92d7bb586 on tablet c996471e869b4dc78487f6b92d7bb586 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:20.173090 30407 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.173380 30408 ts_tablet_manager.cc:933] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:20.174017 30407 tablet_bootstrap.cc:492] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:20.174960 30407 ts_tablet_manager.cc:1403] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.014s
I20260709 13:10:20.177990 30407 raft_consensus.cc:359] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.178864 30407 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:20.179596 30407 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.182066 30407 ts_tablet_manager.cc:1434] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:10:20.183725 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-1f520c8b2a9e4af1a8676180d2dd96f4 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:10:20.184160 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-1f520c8b2a9e4af1a8676180d2dd96f4 on tablet 1f520c8b2a9e4af1a8676180d2dd96f4 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:20.192865 30408 tablet_copy_client.cc:323] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:10:20.194561 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 247648c6c3c549fcb98f79d8df339536 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:10:20.195091 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 247648c6c3c549fcb98f79d8df339536 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-247648c6c3c549fcb98f79d8df339536
I20260709 13:10:20.202033 29833 tablet_copy_source_session.cc:215] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:20.205235 30408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247648c6c3c549fcb98f79d8df339536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.220547 30408 tablet_copy_client.cc:806] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.221093 30408 tablet_copy_client.cc:670] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.224363 30408 tablet_copy_client.cc:538] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.233003 30408 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:20.251811 30408 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.252676 30408 tablet_bootstrap.cc:492] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:20.253531 30408 ts_tablet_manager.cc:1403] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.008s
I20260709 13:10:20.255937 30408 raft_consensus.cc:359] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.256716 30408 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:20.257239 30408 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:20.259322 30408 ts_tablet_manager.cc:1434] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:20.260869 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-247648c6c3c549fcb98f79d8df339536 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:10:20.261197 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-247648c6c3c549fcb98f79d8df339536 on tablet 247648c6c3c549fcb98f79d8df339536 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:20.401332 30350 raft_consensus.cc:1217] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:20.535032 30350 raft_consensus.cc:1217] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:20.544788 30350 raft_consensus.cc:1217] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:20.730633 30350 raft_consensus.cc:1217] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:20.912307 30418 raft_consensus.cc:1064] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:20.915146 30418 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:20.922010 30350 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:20.924376 29669 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:20.924624 30143 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:20.926266 29744 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:20.928875 30300 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:20.941056 30421 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:20.957472 30418 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:20.974447 29669 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:20.985158 29745 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:20.986929 30350 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:20.996675 29571 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.998561 30146 raft_consensus.cc:1064] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:21.005688 30146 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:21.032537 30350 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.034180 30391 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.035897 29745 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.032537 29817 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.038882 30200 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.040738 30200 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.068570 30200 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.071281 29819 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.072899 29817 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:21.080466 30300 raft_consensus.cc:1064] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:21.079383 29745 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.082749 30300 consensus_queue.cc:237] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:21.084975 30350 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.085516 29748 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.087775 30102 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.093605 30102 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.095825 30425 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.101039 30350 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.112768 29748 raft_consensus.cc:2955] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.127120 30349 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.141270 29569 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.144016 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c996471e869b4dc78487f6b92d7bb586 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.143263 29571 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.154219 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet c996471e869b4dc78487f6b92d7bb586 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45220
I20260709 13:10:21.156638 30435 tablet_replica.cc:333] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:10:21.157728 30435 raft_consensus.cc:2243] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.158584 30435 raft_consensus.cc:2272] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.162424 30435 ts_tablet_manager.cc:1916] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.171432 29670 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:21.175370 29748 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.177703 30349 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.178579 29672 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.192394 30143 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.193802 30350 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.196611 30418 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.197697 30391 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:21.198300 30435 ts_tablet_manager.cc:1929] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:21.198808 30435 log.cc:1199] T c996471e869b4dc78487f6b92d7bb586 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/c996471e869b4dc78487f6b92d7bb586
I20260709 13:10:21.198558 30418 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:21.203598 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet c996471e869b4dc78487f6b92d7bb586 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:21.208348 30200 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.221699 30350 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.242450 29745 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.252980 30391 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.260519 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f520c8b2a9e4af1a8676180d2dd96f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.265246 30425 raft_consensus.cc:1064] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:21.267987 30425 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:21.282605 30348 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.284287 29670 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.286265 30418 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:21.286217 29744 raft_consensus.cc:2955] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.288419 30425 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.292825 29570 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.305362 30418 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.307324 30348 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.321941 29670 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.325093 29572 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.330513 29745 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.332268 30143 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.342375 30143 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.346073 29672 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.363161 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f520c8b2a9e4af1a8676180d2dd96f4 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51138
I20260709 13:10:21.368707 29748 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.394919 29745 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.405033 29570 catalog_manager.cc:5697] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.436976 30349 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.440140 30447 tablet_replica.cc:333] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:10:21.443203 30447 raft_consensus.cc:2243] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.443967 30447 raft_consensus.cc:2272] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.454623 30447 ts_tablet_manager.cc:1916] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.477029 30447 ts_tablet_manager.cc:1929] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:21.477433 30447 log.cc:1199] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/1f520c8b2a9e4af1a8676180d2dd96f4
I20260709 13:10:21.479400 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet 1f520c8b2a9e4af1a8676180d2dd96f4 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:21.486937 29817 consensus_queue.cc:237] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:21.492514 30349 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.493180 29672 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.493954 30143 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.494688 30102 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.501605 30143 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.502447 30349 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.514791 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fc29718e51d549e395e72e7bff383425 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.522270 29570 catalog_manager.cc:5697] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.525898 29672 raft_consensus.cc:2955] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.536011 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet fc29718e51d549e395e72e7bff383425 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48012
I20260709 13:10:21.538662 30448 tablet_replica.cc:333] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:10:21.539698 30448 raft_consensus.cc:2243] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.540393 30448 raft_consensus.cc:2272] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.544363 30448 ts_tablet_manager.cc:1916] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.565536 30448 ts_tablet_manager.cc:1929] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:21.566059 30448 log.cc:1199] T fc29718e51d549e395e72e7bff383425 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/fc29718e51d549e395e72e7bff383425
I20260709 13:10:21.567935 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet fc29718e51d549e395e72e7bff383425 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:21.855367 29819 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:21.860795 29745 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.860795 30349 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.862183 30300 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.862903 30102 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.870334 30300 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.873622 30349 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.879119 29745 raft_consensus.cc:2955] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:21.886026 29570 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.891294 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 247648c6c3c549fcb98f79d8df339536 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.902060 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet 247648c6c3c549fcb98f79d8df339536 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45220
I20260709 13:10:21.904357 30449 tablet_replica.cc:333] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:10:21.905396 30449 raft_consensus.cc:2243] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.907132 30449 raft_consensus.cc:2272] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.911131 30449 ts_tablet_manager.cc:1916] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.926066 30449 ts_tablet_manager.cc:1929] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:21.926400 30449 log.cc:1199] T 247648c6c3c549fcb98f79d8df339536 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/247648c6c3c549fcb98f79d8df339536
I20260709 13:10:21.928145 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet 247648c6c3c549fcb98f79d8df339536 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:22.977941 29745 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:22.984717 29817 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:22.986954 30454 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.995100 30454 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.000082 29666 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:22.999620 29817 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.001824 30445 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.009742 29672 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.013669 29570 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.013636 29666 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:10:23.029069 29715 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 917259a5b1e94566bb501796d8c4740d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.052608 29817 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:23.053339 29640 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f1f4e71b89146369180189f4402f3db. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.054689 30450 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.056103 29747 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:23.057556 30450 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.086640 30146 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.087291 29817 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.102769 29747 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.138567 29819 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.150909 29568 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:10:23.170239 29789 consensus_peers.cc:597] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 955eae6c53474f8a9c1673dbd294937e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.170734 29747 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:23.174028 29672 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:23.175704 30464 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.176815 30463 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.184355 30102 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.186224 29672 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.186642 29747 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.201510 29672 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.201850 29572 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.210197 29819 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:23.212164 30470 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:23.213084 29640 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 950ba8523bd4460bb0db3a8ae291f1ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.213258 29747 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:23.215049 30469 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.221055 30469 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.223820 29817 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.238451 29747 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.242614 29568 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:23.560209 30479 ts_tablet_manager.cc:933] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:23.563736 30479 tablet_copy_client.cc:323] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:10:23.585263 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet 917259a5b1e94566bb501796d8c4740d from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:10:23.585870 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet 917259a5b1e94566bb501796d8c4740d from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-917259a5b1e94566bb501796d8c4740d
I20260709 13:10:23.595741 29759 tablet_copy_source_session.cc:215] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.602422 30479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 917259a5b1e94566bb501796d8c4740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.622413 30479 tablet_copy_client.cc:806] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.622984 30479 tablet_copy_client.cc:670] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.630024 30479 tablet_copy_client.cc:538] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.640265 30483 ts_tablet_manager.cc:933] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:23.641537 30479 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:23.642431 30483 tablet_copy_client.cc:323] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:10:23.644460 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet 950ba8523bd4460bb0db3a8ae291f1ca from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:10:23.645015 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet 950ba8523bd4460bb0db3a8ae291f1ca from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-950ba8523bd4460bb0db3a8ae291f1ca
I20260709 13:10:23.714349 29684 tablet_copy_source_session.cc:215] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.719159 30483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 950ba8523bd4460bb0db3a8ae291f1ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.745586 30486 ts_tablet_manager.cc:933] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:23.753288 30486 tablet_copy_client.cc:323] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:10:23.755069 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet 0f1f4e71b89146369180189f4402f3db from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:10:23.755607 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet 0f1f4e71b89146369180189f4402f3db from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-0f1f4e71b89146369180189f4402f3db
I20260709 13:10:23.755914 30479 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.756817 30479 tablet_bootstrap.cc:492] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:23.757469 30479 ts_tablet_manager.cc:1403] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.116s	user 0.041s	sys 0.017s
I20260709 13:10:23.760252 30479 raft_consensus.cc:359] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.760886 30479 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:23.761415 30479 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.764631 30479 ts_tablet_manager.cc:1434] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.007s
I20260709 13:10:23.765242 29684 tablet_copy_source_session.cc:215] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.767051 30483 tablet_copy_client.cc:806] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.767639 30483 tablet_copy_client.cc:670] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.768435 30486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1f4e71b89146369180189f4402f3db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.772992 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-917259a5b1e94566bb501796d8c4740d received from {username='slave'} at 127.0.0.1:36354
I20260709 13:10:23.773458 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-917259a5b1e94566bb501796d8c4740d on tablet 917259a5b1e94566bb501796d8c4740d with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:23.774792 30483 tablet_copy_client.cc:538] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.785744 30486 tablet_copy_client.cc:806] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.786367 30486 tablet_copy_client.cc:670] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.788146 30483 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:23.790184 30486 tablet_copy_client.cc:538] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.794442 30479 ts_tablet_manager.cc:933] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:23.803797 30479 tablet_copy_client.cc:323] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:10:23.805419 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 955eae6c53474f8a9c1673dbd294937e from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:10:23.805998 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 955eae6c53474f8a9c1673dbd294937e from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-955eae6c53474f8a9c1673dbd294937e
I20260709 13:10:23.813186 29833 tablet_copy_source_session.cc:215] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.816697 30479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 955eae6c53474f8a9c1673dbd294937e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.827301 30486 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:23.831629 30479 tablet_copy_client.cc:806] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.832211 30479 tablet_copy_client.cc:670] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.838863 30479 tablet_copy_client.cc:538] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.838948 30483 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.840606 30483 tablet_bootstrap.cc:492] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:23.841450 30483 ts_tablet_manager.cc:1403] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.023s
I20260709 13:10:23.843747 30483 raft_consensus.cc:359] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.844362 30483 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:23.844995 30483 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.847287 30483 ts_tablet_manager.cc:1434] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:23.849124 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-950ba8523bd4460bb0db3a8ae291f1ca received from {username='slave'} at 127.0.0.1:57422
I20260709 13:10:23.849546 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-950ba8523bd4460bb0db3a8ae291f1ca on tablet 950ba8523bd4460bb0db3a8ae291f1ca with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:23.851998 30479 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:23.876778 30486 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.877585 30479 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.877653 30486 tablet_bootstrap.cc:492] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:23.878546 30486 ts_tablet_manager.cc:1403] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.008s
I20260709 13:10:23.878583 30479 tablet_bootstrap.cc:492] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:23.879457 30479 ts_tablet_manager.cc:1403] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.008s
I20260709 13:10:23.881785 30486 raft_consensus.cc:359] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.882686 30486 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:23.882298 30479 raft_consensus.cc:359] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.883203 30479 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:23.885360 30479 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.883343 30486 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:23.888319 30479 ts_tablet_manager.cc:1434] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:23.890640 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-955eae6c53474f8a9c1673dbd294937e received from {username='slave'} at 127.0.0.1:52208
I20260709 13:10:23.891074 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-955eae6c53474f8a9c1673dbd294937e on tablet 955eae6c53474f8a9c1673dbd294937e with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:23.892530 30486 ts_tablet_manager.cc:1434] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:10:23.894524 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-0f1f4e71b89146369180189f4402f3db received from {username='slave'} at 127.0.0.1:57422
I20260709 13:10:23.894917 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-0f1f4e71b89146369180189f4402f3db on tablet 0f1f4e71b89146369180189f4402f3db with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:24.126468 30349 raft_consensus.cc:1217] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:24.146189 30349 raft_consensus.cc:1217] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:24.214816 30349 raft_consensus.cc:1217] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:24.397945 30349 raft_consensus.cc:1217] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:24.582525 30470 raft_consensus.cc:1064] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:24.585083 30470 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:24.594507 29817 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.596268 30349 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.596328 29745 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.596616 30470 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.598321 30496 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.599035 30450 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.611313 30496 raft_consensus.cc:1064] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:24.613960 30496 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:24.616122 30470 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.619602 29747 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.633487 29817 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.635622 30349 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.638271 30450 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.637459 30348 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.640179 30450 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.652321 29744 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.658109 30450 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.660099 29570 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.664156 30503 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:24.672497 30349 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.681470 29819 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.692610 29744 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.712774 29817 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.725829 29568 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.744463 29672 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:24.745477 30443 raft_consensus.cc:1064] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:24.747694 30443 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:24.752434 29817 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.753883 30450 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.759198 30348 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.760727 30450 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.767462 30470 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.777423 30349 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.779213 30443 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:24.782325 29669 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.781978 30349 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.786005 30459 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.791257 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f1f4e71b89146369180189f4402f3db with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:24.805795 29817 raft_consensus.cc:2955] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.822467 29572 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.825042 29669 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:24.831948 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 58279.3us
I20260709 13:10:24.835268 29817 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.835711 30443 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.842958 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f1f4e71b89146369180189f4402f3db with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48012
I20260709 13:10:24.842338 29666 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.855043 30349 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.857906 30450 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:24.860271 30348 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.861462 30514 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:24.865170 30517 tablet_replica.cc:333] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:10:24.866421 30470 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.871598 30517 raft_consensus.cc:2243] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.872397 30517 raft_consensus.cc:2272] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.874680 29817 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.876194 30496 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.871462 30349 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.895608 30517 ts_tablet_manager.cc:1916] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:24.924264 30517 ts_tablet_manager.cc:1929] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:24.927026 30517 log.cc:1199] T 0f1f4e71b89146369180189f4402f3db P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/0f1f4e71b89146369180189f4402f3db
I20260709 13:10:24.901292 29571 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.908489 29816 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.900959 29817 raft_consensus.cc:2955] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.928786 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 0f1f4e71b89146369180189f4402f3db (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:24.903553 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 950ba8523bd4460bb0db3a8ae291f1ca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:24.939462 29569 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.944366 29745 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:24.955729 30349 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.957199 30459 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.959897 29672 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.961567 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 950ba8523bd4460bb0db3a8ae291f1ca with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48012
I20260709 13:10:24.963219 30517 tablet_replica.cc:333] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:10:24.964458 30517 raft_consensus.cc:2243] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.967170 30459 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.967655 30517 raft_consensus.cc:2272] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.971827 30443 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.974512 30517 ts_tablet_manager.cc:1916] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:24.979625 30349 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:24.994230 30517 ts_tablet_manager.cc:1929] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:24.994807 30517 log.cc:1199] T 950ba8523bd4460bb0db3a8ae291f1ca P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/950ba8523bd4460bb0db3a8ae291f1ca
I20260709 13:10:24.996254 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 950ba8523bd4460bb0db3a8ae291f1ca (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:24.998095 30509 raft_consensus.cc:1064] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:25.000355 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 917259a5b1e94566bb501796d8c4740d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:25.001233 30509 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:25.002465 29571 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.011785 29672 raft_consensus.cc:2955] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.018311 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet 917259a5b1e94566bb501796d8c4740d with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51138
I20260709 13:10:25.032059 30521 tablet_replica.cc:333] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:10:25.033046 30521 raft_consensus.cc:2243] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.033669 30521 raft_consensus.cc:2272] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.038269 30349 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:25.039407 30521 ts_tablet_manager.cc:1916] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.039783 29745 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:25.040932 30464 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.041908 30495 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:25.058115 30521 ts_tablet_manager.cc:1929] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:25.058595 30521 log.cc:1199] T 917259a5b1e94566bb501796d8c4740d P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/917259a5b1e94566bb501796d8c4740d
I20260709 13:10:25.061385 29672 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:25.063014 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet 917259a5b1e94566bb501796d8c4740d (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:25.063421 30509 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:25.066109 30495 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.084224 29745 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.097299 29672 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.106995 29570 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.111712 30349 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.147475 29819 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:25.151726 30349 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:25.152354 29744 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:25.153344 30525 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:25.154199 30495 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.160665 30464 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.162742 29744 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.169899 30349 raft_consensus.cc:2955] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:25.171659 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 955eae6c53474f8a9c1673dbd294937e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:25.180145 29572 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 1 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.194715 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet 955eae6c53474f8a9c1673dbd294937e with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45220
I20260709 13:10:25.197280 30526 tablet_replica.cc:333] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:10:25.198130 30526 raft_consensus.cc:2243] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.198884 30526 raft_consensus.cc:2272] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.202142 30526 ts_tablet_manager.cc:1916] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.218428 30526 ts_tablet_manager.cc:1929] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:25.218910 30526 log.cc:1199] T 955eae6c53474f8a9c1673dbd294937e P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/955eae6c53474f8a9c1673dbd294937e
I20260709 13:10:25.220408 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet 955eae6c53474f8a9c1673dbd294937e (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:26.264601 29747 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.272672 29666 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:26.273734 29819 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:26.273873 29715 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb08df13591747d7bf91993e76665808. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.274992 30459 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.275882 30518 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.283896 30459 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.285979 29666 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.288910 29819 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.303699 29816 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.309572 29571 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:26.323611 29789 consensus_peers.cc:597] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8c959a6f0c6345c9b312b54d4090ba28. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.329655 29745 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.331262 29666 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:26.332604 30464 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.334930 30509 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.348873 30509 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.350364 29745 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.358618 29672 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.368204 29745 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.382805 29571 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 2 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.392603 29816 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:26.393208 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0f895f1660a4065920da71ac5df9433. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.394537 30529 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.395542 29666 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:26.397856 30518 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.406587 30518 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.408602 29672 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.412957 29816 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.421536 29672 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.423280 29572 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.441569 29817 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:26.441999 29640 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b3e1085d9ad4120b3284dbd3939b5e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.442893 29747 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:26.445760 30450 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:26.448433 30450 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:26.463156 29747 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.460974 30450 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.475421 29817 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:26.488171 29572 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.677825 30549 ts_tablet_manager.cc:933] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:26.680020 30549 tablet_copy_client.cc:323] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:10:26.681977 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet fb08df13591747d7bf91993e76665808 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:10:26.682605 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet fb08df13591747d7bf91993e76665808 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-fb08df13591747d7bf91993e76665808
I20260709 13:10:26.689472 29759 tablet_copy_source_session.cc:215] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:26.692804 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb08df13591747d7bf91993e76665808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.716418 30549 tablet_copy_client.cc:806] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:26.717213 30549 tablet_copy_client.cc:670] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:26.723380 30549 tablet_copy_client.cc:538] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:26.734994 30549 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:26.759032 30551 ts_tablet_manager.cc:933] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:26.767570 30549 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:26.768989 30549 tablet_bootstrap.cc:492] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:26.769641 30551 tablet_copy_client.cc:323] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:10:26.769783 30549 ts_tablet_manager.cc:1403] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.035s	user 0.031s	sys 0.000s
I20260709 13:10:26.771957 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 8c959a6f0c6345c9b312b54d4090ba28 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:10:26.772541 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 8c959a6f0c6345c9b312b54d4090ba28 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-8c959a6f0c6345c9b312b54d4090ba28
I20260709 13:10:26.773839 30549 raft_consensus.cc:359] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.774780 30549 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:26.775574 30549 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.782027 30549 ts_tablet_manager.cc:1434] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:10:26.784067 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fb08df13591747d7bf91993e76665808 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:10:26.784590 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fb08df13591747d7bf91993e76665808 on tablet fb08df13591747d7bf91993e76665808 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:26.786877 29833 tablet_copy_source_session.cc:215] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:26.791074 30551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c959a6f0c6345c9b312b54d4090ba28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.803826 30551 tablet_copy_client.cc:806] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:26.804481 30551 tablet_copy_client.cc:670] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:26.807906 30551 tablet_copy_client.cc:538] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:26.814184 30551 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:26.832212 30551 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:26.833112 30551 tablet_bootstrap.cc:492] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:26.833818 30551 ts_tablet_manager.cc:1403] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.020s	user 0.022s	sys 0.000s
I20260709 13:10:26.836445 30551 raft_consensus.cc:359] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.837340 30551 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:26.838086 30551 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:26.840994 30551 ts_tablet_manager.cc:1434] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:26.843376 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-8c959a6f0c6345c9b312b54d4090ba28 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:10:26.843775 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-8c959a6f0c6345c9b312b54d4090ba28 on tablet 8c959a6f0c6345c9b312b54d4090ba28 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:26.943378 30551 ts_tablet_manager.cc:933] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:26.944994 30551 tablet_copy_client.cc:323] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:10:26.946586 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet e0f895f1660a4065920da71ac5df9433 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:10:26.947153 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet e0f895f1660a4065920da71ac5df9433 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-e0f895f1660a4065920da71ac5df9433
I20260709 13:10:26.955317 29759 tablet_copy_source_session.cc:215] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:26.958662 30551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f895f1660a4065920da71ac5df9433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.962275 30549 ts_tablet_manager.cc:933] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:26.971541 30549 tablet_copy_client.cc:323] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:10:26.973435 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet 7b3e1085d9ad4120b3284dbd3939b5e4 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:10:26.974048 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet 7b3e1085d9ad4120b3284dbd3939b5e4 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-7b3e1085d9ad4120b3284dbd3939b5e4
I20260709 13:10:26.982462 30551 tablet_copy_client.cc:806] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:26.983392 30551 tablet_copy_client.cc:670] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:26.984411 29684 tablet_copy_source_session.cc:215] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:26.987946 30549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b3e1085d9ad4120b3284dbd3939b5e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:26.994046 30551 tablet_copy_client.cc:538] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:27.003916 30551 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:27.006683 30549 tablet_copy_client.cc:806] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:27.007411 30549 tablet_copy_client.cc:670] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:27.015139 30549 tablet_copy_client.cc:538] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:27.026217 30549 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:27.063227 30549 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:27.064248 30549 tablet_bootstrap.cc:492] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:27.064944 30549 ts_tablet_manager.cc:1403] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.017s
I20260709 13:10:27.065059 30551 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:27.066118 30551 tablet_bootstrap.cc:492] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:27.066829 30551 ts_tablet_manager.cc:1403] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.024s
I20260709 13:10:27.067426 30549 raft_consensus.cc:359] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:27.068033 30549 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:27.068629 30549 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:27.070482 30549 ts_tablet_manager.cc:1434] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:10:27.069906 30551 raft_consensus.cc:359] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:27.070879 30551 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:27.071597 30551 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:27.072125 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-7b3e1085d9ad4120b3284dbd3939b5e4 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:10:27.072736 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-7b3e1085d9ad4120b3284dbd3939b5e4 on tablet 7b3e1085d9ad4120b3284dbd3939b5e4 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:27.074328 30551 ts_tablet_manager.cc:1434] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:27.076556 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-e0f895f1660a4065920da71ac5df9433 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:10:27.076999 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-e0f895f1660a4065920da71ac5df9433 on tablet e0f895f1660a4065920da71ac5df9433 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:27.204748 30349 raft_consensus.cc:1217] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:10:27.207442 30349 raft_consensus.cc:1217] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:27.358354 30349 raft_consensus.cc:1217] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:27.415552 30349 raft_consensus.cc:1217] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:27.695376 30518 raft_consensus.cc:1064] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:27.698037 30518 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:27.713374 30349 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:27.715101 30518 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.720474 29669 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:27.723726 30518 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.730165 29816 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:27.732954 30518 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.735021 30518 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.736548 29669 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.751593 30349 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.764707 29571 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.787606 29817 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.796914 29747 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:27.807204 30539 raft_consensus.cc:1064] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:27.808506 30349 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:27.809794 30529 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:27.810137 29672 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:27.814180 30560 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:27.826149 30518 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.826184 29669 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.836042 30349 raft_consensus.cc:2955] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.809795 30539 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:27.849491 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fb08df13591747d7bf91993e76665808 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:27.866458 30348 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.862764 29570 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.871819 29669 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.874235 29745 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:27.875834 30464 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.889061 30518 raft_consensus.cc:1064] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:27.896262 30571 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:27.896381 30518 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:27.897480 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet fb08df13591747d7bf91993e76665808 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51138
I20260709 13:10:27.898092 30464 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.905319 30573 tablet_replica.cc:333] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:10:27.907092 30573 raft_consensus.cc:2243] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:27.909543 30349 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:27.911170 29819 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:27.912048 29666 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:27.915606 30459 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.917250 30573 raft_consensus.cc:2272] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:27.917351 30459 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.919191 30529 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:27.921896 30509 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.933307 30349 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.940611 29745 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.948027 29570 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:27.950356 29666 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:27.975570 29817 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:27.957755 30573 ts_tablet_manager.cc:1916] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:27.998504 29745 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:28.004299 30571 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:28.008919 30573 ts_tablet_manager.cc:1929] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:28.009471 30573 log.cc:1199] T fb08df13591747d7bf91993e76665808 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/fb08df13591747d7bf91993e76665808
I20260709 13:10:28.014515 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet fb08df13591747d7bf91993e76665808 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:28.015828 30349 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:28.018946 30518 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.016680 30569 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.025177 30348 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.034915 29745 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.039402 29819 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.047999 29672 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.051151 30582 raft_consensus.cc:1064] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:28.058868 29570 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.059670 30509 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:28.068365 30582 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:28.081300 30348 raft_consensus.cc:2955] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.086371 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8c959a6f0c6345c9b312b54d4090ba28 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:28.100695 29745 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:28.104717 29572 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 3 to 4, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 2 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.107522 30348 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:28.111572 30518 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:28.118569 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c959a6f0c6345c9b312b54d4090ba28 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45220
I20260709 13:10:28.124825 29666 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:28.135144 30529 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.140728 30348 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.178821 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0f895f1660a4065920da71ac5df9433 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:28.181217 29816 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:28.183403 29745 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:28.183321 29572 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.185685 30581 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:28.188395 30459 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:28.190182 30450 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:28.192719 29666 raft_consensus.cc:2955] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.194954 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet e0f895f1660a4065920da71ac5df9433 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:51138
I20260709 13:10:28.199000 30573 tablet_replica.cc:333] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:10:28.195372 30348 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:28.201639 30450 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:28.197781 29571 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet e0f895f1660a4065920da71ac5df9433 with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
I20260709 13:10:28.214437 30586 tablet_replica.cc:333] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:10:28.216256 30586 raft_consensus.cc:2243] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.217059 30586 raft_consensus.cc:2272] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.238233 30573 raft_consensus.cc:2243] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.239069 30573 raft_consensus.cc:2272] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.241154 30450 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.242762 30573 ts_tablet_manager.cc:1916] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:28.245013 30348 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.249432 30586 ts_tablet_manager.cc:1916] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:28.252626 29747 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.273223 29571 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.277537 30573 ts_tablet_manager.cc:1929] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:28.278115 30573 log.cc:1199] T e0f895f1660a4065920da71ac5df9433 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/e0f895f1660a4065920da71ac5df9433
I20260709 13:10:28.279842 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet e0f895f1660a4065920da71ac5df9433 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:28.296519 30586 ts_tablet_manager.cc:1929] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:10:28.295642 29819 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.303625 30586 log.cc:1199] T 8c959a6f0c6345c9b312b54d4090ba28 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/8c959a6f0c6345c9b312b54d4090ba28
I20260709 13:10:28.305720 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet 8c959a6f0c6345c9b312b54d4090ba28 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:28.326978 29669 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:28.332367 30348 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:28.332784 29819 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:28.333570 30450 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:28.335273 30584 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:28.340317 30450 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.344031 30348 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.349195 29819 raft_consensus.cc:2955] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.361788 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b3e1085d9ad4120b3284dbd3939b5e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:28.369110 29570 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 3 to 4, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:28.382659 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b3e1085d9ad4120b3284dbd3939b5e4 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48012
I20260709 13:10:28.384595 30590 tablet_replica.cc:333] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:10:28.385720 30590 raft_consensus.cc:2243] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:28.386425 30590 raft_consensus.cc:2272] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:28.389371 30590 ts_tablet_manager.cc:1916] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:28.404431 30590 ts_tablet_manager.cc:1929] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:28.404814 30590 log.cc:1199] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/7b3e1085d9ad4120b3284dbd3939b5e4
I20260709 13:10:28.406404 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 7b3e1085d9ad4120b3284dbd3939b5e4 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:10:29.446139 29669 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:29.453301 29747 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:29.453511 29640 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dff620b2062c4139940ec520664442a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.454456 29816 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:29.456493 30592 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:29.458177 30581 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.468298 30594 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.471311 29747 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.487416 29819 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.490471 29745 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:29.487903 29571 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:29.504562 29715 consensus_peers.cc:597] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81b2426a3eab4a3993fe9c9a5eb04e3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.504576 29819 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:29.506740 30591 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.507951 29669 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:29.509208 30591 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.516129 30591 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.517266 29819 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.519811 29669 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.539086 29745 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:29.540129 29570 catalog_manager.cc:5697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:10:29.570988 29715 consensus_peers.cc:597] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1cc4f503726e4efd8620c27deea0b183. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.571858 29672 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:29.584568 30591 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.592373 29819 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:29.600306 30607 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:29.604575 30607 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.626928 29669 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.629869 29747 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:29.627351 29571 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 1 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.630586 29816 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:10:29.646932 29715 consensus_peers.cc:597] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 222c2ac209fd4c24a1f636fff5c13739. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:29.649652 29672 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.651386 30608 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.658429 29816 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.660255 30606 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:29.670173 30591 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.679160 29672 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.693746 29819 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:10:29.694128 29571 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 2, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.918248 30616 ts_tablet_manager.cc:933] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:29.920151 30616 tablet_copy_client.cc:323] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:10:29.921773 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:10:29.922319 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet 81b2426a3eab4a3993fe9c9a5eb04e3d from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-81b2426a3eab4a3993fe9c9a5eb04e3d
I20260709 13:10:29.927910 29759 tablet_copy_source_session.cc:215] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:29.930768 30616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:29.942116 30616 tablet_copy_client.cc:806] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:29.942765 30616 tablet_copy_client.cc:670] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:29.946345 30616 tablet_copy_client.cc:538] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:29.954099 30616 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:29.972007 30616 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:29.972744 30616 tablet_bootstrap.cc:492] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:29.973297 30616 ts_tablet_manager.cc:1403] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:10:29.975836 30616 raft_consensus.cc:359] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:29.976653 30616 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:29.977368 30619 ts_tablet_manager.cc:933] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:29.977267 30616 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:29.980190 30616 ts_tablet_manager.cc:1434] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:10:29.983328 30619 tablet_copy_client.cc:323] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:10:29.985091 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet dff620b2062c4139940ec520664442a1 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:10:29.985632 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet dff620b2062c4139940ec520664442a1 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-dff620b2062c4139940ec520664442a1
I20260709 13:10:29.988726 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-81b2426a3eab4a3993fe9c9a5eb04e3d received from {username='slave'} at 127.0.0.1:36354
I20260709 13:10:29.989203 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-81b2426a3eab4a3993fe9c9a5eb04e3d on tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:29.994853 30622 ts_tablet_manager.cc:933] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:29.998744 29684 tablet_copy_source_session.cc:215] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:30.003739 30619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dff620b2062c4139940ec520664442a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.013872 30622 tablet_copy_client.cc:323] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:10:30.015870 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet 1cc4f503726e4efd8620c27deea0b183 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:10:30.016413 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet 1cc4f503726e4efd8620c27deea0b183 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-1cc4f503726e4efd8620c27deea0b183
I20260709 13:10:30.027981 30619 tablet_copy_client.cc:806] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:30.028687 30619 tablet_copy_client.cc:670] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:30.031970 29759 tablet_copy_source_session.cc:215] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:30.033463 30619 tablet_copy_client.cc:538] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:30.035446 30622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cc4f503726e4efd8620c27deea0b183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.042281 30619 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:30.059262 30622 tablet_copy_client.cc:806] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:30.059823 30622 tablet_copy_client.cc:670] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:30.063619 30622 tablet_copy_client.cc:538] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:30.074975 30622 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:30.087363 30619 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:30.088251 30619 tablet_bootstrap.cc:492] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:30.090895 30619 ts_tablet_manager.cc:1403] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.002s
I20260709 13:10:30.093961 30619 raft_consensus.cc:359] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:30.094794 30619 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:30.095433 30619 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:30.101048 30619 ts_tablet_manager.cc:1434] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:30.103140 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-dff620b2062c4139940ec520664442a1 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:10:30.103608 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-dff620b2062c4139940ec520664442a1 on tablet dff620b2062c4139940ec520664442a1 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:30.124251 30622 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:30.125125 30622 tablet_bootstrap.cc:492] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:30.125783 30622 ts_tablet_manager.cc:1403] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.011s
I20260709 13:10:30.128168 30622 raft_consensus.cc:359] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:30.128758 30622 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:30.129269 30622 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:30.131109 30622 ts_tablet_manager.cc:1434] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:30.133428 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-1cc4f503726e4efd8620c27deea0b183 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:10:30.133788 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-1cc4f503726e4efd8620c27deea0b183 on tablet 1cc4f503726e4efd8620c27deea0b183 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:30.196954 30622 ts_tablet_manager.cc:933] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:30.198486 30622 tablet_copy_client.cc:323] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:10:30.199801 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet 222c2ac209fd4c24a1f636fff5c13739 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:10:30.200232 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet 222c2ac209fd4c24a1f636fff5c13739 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-222c2ac209fd4c24a1f636fff5c13739
I20260709 13:10:30.207172 29759 tablet_copy_source_session.cc:215] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:30.210281 30622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 222c2ac209fd4c24a1f636fff5c13739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:30.222937 30622 tablet_copy_client.cc:806] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:30.223517 30622 tablet_copy_client.cc:670] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:30.228166 30622 tablet_copy_client.cc:538] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:30.238188 30622 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:10:30.257229 30622 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:30.258359 30622 tablet_bootstrap.cc:492] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:10:30.259032 30622 ts_tablet_manager.cc:1403] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:10:30.263934 30622 raft_consensus.cc:359] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:30.264796 30622 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:10:30.265415 30622 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:30.267392 30622 ts_tablet_manager.cc:1434] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:30.269274 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-222c2ac209fd4c24a1f636fff5c13739 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:10:30.269682 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-222c2ac209fd4c24a1f636fff5c13739 on tablet 222c2ac209fd4c24a1f636fff5c13739 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:30.378106 30347 raft_consensus.cc:1217] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:30.483639 30347 raft_consensus.cc:1217] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:30.555557 30347 raft_consensus.cc:1217] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:30.751942 30347 raft_consensus.cc:1217] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:10:30.818454 30591 raft_consensus.cc:1064] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:30.820758 30591 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:30.848903 29672 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:30.850131 29816 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:30.850447 30591 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:30.853204 30591 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:30.857486 30347 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:30.859423 30631 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:31.942353 30635 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:31.942976 30635 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:31.945175 30635 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:32.050531 29639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.009s	sys 0.010s
W20260709 13:10:32.051004 29639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.009s	sys 0.010s
W20260709 13:10:32.051314 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 736498us
I20260709 13:10:32.082407 30639 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.083184 30639 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.085760 30639 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.136111 30641 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.138583 30640 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.140818 30640 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.140126 30645 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.143107 30640 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.142982 30645 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.143610 30640 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.145993 30646 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.146524 30646 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:32.147336 30645 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.147821 30645 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.148249 30645 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.148598 30646 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.149070 30646 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.149518 30646 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.150707 30645 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.144232 30644 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.151328 30646 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.151734 30644 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.154354 30644 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:32.144160 30640 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.144169 30642 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.240270 30646 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.241444 30646 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.244194 30646 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.244342 30640 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.145496 30639 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.241297 30642 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.245764 30646 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.247181 30639 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.247763 30646 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.239923 30641 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.249091 30642 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.249402 30639 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.259670 30646 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.262413 30641 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.263140 30641 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.263792 30641 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.266067 30645 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:32.271061 30645 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.265673 30639 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.272720 30639 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.273178 30645 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.267429 30646 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.274571 30647 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.275240 30644 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.266310 30642 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:32.302696 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080010a980 after lost signal to thread 28568
I20260709 13:10:32.305576 30650 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.306164 30650 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.308288 30650 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.295449 30647 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:32.316366 30647 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.316882 30647 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.317840 30647 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.283310 30645 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.321151 30642 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.323166 30645 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.322168 30644 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.326062 30645 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.283697 30646 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.328488 30642 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.328974 29672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 961) took 1111 ms. Trace:
I20260709 13:10:32.329589 30646 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.329466 29672 rpcz_store.cc:276] 0709 13:10:31.218082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.328219 (+1110137us) service_pool.cc:224] Handling call
0709 13:10:32.328503 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.328672 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.328696 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.328732 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:32.328760 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.328810 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.328905 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.332036 30643 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.327090 30641 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.336459 30639 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.338171 30647 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.281545 30640 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.332857 30643 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.342067 30639 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.359716 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.350116 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.360523 29817 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:32.360664 29819 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:32.359836 30648 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.363490 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.364101 29819 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:32.344221 30641 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.350589 30644 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.369359 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.340895 30640 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.366333 30639 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.362578 30648 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.374634 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.376245 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.376879 29817 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:32.370824 30581 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.379815 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.381327 30581 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.383138 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.383365 30581 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.384171 30648 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.384181 30649 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:32.370669 30641 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:32.380153 30646 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.388255 30640 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.377979 30647 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.392856 30643 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.378746 30644 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.380851 29817 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:32.395241 30649 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.411824 30653 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.412655 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.414072 30648 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.413782 30644 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.414517 30645 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.411154 30647 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.414963 29816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 428) took 1104 ms. Trace:
I20260709 13:10:32.422515 29816 rpcz_store.cc:276] 0709 13:10:31.310972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.414242 (+1103270us) service_pool.cc:224] Handling call
0709 13:10:32.414513 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:32.414671 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:32.414695 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:32.414733 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:32.414761 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.414809 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:32.414909 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:32.437292 30648 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.418620 30581 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.438246 30645 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.438788 30581 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.439531 30648 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.418753 29818 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:32.417260 30646 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.636566 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.657733 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.682215 29817 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:32.455988 30641 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.724766 30641 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.725333 30641 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.725834 30664 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:32.726413 30664 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.727547 30641 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.728528 30664 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:32.633849 30639 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.447356 30645 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.442478 30653 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.536670 30529 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.539023 30649 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:32.591871 30656 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.539170 30654 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.749444 30529 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.710752 30648 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:32.537488 30658 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.731750 30640 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.842870 30529 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.845079 30646 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.737365 30661 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.863328 30529 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.737675 30639 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.909444 30529 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.906996 30643 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.920833 30529 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.831998 30648 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.911728 30644 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.911257 30646 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.931299 30657 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:32.863481 30656 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.907264 30640 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.923730 30647 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.921597 30651 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.921885 30643 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:32.920305 30660 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.923471 30665 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.835737 30654 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.913957 30639 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.960538 30659 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.929767 30644 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:32.907971 30658 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.913389 30661 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.931900 30657 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:32.959494 30647 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.971977 30661 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.972127 30648 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.972553 30661 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:32.973169 30653 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.973023 30661 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.974109 30644 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.981220 30662 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:32.964144 30651 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.984144 30651 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:32.981603 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:32.974053 30647 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:32.974923 30660 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.944397 30646 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.991873 30658 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:32.966579 30659 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.970249 30665 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:32.992043 30661 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.225399 30661 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.074229 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.227324 29674 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:33.245258 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.051072 30663 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.226274 30661 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.067184 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.256872 30671 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.258919 30638 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.262029 30674 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.246753 30648 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.219072 30654 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:32.984145 30643 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:33.060552 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.074040 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.090888 30655 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.082643 30639 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:33.068598 30644 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.264443 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.276345 29672 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:33.278733 30673 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.285401 30677 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.286835 30678 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.274628 30648 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.029374 30653 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.027782 30640 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.028585 30647 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:32.992483 30666 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.292903 29670 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:33.290509 30654 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.302042 30654 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.300549 30653 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.095347 30670 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.074257 30657 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:32.995457 30660 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.068392 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.263574 30667 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.306700 29667 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:33.294868 29666 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:33.050662 30656 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.267062 30658 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.074728 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.246591 30663 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.310359 29639 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.299749 30655 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.313103 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.313796 30647 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.313947 29639 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.314170 30663 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.299559 30648 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.314357 30644 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.314785 30644 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.314838 30675 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.315228 30644 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.315296 30675 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.315757 30675 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.300361 30316 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.318856 30655 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.314210 30647 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.319767 30647 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.995929 30662 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.323576 30662 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.290948 30674 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:33.303691 29640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.039s	sys 0.052s
I20260709 13:10:33.290442 30638 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.326038 30638 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.326146 30674 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:33.326638 29640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.039s	sys 0.052s
I20260709 13:10:33.326946 30675 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.329429 29639 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.302734 30666 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.330286 30638 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.334952 29639 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.331640 30664 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.346895 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.334213 30663 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.349767 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:33.350533 30348 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.334605 30656 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.336901 30649 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.337617 30638 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.338951 30665 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:33.352259 30675 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.303313 30673 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.359170 30629 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.337147 30658 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.339169 30644 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.306733 30667 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.299003 30671 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.365746 30629 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.360528 30649 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.336678 30647 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:33.360013 30638 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.354864 30664 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.410614 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:33.411300 30348 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.304975 30677 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.355491 30663 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.384132 30629 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.362223 30656 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.388482 30660 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.387601 30654 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.337196 30670 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:33.413378 29640 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.388059 30646 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.422400 30671 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.422736 30649 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:33.423877 30644 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.304730 30678 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:33.429680 30643 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.431074 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.431238 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.433133 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.434073 30581 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:33.434698 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08000350e0 after lost signal to thread 29606
I20260709 13:10:33.433601 30672 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.419986 30659 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.421280 30660 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.452292 30677 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.444389 30653 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:33.456984 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 43678us
W20260709 13:10:33.454912 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08003028a0 after lost signal to thread 29698
I20260709 13:10:33.449782 30660 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.459406 30673 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.459692 30646 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:33.459439 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080032d380 after lost signal to thread 29773
I20260709 13:10:33.461089 30646 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.464731 30646 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:33.463812 29603 debug-util.cc:398] Leaking SignalData structure 0x7b0800307620 after lost signal to thread 29847
I20260709 13:10:33.464181 30581 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.467383 29640 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.447233 30643 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.455753 30666 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:33.443768 30648 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.468194 30654 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.455040 30672 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.489776 30668 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.490728 30648 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:33.470345 30581 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.491484 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:33.490535 30668 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.493032 30648 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.494177 30348 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.484903 30658 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.488509 30667 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.494695 30666 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.495061 30669 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:33.477769 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 177499us
I20260709 13:10:33.486135 30654 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.496311 30664 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:33.512290 30591 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.513296 30591 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.498634 30644 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.499083 30663 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.515115 30591 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.517266 30681 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.519776 29640 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.517828 30681 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.521222 30677 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.521803 30677 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.522014 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:33.524112 30655 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.524588 30347 raft_consensus.cc:2393] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:33.525023 30670 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:33.510617 30669 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.521142 30674 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.525452 30677 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.523640 30591 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.507473 30658 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.524636 30655 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.515791 30671 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.509377 30656 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.525825 30674 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.527351 30581 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.527431 30591 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:33.532764 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 185948us
I20260709 13:10:33.528331 30643 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:33.509878 30659 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.525692 30669 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.509966 30666 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.514128 30678 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.501017 30648 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.538621 30591 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.545024 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.522955 30644 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.554674 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:33.555388 29668 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.555980 30674 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:33.538421 30662 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.560137 30676 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.560380 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.547228 30648 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.562600 29823 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:33.533816 30658 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.564834 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.533610 30671 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.537112 30659 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.563216 30662 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.542240 30316 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.578377 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.580090 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.580708 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.581270 29819 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.582479 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.582794 30644 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.582908 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.584362 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.586084 30682 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.591713 30591 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.554603 30679 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.592217 30591 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.559814 30629 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.597636 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.601758 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.586719 30682 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.581234 30654 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.583756 30674 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.607506 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:33.568351 30676 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.609649 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:33.611178 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:33.590615 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 56270.1us
I20260709 13:10:33.637737 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.638322 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:33.638903 29818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 440) took 1258 ms. Trace:
I20260709 13:10:33.639598 30666 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.637954 30681 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.645741 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.646507 29819 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.600369 30668 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.654743 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.657408 29669 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.615741 30676 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.659160 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:33.660660 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.661254 29823 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.663102 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:33.660554 30668 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.666921 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:33.667474 29819 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.669098 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:33.670873 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.671074 29669 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.671554 29817 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.672272 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.672698 29822 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.607810 30685 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.611608 30679 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.639336 29818 rpcz_store.cc:276] 0709 13:10:32.363139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.365580 (+  2441us) service_pool.cc:224] Handling call
0709 13:10:33.609243 (+1243663us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b5400173ed4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:33.615363 (+  6120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73245568}
I20260709 13:10:33.678546 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.679531 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:33.679034 29823 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.658686 29820 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
W20260709 13:10:33.673986 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080031d460 after lost signal to thread 30374
I20260709 13:10:33.684757 30591 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:33.674609 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.655051 30674 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.664893 30668 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.676460 30685 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.715178 29669 raft_consensus.cc:1240] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.673676 30644 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.670430 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:33.719678 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.723354 29823 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:33.721993 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:33.724774 30659 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.726722 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:33.728413 30661 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:33.728780 30671 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.688437 30662 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.677281 30638 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.741374 30683 raft_consensus.cc:1064] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:33.741456 30655 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:33.714504 30675 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:33.724889 29815 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.738574 30647 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.746688 30675 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.744232 30684 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.722586 30672 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.664299 30316 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:33.749222 30684 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.754037 29666 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.742910 30686 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.768117 30629 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.721040 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:33.726246 30644 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.764364 30315 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:33.769451 30686 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:33.846339 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:33.777732 30647 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:33.767356 30684 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.886541 30646 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:33.817556 30681 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.790264 30658 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.950174 30685 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.950812 30679 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:33.776237 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 121007us
I20260709 13:10:33.953305 30668 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.853580 30615 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.954759 30638 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.873044 29819 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:33.966739 29666 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:33.951622 30674 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:33.790966 30682 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:33.980451 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:33.904244 30314 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.66:46333 timed out after 1.574s (SENT) [suppressed 1 similar messages]
I20260709 13:10:33.777350 29814 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:34.073642 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:33.972793 30651 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:33.972270 30681 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:34.097748 30649 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:33.981367 30660 consensus_meta.cc:287] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.007s
I20260709 13:10:34.071873 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:34.098779 29820 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:34.105316 30681 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.999125 30686 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:33.972610 30647 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:34.086763 29668 consensus_meta.cc:287] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.531s	user 0.003s	sys 0.007s
I20260709 13:10:34.110457 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:34.075820 30644 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:34.106981 29665 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:34.004797 30639 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:34.122043 29666 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.133800 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:34.107797 30615 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:34.110261 30660 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:34.138614 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:34.119385 30316 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:34.112685 30651 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:34.122017 30649 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:34.148619 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.149258 29670 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:34.120270 29668 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:34.152323 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:34.156100 29672 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:34.156879 29667 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:34.157467 30649 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:34.155167 29821 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:34.161638 30648 consensus_meta.cc:287] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.587s	user 0.000s	sys 0.013s
I20260709 13:10:34.168076 29815 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:34.168808 29817 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:34.170339 30674 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:10:34.171514 30676 consensus_meta.cc:287] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.011s
I20260709 13:10:34.171949 30646 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:34.148924 30639 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:34.184108 30639 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:34.178421 30648 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:34.187866 30648 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:34.205327 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.190241 30676 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:34.209009 29674 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:34.222543 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 113806us
I20260709 13:10:34.224300 30651 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:34.224766 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.226979 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:34.145809 30683 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:34.210223 30669 consensus_meta.cc:287] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.007s
I20260709 13:10:34.229746 29672 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:10:34.201309 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 295978us
I20260709 13:10:34.240530 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.241714 30688 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:34.216755 30648 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.242146 30651 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:34.246920 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.242223 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.222066 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:34.250382 29672 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:34.229645 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.261150 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:34.245790 30688 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:34.259531 29667 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:34.250322 30675 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:34.263079 30676 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:34.267524 30687 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:10:34.252701 30651 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:34.273190 30684 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:34.243289 30669 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:34.265739 30660 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:34.261972 30647 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:34.256516 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:34.259148 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 597597us
I20260709 13:10:34.333997 30669 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:34.338495 30349 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:34.338922 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:34.263839 30688 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.343504 30684 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:34.344173 30684 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.344650 30684 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:34.346225 30615 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:34.347954 30681 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:34.353673 30651 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:34.358243 30347 raft_consensus.cc:1240] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:34.333966 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 85693.1us
I20260709 13:10:34.430423 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:34.437484 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:34.438431 30345 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:34.345510 30684 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:35.152915 30683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.036s	sys 0.058s
W20260709 13:10:35.154819 30688 consensus_meta.cc:287] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.002s
I20260709 13:10:35.163811 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:35.191183 30350 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:35.164044 30681 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:35.177340 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:35.192619 30349 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.183643 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:35.193621 30348 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.185233 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:35.185807 30343 raft_consensus.cc:1240] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:35.195287 30688 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.196475 30346 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:35.205035 30688 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:35.190407 30683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.036s	sys 0.059s
I20260709 13:10:35.374694 30345 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:35.441403 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 933) took 1764 ms. Trace:
I20260709 13:10:35.441980 29822 rpcz_store.cc:276] 0709 13:10:33.676606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.679296 (+  2690us) service_pool.cc:224] Handling call
0709 13:10:33.679784 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:33.680121 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:33.680145 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:33.775712 (+ 95567us) log.cc:844] Serialized 564 byte log entry
0709 13:10:33.961009 (+185297us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:33.961045 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:33.961110 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:35.441063 (+1479953us) raft_consensus.cc:1685] finished
0709 13:10:35.441088 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.441294 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":184980,"threads_started":1,"wal-append.queue_time_us":348985,"wal-append.run_cpu_time_us":2895,"wal-append.run_wall_time_us":1207243}
W20260709 13:10:35.470949 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 524908us
I20260709 13:10:35.538051 29668 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.538769 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 899) took 1343 ms. Trace:
I20260709 13:10:35.539077 29668 rpcz_store.cc:276] 0709 13:10:34.195139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.195869 (+   730us) service_pool.cc:224] Handling call
0709 13:10:35.538686 (+1342817us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:35.551378 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.552949 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.553254 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.553591 29815 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.554361 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.554740 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.555387 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.555830 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.556403 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.556950 29822 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.556874 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.558518 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.559664 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.560454 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.557753 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.561635 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.562057 29822 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.562830 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.563755 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.564700 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.565657 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.566578 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.566844 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.568634 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.568838 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.569541 29668 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.569774 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.570895 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.571759 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.572654 29667 raft_consensus.cc:2393] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:35.575835 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.577729 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.578806 29667 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.567602 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.581981 29822 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.582948 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.583873 29669 raft_consensus.cc:2410] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:35.585104 30347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49706 (request call id 129) took 1844 ms. Trace:
I20260709 13:10:35.585556 30347 rpcz_store.cc:276] 0709 13:10:33.755892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.765665 (+  9773us) service_pool.cc:224] Handling call
0709 13:10:33.821216 (+ 55551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.358757 (+537541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.584849 (+1226092us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400473454. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:35.585014 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229701376}
I20260709 13:10:35.588402 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.588547 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.593207 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.593331 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.594318 29816 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.593338 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 907) took 1328 ms. Trace:
I20260709 13:10:35.594832 29666 rpcz_store.cc:276] 0709 13:10:34.264557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.265951 (+  1394us) service_pool.cc:224] Handling call
0709 13:10:34.266495 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.266659 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:34.266727 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:34.266765 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:34.266792 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:34.266893 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:35.593257 (+1326364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:35.593205 30700 consensus_queue.cc:1059] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:35.595232 29819 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.600328 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:35.607204 29787 connection.cc:256] RPC call timeout handler was delayed by -1.2230193219999137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:10:35.608090 29787 connection.cc:256] RPC call timeout handler was delayed by -1.190619321999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:10:35.608592 29787 connection.cc:256] RPC call timeout handler was delayed by -1.1537193219999153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 13:10:35.610386 30346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 67) took 1273 ms. Trace:
I20260709 13:10:35.611176 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.611866 29744 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.612145 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.612468 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.616601 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.617144 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.618011 30345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 69) took 1134 ms. Trace:
W20260709 13:10:35.618238 29787 connection.cc:256] RPC call timeout handler was delayed by -1.1222193219999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260709 13:10:35.619297 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:35.618716 29787 connection.cc:256] RPC call timeout handler was delayed by -1.0547149679999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:10:35.620582 29787 connection.cc:256] RPC call timeout handler was delayed by -1.0538193219999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
I20260709 13:10:35.621786 30700 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:35.621486 30345 rpcz_store.cc:276] 0709 13:10:34.616538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.618561 (+  2023us) service_pool.cc:224] Handling call
0709 13:10:34.620243 (+  1682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.375258 (+755015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.617739 (+242481us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54004768d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:35.617934 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734572288}
I20260709 13:10:35.622545 30700 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:35.624640 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.624926 30700 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:35.627113 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.610795 30346 rpcz_store.cc:276] 0709 13:10:34.337344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.337513 (+   169us) service_pool.cc:224] Handling call
0709 13:10:34.337840 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.196876 (+859036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.610127 (+413251us) spinlock_profiling.cc:243] Waited 858 ms on lock 0x7b540066f3d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:35.610324 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974259456}
I20260709 13:10:35.629201 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.631368 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.675976 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.683255 29673 raft_consensus.cc:1240] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:35.695392 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.696166 29748 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.699872 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 968) took 2044 ms. Trace:
I20260709 13:10:35.700289 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.697845 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.701953 29745 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.700644 29674 rpcz_store.cc:276] 0709 13:10:33.656131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:33.656244 (+   113us) service_pool.cc:224] Handling call
0709 13:10:33.665730 (+  9486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:34.211186 (+545456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.697196 (+1486010us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540003aa54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:35.699780 (+  2584us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248989440}
I20260709 13:10:35.703192 29746 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.704541 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.706578 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.710130 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.727727 30702 raft_consensus.cc:3055] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:35.726878 30707 consensus_queue.cc:1059] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:10:35.728761 30702 raft_consensus.cc:740] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:35.729703 30702 consensus_queue.cc:260] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.731002 30702 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.732867 30705 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:35.733270 30705 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:35.733748 30707 raft_consensus.cc:1064] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:35.734050 30705 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.735317 30705 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.736544 30707 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:35.761018 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 138806us
I20260709 13:10:35.764430 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.765887 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.766625 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.766896 29672 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.767159 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.767581 29666 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.768085 29670 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.768514 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.769452 29671 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.764207 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.773625 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.774999 29669 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:35.774610 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.776054 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.785557 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.788352 29746 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:35.790778 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:35.792189 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 88195.7us
I20260709 13:10:35.792681 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.797499 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:35.798803 29820 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:35.799115 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:35.802793 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:35.803925 29821 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.807123 30315 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:35.810505 30684 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:35.811071 30684 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:35.811324 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.812338 29743 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:35.812762 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.813707 29744 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:35.813797 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.815268 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:35.815658 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:35.817677 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.818419 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.819072 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.819577 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.834542 29668 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.820571 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:35.830541 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.835964 29669 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.793586 29715 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:35.836182 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:35.837101 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.838263 30345 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:35.839004 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:35.830586 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.837410 30346 raft_consensus.cc:2393] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:35.840240 29665 raft_consensus.cc:2393] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:35.840198 29742 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:35.819749 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 894) took 1705 ms. Trace:
I20260709 13:10:35.844834 29821 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:35.845533 30683 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:35.843783 29570 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 2 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.836078 30684 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.846606 30683 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.850338 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:35.859300 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 95486.9us
I20260709 13:10:35.862088 30704 raft_consensus.cc:1064] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:35.858481 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.865523 29671 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:35.858521 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:35.867549 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 74223.9us
I20260709 13:10:35.867892 30706 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:35.868417 30706 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:35.868911 30706 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:35.870250 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 43953.8us
I20260709 13:10:35.872524 29671 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:35.843729 29673 rpcz_store.cc:276] 0709 13:10:34.140084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.145218 (+  5134us) service_pool.cc:224] Handling call
0709 13:10:34.148641 (+  3423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.683845 (+1535204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.819144 (+135299us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001004d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:35.819528 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3528645120}
I20260709 13:10:35.874440 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:35.875500 29665 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:35.876209 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.876946 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.877705 29817 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:35.868886 29715 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:35.883914 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.884833 29674 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.888825 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.889364 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.890172 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:35.892297 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.893034 29747 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:35.894253 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:35.894870 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.896610 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.897423 29747 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:35.902376 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:35.892346 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:35.866636 30704 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.912560 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:35.913803 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 45236.2us
I20260709 13:10:35.914626 30703 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.914922 30709 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:35.915859 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.916319 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.916296 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.917404 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.917682 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.918310 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.926258 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.926403 29667 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.922423 30709 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:35.922183 30703 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:35.923152 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.930346 29668 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.927377 30709 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.934316 29715 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:35.935016 30702 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.936265 30710 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:35.936800 30708 consensus_queue.cc:1059] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:35.930039 30706 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.923871 29669 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:35.946854 29674 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:35.952006 30695 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:35.952548 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.953291 29668 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.937651 30703 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:35.936796 30710 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:35.935761 30702 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.973320 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.973434 30316 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:35.974300 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.975067 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:35.974323 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.962836 30710 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.979758 30684 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:35.983134 30683 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:35.982919 30715 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:35.984375 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.985658 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:35.988207 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 76044.3us
I20260709 13:10:35.992062 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.990967 29665 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.994320 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:35.996691 29667 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.998778 29672 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:35.998999 29669 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:35.986130 30711 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:10:35.999253 30715 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:36.002358 30715 raft_consensus.cc:697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:36.002171 30709 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.006628 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.007359 30709 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:36.012624 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.013394 29669 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:36.017345 30702 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:36.024731 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:35.989558 30315 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:10:36.027920 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 71930.4us
I20260709 13:10:36.018841 30708 raft_consensus.cc:3055] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.029462 30708 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:36.007978 30715 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.039659 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.030675 30708 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.038981 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:36.034812 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 61622.1us
W20260709 13:10:36.046865 30314 leader_election.cc:336] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Timed out: RequestConsensusVote RPC to 127.27.229.66:46333 timed out after 1.574s (SENT)
I20260709 13:10:36.037715 30713 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.047962 30713 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:36.048307 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58326.1us
I20260709 13:10:36.047017 30719 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:36.036880 30705 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:10:36.051761 30699 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.048358 30684 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.060669 29669 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:36.059928 30719 raft_consensus.cc:697] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:36.066098 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.066902 29665 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:36.060789 30706 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:36.069635 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:36.069881 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.070394 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.070626 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.069669 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.075305 29672 raft_consensus.cc:2393] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:36.075249 29673 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:36.063584 30699 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.089637 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.090737 30717 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.066838 30719 consensus_queue.cc:237] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.091410 30708 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.092047 30713 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.076195 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:36.119254 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 79963.6us
I20260709 13:10:36.135444 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.150837 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.093992 29668 raft_consensus.cc:1240] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.096741 30717 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:10:36.157285 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.158638 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.166342 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.167284 29670 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:36.176478 29669 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:36.176637 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.182036 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:36.175472 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 81869us
I20260709 13:10:36.151238 30705 consensus_queue.cc:1243] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 121060c6c5b14502957b76fd1dfc7b2d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:10:36.183933 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.170380 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:36.190133 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.193737 30717 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.194336 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.194977 29672 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:36.195302 30717 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.197947 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:36.198385 30723 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:10:36.198714 29670 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:36.200488 30705 consensus_queue.cc:1059] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.199668 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.197091 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.181139 30710 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.204447 30709 raft_consensus.cc:3055] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.205904 30699 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.208525 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.223404 30710 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:36.211443 30709 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:36.225365 30709 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.226426 29667 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:36.188979 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.226838 30709 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.228235 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.229025 30706 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.238709 30706 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:36.240131 30706 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.235793 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.242697 29666 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:36.244037 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.241822 30706 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.246268 30725 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:36.184742 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 217033us
W20260709 13:10:36.255139 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 57853.5us
I20260709 13:10:36.258383 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:36.259735 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.260325 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.262068 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.263058 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.245819 30314 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:36.266189 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.266899 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.267428 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.267326 30314 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:36.270140 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.270524 30712 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:36.270383 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.271332 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.272935 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.274410 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.275154 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.275909 29743 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.276124 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.276477 29742 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.276877 29746 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.277472 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.279093 29748 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.279210 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.270128 30725 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.279995 29743 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.281440 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.282231 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:36.282896 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:36.285019 30709 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:36.287039 30724 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.287448 30724 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:36.288419 30724 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.289656 30724 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.269666 30314 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:36.290305 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.282992 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.298251 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.301512 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.305676 29821 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.305972 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:36.316473 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46917.9us
I20260709 13:10:36.317636 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.319075 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:36.320513 30684 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.321336 30684 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.322022 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.323158 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:36.325338 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.326553 30725 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.327014 30725 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.327437 30725 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.322161 30684 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.330281 30705 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.330430 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:36.325297 29714 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.333549 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:36.336004 30706 consensus_queue.cc:1059] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:36.338973 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.339641 29748 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.330770 30705 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.340451 30705 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.340565 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:36.333580 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.340746 30346 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:36.331087 30684 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:36.346048 29742 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.346437 30710 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.346980 30710 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.347354 30710 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.348479 30726 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:10:36.350519 30727 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.349565 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.351729 30684 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.352219 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.352558 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.353107 29744 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.354264 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.354594 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.355212 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.355307 29742 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.355527 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.339829 30706 raft_consensus.cc:3055] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.356334 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.356631 30706 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:36.356967 29745 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.357623 30706 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.358124 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.358906 30706 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.359160 30705 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.359302 30708 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:36.339656 30347 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:36.349586 30726 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.371341 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.371634 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.372440 29744 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.371330 30726 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:36.373154 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.373831 29748 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.373307 30703 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.376878 30703 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.376919 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.377372 30703 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.380981 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:36.381739 29817 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:36.382140 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 56964.8us
W20260709 13:10:36.382686 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.381094 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.386080 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.374169 30726 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.386296 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.386399 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.387333 30726 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.387882 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:36.388235 29638 connection.cc:256] RPC call timeout handler was delayed by -1.0499307159999489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
W20260709 13:10:36.388648 29638 connection.cc:256] RPC call timeout handler was delayed by -1.0409307159999344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:10:36.388928 29638 connection.cc:256] RPC call timeout handler was delayed by -1.0292307160000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 13:10:36.390084 29817 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.391003 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.391363 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.392151 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.394387 29746 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.394718 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.396333 30725 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.394418 30345 raft_consensus.cc:1240] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.398924 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.381850 29714 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.393131 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.393241 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.393544 29742 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.393800 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.406376 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.406776 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.407091 29746 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.393800 30705 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.373131 30724 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:36.407110 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.408516 29747 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.410534 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:36.411154 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.413291 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.413507 29787 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.414208 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.419005 29823 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:36.410486 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.414224 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.415508 30345 raft_consensus.cc:1240] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.420775 29746 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.417388 30315 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.422120 30719 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.416067 30683 consensus_queue.cc:1059] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.423156 30733 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:36.422400 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.423436 30683 raft_consensus.cc:3055] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.424250 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.385281 30684 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.426234 29748 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.424005 30683 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:36.430197 29787 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.428114 30699 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.433245 30683 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.433820 30699 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.434048 30734 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.434166 29714 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.434659 30734 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.435227 30734 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.435388 30695 consensus_queue.cc:1059] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.427364 30708 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.442207 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.442879 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.443025 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.434593 30683 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.445905 30315 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.449249 29714 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.446979 30725 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.447036 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.447451 30684 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.453302 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.454279 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:36.454885 30707 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.455266 30707 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.455580 30709 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.455960 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.453104 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:36.456739 29742 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.456859 29821 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.457496 30718 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.441184 30699 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.447479 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.446231 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:36.450287 29787 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.448675 30708 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.452718 30724 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:36.447060 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.455612 30707 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.465551 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.466089 29748 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.456015 30709 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.450013 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:36.453034 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.480285 29744 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:36.480922 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:36.483001 29817 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:36.483493 29823 raft_consensus.cc:2393] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
W20260709 13:10:36.484089 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 47724.9us
I20260709 13:10:36.457892 30718 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.483407 30709 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.491364 30695 raft_consensus.cc:3055] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.466845 30708 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.495385 29821 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.498726 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.467041 30684 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.497771 29745 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.500837 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.506561 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.509865 29747 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.510200 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.512229 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.513567 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.515332 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.515027 30710 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:36.516995 30732 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.496264 30718 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.518960 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:36.523326 30717 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:36.525100 29746 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.525840 30717 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:36.527051 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.526072 29820 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:36.523279 30708 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:36.553396 29743 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.554183 30708 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.557128 30717 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.560070 29667 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:36.561862 29820 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:10:36.563048 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 131105us
I20260709 13:10:36.566219 30719 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.567886 30715 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:36.569151 30717 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.570469 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.499020 30695 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:36.505342 30684 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:10:36.578022 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 59714.4us
I20260709 13:10:36.581359 29787 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.595286 29789 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.596933 29740 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.598215 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.602201 29667 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:10:36.603025 29639 connection.cc:256] RPC call timeout handler was delayed by -2.3238847730000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260709 13:10:36.579335 30684 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:36.607347 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 50370.7us
I20260709 13:10:36.618883 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.622107 30696 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.622361 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:36.622598 30696 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.623015 30696 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.623694 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.604645 30732 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:36.625255 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.625854 29639 connection.cc:256] RPC call timeout handler was delayed by -1.254127326999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 13:10:36.628163 29639 connection.cc:256] RPC call timeout handler was delayed by -1.2127273270000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
I20260709 13:10:36.628192 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:36.628558 29639 connection.cc:256] RPC call timeout handler was delayed by -1.1965273270000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 13:10:36.628916 29639 connection.cc:256] RPC call timeout handler was delayed by -1.1551273270000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:10:36.628927 29747 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
W20260709 13:10:36.629262 29639 connection.cc:256] RPC call timeout handler was delayed by -1.140727327000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:10:36.629586 29639 connection.cc:256] RPC call timeout handler was delayed by -1.1182273269999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:10:36.629868 29639 connection.cc:256] RPC call timeout handler was delayed by -1.0930273270000725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 13:10:36.630571 29639 connection.cc:256] RPC call timeout handler was delayed by -1.0813273270000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:10:36.630882 29639 connection.cc:256] RPC call timeout handler was delayed by -1.0363273269999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:10:36.631386 29639 connection.cc:256] RPC call timeout handler was delayed by -1.0120273270000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 13:10:36.636742 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.637310 29789 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.637874 30698 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:36.638067 29844 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd4c0 after lost signal to thread 28568
W20260709 13:10:36.639125 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800082700 after lost signal to thread 29606
W20260709 13:10:36.640434 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800326aa0 after lost signal to thread 29698
W20260709 13:10:36.641610 29844 debug-util.cc:398] Leaking SignalData structure 0x7b080030db00 after lost signal to thread 29773
I20260709 13:10:36.622154 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:36.642678 30741 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:36.630264 30700 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.643292 30700 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:36.643834 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800346ea0 after lost signal to thread 29847
I20260709 13:10:36.623778 30709 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:36.645131 29844 debug-util.cc:398] Leaking SignalData structure 0x7b080034f6a0 after lost signal to thread 30374
W20260709 13:10:36.645403 29844 debug-util.cc:398] Leaking SignalData structure 0x7b080034f6e0 after lost signal to thread 30375
I20260709 13:10:36.643692 30700 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.658560 30718 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.630148 30738 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.658879 30698 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.658581 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.648679 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.663543 29747 raft_consensus.cc:2410] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:36.645673 30709 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.628415 30725 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:10:36.661569 30738 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:36.669512 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.669670 29789 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.670544 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.670918 30702 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.668897 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.664215 30698 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:36.685510 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 49350.2us
I20260709 13:10:36.668574 30738 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.684342 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.689043 30742 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.689181 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.699283 30742 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.699437 29747 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:36.699717 30742 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.691061 30699 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.671341 30702 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.698613 30732 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.685410 30698 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.707538 30699 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.708217 30699 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.708559 30699 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.708886 30699 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.712762 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 76) took 1166 ms. Trace:
I20260709 13:10:36.703400 30702 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.663246 30695 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.705324 30732 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:36.721702 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51221.5us
I20260709 13:10:36.722525 29639 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.710470 30710 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
W20260709 13:10:36.723018 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 281861us
W20260709 13:10:36.732002 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.737905 30738 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.739349 30695 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.741318 30718 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.741160 30707 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.742231 29639 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.724010 30732 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.720686 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.742353 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.752203 29741 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:36.726709 30734 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.747684 30707 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.754119 29742 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:36.764753 30744 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.757071 29740 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:36.754109 29746 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:36.768376 30744 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.799695 30683 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.800177 30683 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.803645 30683 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.803858 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:36.804557 29666 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:36.715487 29570 rpcz_store.cc:276] 0709 13:10:35.540194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.540346 (+   152us) service_pool.cc:224] Handling call
0709 13:10:36.706698 (+1166352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:35.986255 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:36.023148 (+ 36893us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:36.023196 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:10:36.023231 (+    35us) tablet.cc:662] Decoding operations
0709 13:10:36.023696 (+   465us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:36.023796 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:36.023828 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:36.024237 (+   409us) tablet.cc:701] Row locks acquired
0709 13:10:36.024283 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:10:36.024455 (+   172us) write_op.cc:270] Start()
0709 13:10:36.024627 (+   172us) write_op.cc:276] Timestamp: P: 1783602636024401 usec, L: 0
0709 13:10:36.024665 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:10:36.025440 (+   775us) log.cc:844] Serialized 535 byte log entry
0709 13:10:36.192129 (+166689us) spinlock_profiling.cc:243] Waited 979 us on lock 0x7b1800253ea0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69d0522 00007fd9e69d27c1 00007fd9e69d2779 00007fd9e69d2709 00007fd9e69d26d1 00007fd9e69d19cd 000000000038f354 000000000038f199 00007fd9e69b383a
0709 13:10:36.361909 (+169780us) op_driver.cc:464] REPLICATION: finished
0709 13:10:36.580428 (+218519us) write_op.cc:301] APPLY: starting
0709 13:10:36.600334 (+ 19906us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:36.614038 (+ 13704us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:36.614081 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:36.617317 (+  3236us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:36.617568 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:10:36.617631 (+    63us) write_op.cc:312] APPLY: finished
0709 13:10:36.682669 (+ 65038us) log.cc:844] Serialized 22 byte log entry
0709 13:10:36.689237 (+  6568us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:36.689325 (+    88us) write_op.cc:454] Released schema lock
0709 13:10:36.689377 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:36.689820 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:36.689855 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":148578,"apply.run_cpu_time_us":2779,"apply.run_wall_time_us":122712,"num_ops":1,"prepare.queue_time_us":136208,"prepare.run_cpu_time_us":15809,"prepare.run_wall_time_us":76810,"raft.queue_time_us":148743,"raft.run_cpu_time_us":15818,"raft.run_wall_time_us":122167,"replication_time_us":306974,"spinlock_wait_cycles":2251648,"thread_start_us":320186,"threads_started":4,"wal-append.queue_time_us":39795}]]}
I20260709 13:10:36.794178 30744 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.818224 29821 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:36.813868 30733 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:36.822285 30733 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:36.822679 30733 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:36.823043 30733 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:36.834440 29748 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:36.838631 30738 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.842309 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.866654 29748 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:36.838647 30734 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.883955 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.884791 29745 raft_consensus.cc:2393] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:36.887319 30684 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:36.889986 30719 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:36.891880 30702 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.894268 30684 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.894289 30702 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.903457 30683 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:36.910848 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:36.894253 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.918809 30742 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.921095 30742 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.905671 30683 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.925733 30700 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.927913 30700 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.936012 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:36.936694 30684 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:36.938095 30684 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.939137 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:36.945012 30703 consensus_meta.cc:287] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.567s	user 0.004s	sys 0.007s
I20260709 13:10:36.945430 30703 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.932613 30699 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.947515 30703 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.947371 30733 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.948854 30744 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.932925 30732 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.949090 30719 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:36.951025 30744 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:36.951481 30732 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.947744 30699 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.960255 30698 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.962479 30698 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:36.963439 30696 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:36.965363 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:36.968897 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.970965 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.971642 29742 raft_consensus.cc:2376] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
W20260709 13:10:36.976827 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 252359us
I20260709 13:10:36.977803 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:36.978891 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:36.979542 29747 raft_consensus.cc:2376] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:36.981276 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:36.981950 29748 raft_consensus.cc:2376] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:36.972813 30684 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:36.998203 30733 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:37.002066 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.004341 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.001613 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:37.006942 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 264796us
I20260709 13:10:37.010811 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.013603 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.006837 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.014626 29639 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.017704 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.019105 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.019711 29747 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:37.009290 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.009236 29742 raft_consensus.cc:2376] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:37.015813 30346 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.026064 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.024395 30744 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.029314 29639 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.032847 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.043174 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.044617 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:37.045511 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.052600 29639 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:37.053007 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 75254.5us
I20260709 13:10:37.053751 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.054019 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.042919 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.031975 30744 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.054355 29744 raft_consensus.cc:2376] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:37.064380 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.062505 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.065555 29748 raft_consensus.cc:2376] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:37.066715 29639 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.069010 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.068765 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.071049 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.071466 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.072152 29748 raft_consensus.cc:2376] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:37.072966 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.075737 30742 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.076174 30742 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.076531 30742 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.073942 30733 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.077378 30733 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.077757 30733 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.078284 30754 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.078732 30754 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.079098 30754 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.081360 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.082532 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.083961 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.064641 30744 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.087800 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.054958 30753 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.086782 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.062005 30751 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.067927 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.068910 30696 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:37.090530 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.092724 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.094455 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.095048 29821 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.102491 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.110881 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.111415 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.111985 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.074559 30695 consensus_queue.cc:1059] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:10:37.111557 29747 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:37.089579 30753 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.093176 30699 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.119419 29639 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.103382 29748 raft_consensus.cc:2376] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:37.123027 29821 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:37.118489 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.110400 30755 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:10:37.128497 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.092240 30751 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.110515 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.109427 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.138288 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.136747 30750 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.134904 30742 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:37.141273 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.143610 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.127321 29740 raft_consensus.cc:2376] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:37.148696 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:37.147176 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 76023.3us
I20260709 13:10:37.118824 30753 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:37.166077 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 84778.7us
I20260709 13:10:37.168260 29748 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:37.171474 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.172480 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.176738 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.138513 30751 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:37.180959 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 86746.6us
I20260709 13:10:37.184109 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.186260 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.144316 30702 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.144526 29741 raft_consensus.cc:2376] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2. Re-sending same reply.
I20260709 13:10:37.206728 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.189870 29787 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.188508 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.209607 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.210434 29747 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:37.211206 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.212441 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.213529 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.168569 30315 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.238209 30702 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:37.241849 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 53416.6us
W20260709 13:10:37.243662 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53858.6us
I20260709 13:10:37.245262 29787 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.246814 29789 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:37.250603 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.226236 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.242545 30684 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.237179 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:37.254931 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 145815us
I20260709 13:10:37.254808 30738 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.260042 30683 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.260870 30733 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.262454 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:37.241964 30762 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.246395 30734 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:37.281749 30734 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.281510 30754 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:37.282130 30734 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.283864 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.284199 30754 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:37.286008 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 101205us
I20260709 13:10:37.269886 29787 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.270880 30742 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.267470 30738 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.267263 30758 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.275367 30684 raft_consensus.cc:697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:37.292680 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.293314 29819 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:37.246675 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 103988us
I20260709 13:10:37.294245 29820 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.296182 29819 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.296543 30742 consensus_queue.cc:1059] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.297592 30742 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.298447 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.264425 30703 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:37.277302 30346 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.267766 30683 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.300207 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.300956 29819 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:37.281339 30762 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.293579 30684 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.302253 30762 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.302750 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.303824 29638 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.300485 30703 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:37.304847 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:37.305104 30703 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.308714 29820 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.309325 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.309948 29819 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.310340 29816 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.311797 29817 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.300557 30683 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.269510 30753 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.316002 30753 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.316102 29822 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.316636 30753 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.280968 30733 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:37.331444 29819 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
W20260709 13:10:37.184640 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 48561.8us
I20260709 13:10:37.291880 30738 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.292574 29823 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:37.317584 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.319787 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.320257 29816 raft_consensus.cc:1240] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.290931 30754 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.322659 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.323588 29818 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.280433 30744 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:37.326474 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 56634.2us
I20260709 13:10:37.360706 29817 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.361021 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.326974 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.328912 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:37.363492 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:37.321448 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:37.324306 30742 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:10:37.355620 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 49677.1us
I20260709 13:10:37.357645 29822 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:37.331311 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.330629 30753 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:37.367527 29638 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:37.382447 29815 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:37.382640 29821 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:37.383787 30744 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.367678 30768 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.386848 30702 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.357965 30765 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:37.391345 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 99821.5us
I20260709 13:10:37.320273 30703 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.394002 29817 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:37.395812 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.396880 29639 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.400992 30767 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.401566 30767 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.402520 30767 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.366344 30717 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.358565 30699 consensus_queue.cc:1059] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:10:37.366485 30707 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.417440 29787 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:37.394840 30753 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.388249 30765 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:37.396378 30744 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.392619 30733 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:37.432624 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 65186.6us
I20260709 13:10:37.390949 30718 consensus_queue.cc:1059] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:10:37.367084 30695 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:10:37.436098 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 62245.9us
I20260709 13:10:37.419831 30752 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.434108 30771 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.450767 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:37.390502 30742 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.433936 30765 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.452461 30771 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.440428 30768 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.489351 30771 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.490438 30773 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:37.496901 30742 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.439880 30717 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:10:37.483842 30695 raft_consensus.cc:3055] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:10:37.508186 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 52963.3us
I20260709 13:10:37.513394 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.508515 30695 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:10:37.515259 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 123242us
I20260709 13:10:37.515030 30695 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.516052 29639 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.516721 30695 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.517681 29639 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.518922 29639 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.484513 30738 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.500922 30718 raft_consensus.cc:3055] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.499372 30751 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.528247 30699 raft_consensus.cc:2764] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:37.530676 30718 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:37.505153 30772 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:37.527726 30734 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.541131 30767 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.554265 30767 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.554755 30767 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.554975 30761 raft_consensus.cc:3055] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.555445 30761 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.531724 30773 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:10:37.559130 29639 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:37.566015 30775 log.cc:927] Time spent T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:37.565959 29639 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:37.561301 30758 raft_consensus.cc:3055] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.568462 30758 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:37.569396 30758 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.572063 30783 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.572562 30758 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.551380 29820 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.552117 30703 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:37.554313 30774 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.541829 30683 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.533579 29667 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:37.588367 30777 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.588856 30777 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.586236 30774 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.590896 29822 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:37.591735 29570 catalog_manager.cc:5697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.581552 30346 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.590386 30774 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.604341 30744 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.596242 30718 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.625144 30718 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.556802 30768 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.620036 29570 catalog_manager.cc:5697] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 2, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 2 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:37.639243 30744 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.584702 30761 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.596745 30762 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:37.655093 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 204402us
I20260709 13:10:37.621618 30753 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.660185 30772 consensus_queue.cc:1059] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.663247 30784 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.589813 30777 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
W20260709 13:10:37.685011 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 229218us
I20260709 13:10:37.658782 30738 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:37.685897 29638 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:37.673830 30751 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.685897 30783 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.681346 30765 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.714432 30710 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.715592 30710 consensus_queue.cc:1059] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:37.716650 30710 raft_consensus.cc:3055] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.717031 30710 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:37.715830 30765 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.690564 30784 raft_consensus.cc:3055] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.714679 30776 raft_consensus.cc:3055] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.721172 30776 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:37.720937 30710 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.719836 29714 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:37.719718 30784 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.704959 30732 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:37.724752 30777 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.724844 30784 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.711452 30751 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.718374 30683 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.738193 30684 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:37.720845 30791 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.748793 30684 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.754325 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:37.756170 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:37.757011 29818 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:37.758178 30781 raft_consensus.cc:3055] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.758663 30781 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:37.753778 30684 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.738608 30784 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.759729 30781 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.764599 30781 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.738483 30751 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.768635 30718 consensus_queue.cc:1059] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:37.722045 30776 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.719408 30786 consensus_queue.cc:1059] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:10:37.779762 30786 consensus_queue.cc:1243] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Peer 121060c6c5b14502957b76fd1dfc7b2d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:10:37.782696 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 96917.8us
I20260709 13:10:37.784931 30751 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:37.795812 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 162276us
I20260709 13:10:37.803346 30789 raft_consensus.cc:3055] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.803772 30791 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:37.805343 30791 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.783515 30762 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.786697 30753 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:37.818107 29715 leader_election.cc:336] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.566s (SENT)
I20260709 13:10:37.807576 30776 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.803785 30789 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:37.818979 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:37.830538 29715 leader_election.cc:336] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.584s (SENT)
I20260709 13:10:37.830987 29715 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.833165 30787 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.834017 30787 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:37.845634 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 125877us
W20260709 13:10:37.847011 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 286732us
I20260709 13:10:37.847815 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:37.808130 30774 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.787358 30783 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.852600 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:37.863683 29744 raft_consensus.cc:1240] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:37.866137 29639 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:37.866801 29715 leader_election.cc:336] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.627s (SENT)
I20260709 13:10:37.872745 30790 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.868671 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.877223 29638 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:37.877517 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.832453 30771 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.863138 30796 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:10:37.856334 30789 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.866923 30751 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.892182 29638 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:37.894025 29715 leader_election.cc:336] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.654s (SENT)
I20260709 13:10:37.894484 29715 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.878803 30753 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.867866 30718 consensus_queue.cc:1059] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:10:37.880393 29665 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
W20260709 13:10:37.906020 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 55061.2us
I20260709 13:10:37.907995 29639 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:37.889950 30695 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.897985 30762 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.879761 30767 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.913133 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.898901 30751 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:37.916129 29748 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.884991 30792 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.920687 30792 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:37.923527 29638 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:37.924909 30771 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.906654 30789 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.900177 30791 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.906296 30787 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.886940 30778 consensus_queue.cc:1059] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:10:37.918690 30683 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.918701 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:37.916636 30742 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:37.914510 30753 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:10:37.930087 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.930090 30718 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:37.931559 29821 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:37.943815 29715 leader_election.cc:336] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.703s (SENT)
I20260709 13:10:37.944205 29715 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.935542 29748 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:37.935498 29745 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:37.951318 30732 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:37.951911 30732 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:37.939442 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:37.944861 30771 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:37.945571 30719 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:37.956431 29715 leader_election.cc:336] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.714s (SENT)
I20260709 13:10:37.959479 30774 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.959733 30802 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.962280 30683 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:37.962604 30772 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:37.963068 30772 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:37.963608 30683 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:37.963836 29638 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:37.963222 29639 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:37.964522 30683 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.965884 30744 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.966645 30753 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:37.976652 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:37.986774 29715 leader_election.cc:336] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.742s (SENT)
I20260709 13:10:37.987275 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:37.955750 30771 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:37.921702 30792 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:37.990875 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:37.991664 30346 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:37.990029 30771 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:37.996732 29741 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:37.964079 30772 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.000329 30684 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.007200 29715 leader_election.cc:336] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.758s (SENT)
I20260709 13:10:38.007722 29715 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.000991 30684 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.009346 30798 raft_consensus.cc:3055] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.009835 30798 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.010738 30684 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:38.014813 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.017307 30802 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.013173 30781 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:37.977533 30767 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:37.976438 30751 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:38.025645 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.027247 29744 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:38.010759 30798 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.030550 30717 raft_consensus.cc:3055] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.030985 30717 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.016093 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.039551 30761 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.041538 30314 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:38.043092 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 79947.8us
W20260709 13:10:38.043860 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 132724us
W20260709 13:10:38.044343 29715 leader_election.cc:336] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.759s (SENT)
I20260709 13:10:38.045044 29714 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:38.029296 30732 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.046308 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.045353 29640 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:38.031128 30798 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.046654 29714 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:38.047313 30776 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:10:38.049214 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 72676.1us
I20260709 13:10:38.049360 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.049681 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.050030 29638 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.050863 29666 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.051487 29674 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.052022 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.052924 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.053004 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.053428 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.053975 29672 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.047043 30684 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.057049 29666 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.059474 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.057031 29674 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.046456 30796 raft_consensus.cc:3055] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.059242 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.061894 29669 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.060303 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.045730 29741 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:38.047679 30767 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.061586 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.049360 30802 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.065997 29674 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.062841 29673 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.062165 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.063794 29672 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:38.055418 30781 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.053818 30774 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.068596 29670 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.070062 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.053284 30776 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.057130 30751 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.057308 30777 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.096710 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.072846 30774 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.119279 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.119287 30774 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.062541 30796 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.130278 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.061347 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:38.166253 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.174871 29666 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.175511 29673 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.177414 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.178529 29673 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.055155 30717 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.180694 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.183082 29674 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.187937 30707 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.192584 30789 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.193397 30710 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.195436 30732 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:38.188009 30802 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.203502 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.207928 29638 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:38.222252 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.193035 30789 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.302210 29667 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:38.256275 30717 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.206887 30751 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.202767 30802 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.178136 30776 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:38.231848 30684 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.292023 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 84189.9us
I20260709 13:10:38.292833 30782 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.301340 30774 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:38.183085 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 88036.8us
W20260709 13:10:38.309180 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.302265 30719 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.304045 30789 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.335351 29742 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.330668 30771 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.337334 30734 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:38.337450 30771 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:38.339361 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.342433 29672 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.333725 30719 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:38.344512 30804 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:10:38.344873 30719 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:38.315375 30796 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.312417 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.350455 30796 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.355197 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.356030 29665 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
W20260709 13:10:38.360993 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48640.1us
I20260709 13:10:38.361841 30316 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:38.363931 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.364904 30719 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.376070 30774 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:38.362417 30771 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.362066 30802 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:38.370361 30719 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.381053 29638 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:38.381822 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.383008 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.383626 29715 leader_election.cc:336] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.800s (SENT)
I20260709 13:10:38.384007 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.380321 30783 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.381289 30719 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:38.412638 29715 leader_election.cc:336] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.824s (SENT)
I20260709 13:10:38.382438 30781 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:10:38.415961 29715 leader_election.cc:336] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.833s (SENT)
I20260709 13:10:38.414103 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.416616 29715 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.420222 30807 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.422649 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.423368 29665 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.424203 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.424585 29665 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:38.425287 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.425628 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.426075 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.426505 29665 raft_consensus.cc:2410] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:38.426666 29669 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:38.427520 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.426395 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.429586 29671 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.424839 29673 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.407960 30771 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.438293 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.444126 29672 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
W20260709 13:10:38.444953 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 391090us
I20260709 13:10:38.409394 30802 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.445675 29670 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:38.448359 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.449358 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:38.449705 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.451778 29715 leader_election.cc:336] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.864s (SENT)
I20260709 13:10:38.452270 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.453687 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.455987 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.438197 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.459412 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.460021 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.460462 30776 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.464537 29821 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.466637 29814 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.467281 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:38.467522 29815 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:38.470121 30734 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.452828 30684 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:38.479206 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:38.448099 29668 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:38.494310 30696 raft_consensus.cc:3055] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.494781 30696 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:38.495023 29668 raft_consensus.cc:1240] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.496351 29668 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.456362 30717 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.457589 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 43584.9us
W20260709 13:10:38.482880 29715 leader_election.cc:336] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.872s (SENT)
W20260709 13:10:38.499046 29715 leader_election.cc:336] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.895s (SENT)
I20260709 13:10:38.499454 29715 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:38.500492 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.500955 29715 leader_election.cc:336] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.973s (SENT)
I20260709 13:10:38.501310 29715 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.444722 30768 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.486835 29822 raft_consensus.cc:1240] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:38.487982 29742 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.488132 29666 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:38.443419 30810 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:10:38.487658 30734 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.490654 30725 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.491225 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:38.459208 30719 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:38.497385 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.507148 29673 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.520174 29669 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:38.465791 30738 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:38.505029 29672 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.507172 29670 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:38.504545 29715 leader_election.cc:336] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.994s (SENT)
I20260709 13:10:38.505362 29666 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.507658 29638 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.504340 30684 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.513396 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.516600 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.503187 30802 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.496344 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.501883 29668 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.548976 29668 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.550525 29668 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.551697 30811 consensus_queue.cc:1059] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:38.552291 29667 raft_consensus.cc:2368] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:38.553066 29673 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.553647 30753 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.555182 30789 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.495671 30696 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.559875 30734 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:38.560103 30696 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.540699 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.561749 30813 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:38.562311 30752 consensus_queue.cc:1175] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "121060c6c5b14502957b76fd1dfc7b2d" responder_term: 2 status { last_received { term: 2 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 2 index: 4 } }
W20260709 13:10:38.559283 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 51681.4us
I20260709 13:10:38.503062 30807 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.566268 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:38.567426 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62901.8us
W20260709 13:10:38.570045 29715 leader_election.cc:336] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 2.015s (SENT)
I20260709 13:10:38.508037 30717 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.521322 30776 consensus_queue.cc:1059] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:10:38.541345 30707 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:10:38.572676 29715 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.542019 30725 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.544114 30738 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.576174 30717 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:38.522547 30781 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.591980 30810 raft_consensus.cc:3055] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.591786 30811 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.571084 30796 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:10:38.602692 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 125838us
I20260709 13:10:38.606921 29787 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:38.613242 29821 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.613548 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.614428 29817 raft_consensus.cc:2393] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.617616 29638 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.604218 30772 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:38.621973 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51979us
I20260709 13:10:38.619769 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.603219 30810 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:38.646750 30810 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.648367 30810 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.651885 30719 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:38.652541 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.653138 29670 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.621829 30792 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.656383 29671 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:38.659497 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.660373 29818 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.661440 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.662411 29818 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.606712 30811 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.663422 30811 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.625134 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.663977 29670 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:38.626296 30738 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:38.626921 29822 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.619079 29787 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:38.632112 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:38.634277 30684 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:38.634595 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.668282 30738 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.668243 30784 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:38.618140 30816 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.667724 29639 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.669196 30816 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:38.669406 30784 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.669832 30784 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:38.668582 29672 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.670184 30816 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.670647 30784 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.671836 30784 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.637781 30707 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.671962 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.672744 30771 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.673115 30738 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:38.644081 30802 raft_consensus.cc:3055] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.673611 30802 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.674523 30802 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.675606 30802 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.644220 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:38.610255 30346 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:38.651714 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:38.663393 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.631330 29742 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:38.620712 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.670118 30683 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.682219 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:38.685602 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 61000.6us
W20260709 13:10:38.687377 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.666817 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.666922 30316 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:38.666275 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 491519us
I20260709 13:10:38.688062 29822 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.687291 29639 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.688925 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.689278 30783 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.690101 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.690944 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.691121 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.691713 29821 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.667616 30347 raft_consensus.cc:2368] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:10:38.612319 29820 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:10:38.705806 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.635995 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.668002 30774 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.710551 29823 raft_consensus.cc:2393] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.711057 29822 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.639319 30813 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.672487 30707 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.612859 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:38.712131 30813 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.643292 30725 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:38.677412 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 59877.1us
W20260709 13:10:38.665547 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46560.6us
I20260709 13:10:38.693048 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.697036 30684 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.699436 29818 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.699903 29815 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.700716 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:38.701170 29789 leader_election.cc:400] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:10:38.673988 30738 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.703016 30811 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.708014 29820 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.634994 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.727274 29816 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.708755 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.711722 29823 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:38.637040 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.714473 29822 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.729521 29819 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.713085 30813 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.716777 30707 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:38.717214 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.732507 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.694384 29715 leader_election.cc:336] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 2.028s (SENT)
I20260709 13:10:38.718454 29747 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:38.734874 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.720697 29638 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:38.721886 29789 leader_election.cc:403] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:38.725083 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:10:38.739277 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.743937 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.730414 30774 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:10:38.744854 30345 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:38.746665 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 52288.8us
I20260709 13:10:38.748668 30784 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.749092 30784 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:38.749517 30784 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.728565 30684 raft_consensus.cc:697] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
W20260709 13:10:38.748448 29715 leader_election.cc:336] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 2.069s (SENT)
I20260709 13:10:38.753662 29715 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.725219 30315 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:38.732292 30347 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:38.755453 29787 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.743707 30703 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.758446 29787 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:38.744031 29741 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:38.767961 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.770728 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:38.730826 30817 consensus_queue.cc:1059] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:10:38.780434 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.770228 29749 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:38.757241 30813 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.756839 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:38.759193 30725 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.763900 30778 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.770146 30821 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.795071 29715 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:38.783521 30696 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.804756 29715 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:38.769332 30774 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:10:38.790803 30772 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.802968 30809 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.802500 30783 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.810669 30807 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.814260 30725 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.811594 30696 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:38.826903 29715 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:38.802731 30683 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:10:38.802611 30771 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:10:38.800067 30768 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:10:38.819748 29818 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:38.834256 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 63578.3us
I20260709 13:10:38.812580 30820 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:38.835960 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.836766 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:38.820590 30809 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:38.837829 29787 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:38.825035 30789 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.824259 30807 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:38.827759 30725 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.841599 30710 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:38.814778 30684 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.843194 30809 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.840094 30816 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.866283 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.846403 30807 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.857527 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.884745 29749 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.858294 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.858951 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.859604 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.860462 29745 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.860944 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.860374 30703 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:10:38.848318 30782 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:38.863987 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.865899 30811 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:38.895377 30732 raft_consensus.cc:3055] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.895925 30732 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:38.897567 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.898355 29672 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:38.899515 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.900055 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.900882 29672 raft_consensus.cc:2393] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.856766 30345 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:38.844666 30789 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:38.887053 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.903717 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.900969 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.905807 29747 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:38.905670 29672 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.851675 30710 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:38.906361 30784 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.920593 29674 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:38.914546 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 63228.1us
I20260709 13:10:38.922873 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:38.926810 29715 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:38.927817 30792 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:38.928362 30792 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.929356 30792 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.843500 30820 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.943136 30696 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.954352 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.960366 29668 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.960987 30820 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:38.961294 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.933949 30710 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.962124 29668 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.963218 29668 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.956931 30774 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.965361 30774 consensus_queue.cc:1243] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:38.965828 30774 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.900096 30816 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.966156 30774 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:38.966473 29740 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:38.966925 30774 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.967409 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.967844 30816 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:38.902585 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.968056 30774 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.968665 29667 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.968544 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.969017 30710 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.954228 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:38.970059 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.943940 29789 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.616s (SENT) [suppressed 122 similar messages]
I20260709 13:10:38.970458 29747 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:38.896740 30732 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.971187 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.971566 30732 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.903582 30789 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:38.958346 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.973385 29670 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.975185 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.976366 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.976943 29742 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.977115 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.977758 29671 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.978155 30781 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:38.979162 30781 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.979498 30781 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:38.980023 30778 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.980085 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:38.980846 30345 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:38.980654 30778 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:38.981771 29822 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.983006 30778 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:38.983448 30825 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:10:38.984015 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:10:38.984279 30783 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:38.977629 29640 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:38.984675 30783 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:38.985262 30782 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.985720 30782 raft_consensus.cc:697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:38.986611 30782 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:38.988106 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:38.989215 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.992466 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.993602 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.994176 29745 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:38.994517 29571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 201) took 1129 ms. Trace:
I20260709 13:10:38.995047 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:38.995937 29745 raft_consensus.cc:2410] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:38.996986 29745 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:38.999884 29749 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
W20260709 13:10:39.002076 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.003669 29744 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:39.004791 29666 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:39.005136 29744 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:39.006218 29673 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:39.013311 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.014451 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:39.015182 29744 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:39.016816 29747 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:39.017791 29715 leader_election.cc:400] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:39.018270 29747 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:38.985546 30783 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:38.980263 30781 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.020023 30783 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.020404 29745 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.021549 29745 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:39.022614 29746 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.023913 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:38.994864 29571 rpcz_store.cc:276] 0709 13:10:37.865479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.865623 (+   144us) service_pool.cc:224] Handling call
0709 13:10:38.994365 (+1128742us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38862,"reported_tablets":3}
I20260709 13:10:39.024827 29672 raft_consensus.cc:2393] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:38.989777 30789 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.026789 29669 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:39.027789 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.028630 29667 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.021862 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.019904 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:38.921749 30784 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:38.973574 30809 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.035737 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 77) took 1533 ms. Trace:
I20260709 13:10:39.043560 29748 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:39.044035 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.045045 29748 raft_consensus.cc:1240] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:39.018263 29715 leader_election.cc:403] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.047426 29749 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.048156 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.048601 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:39.049690 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.050303 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.050530 29670 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.052331 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:39.052745 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 62421.7us
I20260709 13:10:39.052561 29674 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.053339 30710 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.053800 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.054719 29670 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.055881 30820 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:39.056398 30820 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:39.040333 29570 rpcz_store.cc:276] 0709 13:10:37.502750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.502901 (+   151us) service_pool.cc:224] Handling call
0709 13:10:39.035667 (+1532766us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:37.896375 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:37.927767 (+ 31392us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:37.927801 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:10:37.927819 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:37.928203 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:37.928281 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:37.928308 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:37.928620 (+   312us) tablet.cc:701] Row locks acquired
0709 13:10:37.928637 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:37.928770 (+   133us) write_op.cc:270] Start()
0709 13:10:37.928891 (+   121us) write_op.cc:276] Timestamp: P: 1783602637928731 usec, L: 0
0709 13:10:37.928913 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:37.929574 (+   661us) log.cc:844] Serialized 981 byte log entry
0709 13:10:38.492385 (+562811us) op_driver.cc:464] REPLICATION: finished
0709 13:10:38.751669 (+259284us) write_op.cc:301] APPLY: starting
0709 13:10:38.754232 (+  2563us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:38.764921 (+ 10689us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:38.803188 (+ 38267us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:38.840983 (+ 37795us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:38.848778 (+  7795us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:10:38.852296 (+  3518us) write_op.cc:312] APPLY: finished
0709 13:10:38.898030 (+ 45734us) log.cc:844] Serialized 28 byte log entry
0709 13:10:38.898215 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.898301 (+    86us) write_op.cc:454] Released schema lock
0709 13:10:38.898339 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:38.898660 (+   321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:38.898689 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":213,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":240350,"apply.run_cpu_time_us":2715,"apply.run_wall_time_us":152238,"num_ops":2,"prepare.queue_time_us":196142,"prepare.run_cpu_time_us":14632,"prepare.run_wall_time_us":77757,"raft.queue_time_us":146548,"raft.run_cpu_time_us":27250,"raft.run_wall_time_us":189225,"replication_time_us":563209,"spinlock_wait_cycles":1792,"thread_start_us":448355,"threads_started":4,"wal-append.queue_time_us":127915}]]}
W20260709 13:10:39.052434 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 69554.9us
W20260709 13:10:39.061214 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.057301 30820 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.069305 29638 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.072507 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.073503 29673 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.080865 29638 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:10:39.083501 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 134589us
I20260709 13:10:39.028497 30789 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.029898 29665 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:10:39.030830 30835 log.cc:927] Time spent T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:39.090080 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:39.047080 30806 log.cc:927] Time spent T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.102s	user 0.001s	sys 0.006s
I20260709 13:10:39.030107 30752 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.996563 30807 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.091394 29744 raft_consensus.cc:1240] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:39.046676 30809 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.069870 30702 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.102977 29638 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.030220 29814 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:39.106316 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:39.089365 30753 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.083062 30683 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.099261 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.099941 30752 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.104620 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:39.114614 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.103677 30796 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:10:39.151458 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 55238.4us
I20260709 13:10:39.167886 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.133948 30752 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.138084 29743 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:39.176230 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:10:39.170253 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 72111.9us
I20260709 13:10:39.141218 30821 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.194540 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.197098 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.198205 29666 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.218392 29669 raft_consensus.cc:2368] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:10:39.174729 30710 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.193846 30717 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.222515 30807 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.193662 30846 consensus_queue.cc:1059] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:10:39.229442 30717 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.248124 30696 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.248898 29743 raft_consensus.cc:1240] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:39.258188 30717 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.234995 29741 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:39.267220 30702 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:39.267764 30702 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.214962 30315 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.248672 30696 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.277683 29742 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:39.286300 30807 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.286870 30807 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.287667 30776 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:39.279006 30781 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.284499 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.285087 30702 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.285688 30789 raft_consensus.cc:3055] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.292057 30789 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:39.293068 30789 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.294498 30789 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.243224 30725 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.301959 29671 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:39.302301 30725 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:39.303417 30347 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:39.289659 29672 raft_consensus.cc:2410] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:39.306380 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.307581 30725 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:39.308557 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 132394us
I20260709 13:10:39.310519 30345 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:10:39.310902 30345 pending_rounds.cc:85] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 2
I20260709 13:10:39.311196 30345 pending_rounds.cc:107] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:10:39.234414 30849 consensus_queue.cc:1059] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:10:39.291711 29668 raft_consensus.cc:2393] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.312428 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:39.324227 30849 raft_consensus.cc:3055] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.316164 30345 raft_consensus.cc:2917] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:10:39.324870 30345 raft_consensus.cc:2889] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:39.326731 30717 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.322057 30702 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:39.292186 30816 raft_consensus.cc:3055] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.323285 30811 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.327200 30807 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:39.327818 30809 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:39.025715 30768 consensus_queue.cc:1175] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "389c080a49494f8fb56c53fa7e6087f3" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:39.321792 29570 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 2, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 2 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.324610 30849 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.275545 30783 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.329142 30696 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:39.330294 29740 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:39.345175 29747 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:10:39.359158 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 268744us
I20260709 13:10:39.336887 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:39.342586 30816 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.365079 29570 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 3, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 3 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.366312 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.344165 30811 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:39.367151 29672 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:10:39.370738 29672 pending_rounds.cc:85] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 2
I20260709 13:10:39.370988 29672 pending_rounds.cc:107] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:10:39.367290 29823 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:39.345644 30774 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:39.370142 29670 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:39.373395 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.372514 29570 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 3, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 3 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.364745 30809 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.378053 29672 raft_consensus.cc:2917] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:10:39.379251 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.379997 30816 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.380520 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.381356 30816 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.381484 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:39.382442 30807 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.382121 30849 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.382925 30807 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.383311 30849 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.383932 29671 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.384521 30809 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.385390 30717 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:39.371598 30811 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.386806 30809 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.386463 30807 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.378512 29672 raft_consensus.cc:2889] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:39.377638 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.402315 29715 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.403427 30807 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.387928 30837 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.407437 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.407976 30752 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.410244 30346 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:39.410761 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.413079 29665 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.415894 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.419731 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.421231 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.421991 29673 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:39.424527 30783 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:39.424960 30783 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.426373 30696 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.426841 30696 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:39.428954 30696 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:39.425719 30783 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.430437 30783 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.434064 30752 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:39.443145 29815 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:39.444489 29666 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:39.444918 30837 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:39.447064 30811 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.451412 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:39.451864 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.453852 30809 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.454597 30809 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.454658 30807 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:39.455101 29667 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:39.451308 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.459478 29666 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:39.460085 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:39.461830 29667 raft_consensus.cc:2410] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:39.465221 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.465873 29673 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:39.469604 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.475809 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.478328 30811 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.479377 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:39.485278 29747 raft_consensus.cc:1240] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:39.486699 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:39.487296 29746 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.487587 29741 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.488852 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:39.494093 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:39.501835 30854 consensus_queue.cc:1059] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:39.503147 30702 raft_consensus.cc:3055] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.503530 30702 raft_consensus.cc:740] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:10:39.503938 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 401025us
I20260709 13:10:39.504379 30702 consensus_queue.cc:260] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.504786 29638 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:39.505848 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 394159us
I20260709 13:10:39.494179 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:39.507016 29743 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.505499 30753 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.508231 30753 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.509892 30702 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.506824 29789 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.514257 30854 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.515074 30734 consensus_queue.cc:1059] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.515808 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.516291 30854 raft_consensus.cc:3055] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.516664 30752 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:39.517097 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.516700 30854 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.518311 30854 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.519624 30854 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.522245 30696 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:39.528640 29746 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:39.529140 30857 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.473578 29740 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:39.546548 29787 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:39.550607 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:39.548266 30782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.017s	sys 0.025s
W20260709 13:10:39.551782 30782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.017s	sys 0.025s
I20260709 13:10:39.551643 30792 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.553249 30734 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:39.540642 29743 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:39.542169 29638 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.555565 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.564580 29715 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.568066 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.569180 29638 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.578773 29638 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:39.580392 29638 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:39.552120 30857 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:39.584707 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.592547 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:39.594019 30853 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.598119 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.599450 30855 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.603263 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.599296 30807 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.610370 29789 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.582988 30792 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.613157 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.592300 30768 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.591913 30774 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.583711 30784 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.609120 30752 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.591442 30734 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.584890 30683 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.594369 30781 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.601110 30717 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.632758 30774 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.633435 30859 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.633736 30774 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.631029 30734 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.620159 30858 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.614404 30732 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.609289 30807 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.619091 30779 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.627347 29818 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:39.629050 29787 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:39.620235 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.611842 30816 consensus_queue.cc:1059] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:10:39.622754 30855 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:10:39.628615 30768 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.663511 29638 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:39.645825 30807 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.646448 30809 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:39.675197 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 55006.7us
I20260709 13:10:39.676082 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.676600 30809 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.677469 30854 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.678596 30784 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.678774 30809 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.679133 30784 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:39.679821 30851 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.680325 30851 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.681173 30851 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.682713 30768 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.683110 29714 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.692518 29714 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.668773 30792 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.656443 30858 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:39.683557 30854 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.683365 30734 consensus_queue.cc:1059] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.684505 30702 consensus_queue.cc:1059] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.681322 30784 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:39.685526 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:39.686261 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:39.687635 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:39.711438 29673 raft_consensus.cc:2410] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:39.698855 30732 raft_consensus.cc:3055] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.702602 30854 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:39.630961 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 121060c6c5b14502957b76fd1dfc7b2d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:39.713063 29819 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.705448 29745 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:39.714834 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:39.715421 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:39.718142 29815 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:39.712443 30732 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.719431 30858 raft_consensus.cc:697] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.719960 30732 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.720352 30858 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.720847 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:39.721449 29817 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:39.722116 30707 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.722396 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:39.722909 29814 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.724210 29639 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:39.725037 30683 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.725395 30683 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.725724 30683 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.726559 29743 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:39.718382 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:39.728523 29822 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:39.730394 29714 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.721345 30732 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.731376 30315 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.739120 30702 raft_consensus.cc:3055] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.739313 30849 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.739621 30702 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.703441 30792 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:39.741009 30734 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:39.741473 30734 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.741740 30792 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:39.708138 30789 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:39.731700 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 100954us
W20260709 13:10:39.727825 30804 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:10:39.767907 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:39.769723 30781 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.710577 30809 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.716480 30346 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.781198 30758 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:10:39.785800 30872 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.786410 30872 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.788224 29666 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.788919 29823 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:39.770660 30820 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:39.770488 30781 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:10:39.752871 30849 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:39.793231 30820 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:39.794220 30820 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:39.796926 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 136693us
I20260709 13:10:39.798192 29638 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:39.802763 29638 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:39.786724 30847 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:39.803958 29638 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:39.802431 30859 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.806252 30783 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.806800 30783 raft_consensus.cc:697] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.806869 30771 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.808878 29638 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:39.812418 30859 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:39.803503 30784 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:10:39.796022 30872 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.821599 30771 raft_consensus.cc:697] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.807919 30809 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:10:39.830403 30859 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:39.834403 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:39.823069 30782 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:10:39.872213 29789 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:39.961401 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 89277.3us
I20260709 13:10:39.962258 29789 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.963420 29789 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.976786 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:39.833333 30849 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:39.996567 30849 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.964689 30778 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.980912 30779 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:39.980563 30732 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.040830 30725 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.041545 30725 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:40.043095 29819 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:39.965378 30783 consensus_queue.cc:237] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.045521 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.046301 29819 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:40.012311 29742 raft_consensus.cc:2410] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:40.008849 30696 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.009058 30857 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:40.007337 29789 leader_election.cc:400] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
W20260709 13:10:40.097326 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 90141us
I20260709 13:10:40.099468 29789 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:40.102232 29823 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.053314 30725 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.065496 30683 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:40.121351 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.122087 29822 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:40.096323 30853 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:10:40.138823 30853 consensus_queue.cc:1243] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:40.116911 30859 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.110002 30847 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.048749 30771 consensus_queue.cc:237] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.118209 30857 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:40.151369 30857 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:40.162112 30683 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.120769 30725 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.177222 30725 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:40.182030 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.182722 29822 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:40.174506 30807 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.185555 30807 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.186620 30346 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:40.192137 30725 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.206883 30702 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.208043 30702 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.287151 30774 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.244863 30683 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:40.289947 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 485146us
I20260709 13:10:40.291159 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:40.291406 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:40.293197 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:40.297178 29669 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.299115 29674 raft_consensus.cc:3055] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:40.299511 29674 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:40.299894 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.300580 29745 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:40.303848 29674 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.304396 30725 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.290529 30683 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.289770 30774 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.331797 29669 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:40.321193 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.322590 30870 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:40.341981 29744 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:40.357983 29670 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:40.372982 29670 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:40.357983 30778 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:40.335484 29742 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:40.342582 30347 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:40.325687 30725 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:40.343989 29715 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.016s
W20260709 13:10:40.407814 29715 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.000s	sys 0.019s
W20260709 13:10:40.408156 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 572166us
I20260709 13:10:40.408440 29745 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:40.372440 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:40.329463 30837 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.031s	sys 0.034s
W20260709 13:10:40.410868 30837 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.031s	sys 0.035s
I20260709 13:10:40.360816 30774 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.373721 29670 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:40.375340 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:40.412897 29747 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.385643 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.413354 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:40.358780 29741 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:40.416214 29673 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:40.371177 30316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.015s
I20260709 13:10:40.395984 30859 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.416800 29749 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:40.370114 30758 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:40.378176 30346 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:40.416301 29670 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.364044 30870 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.379379 30683 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.424330 29638 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:40.425812 30314 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:40.421619 30859 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.431262 30725 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.367107 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:40.418853 30781 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.439463 29749 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.432331 29673 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:40.449446 29747 raft_consensus.cc:2410] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:40.450372 29670 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:10:40.451938 29670 pending_rounds.cc:85] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 4
I20260709 13:10:40.452230 29670 pending_rounds.cc:107] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:10:40.452473 29670 raft_consensus.cc:2889] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.453636 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:40.432773 30316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.005s	sys 0.015s
I20260709 13:10:40.457211 29748 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.456207 29744 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:40.456905 29667 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:40.456954 30878 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:40.449505 30820 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:10:40.442559 30683 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.400454 30778 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:40.454619 30774 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.460801 30881 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.460631 30771 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:10:40.469460 30887 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:40.457345 30884 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.485960 30683 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.471172 30870 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.514425 29740 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:40.466192 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.443106 30879 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.458161 30781 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.517988 30879 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.518633 30879 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.519742 30781 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.495870 30774 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.522516 30774 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.495656 30885 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.474092 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:40.475529 29668 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:40.523913 30885 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.474167 30886 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:10:40.486582 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:40.489655 29745 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.489984 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.490783 29747 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:40.492405 30896 log.cc:927] Time spent T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:10:40.434825 30758 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.513055 30884 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.518157 29742 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:40.524303 30683 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.525828 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:40.571708 29673 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:40.483670 30820 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:40.487792 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 144923us
I20260709 13:10:40.491859 30853 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:40.531770 29746 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:40.465181 30784 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:10:40.505209 30887 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:40.539724 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 53244.7us
I20260709 13:10:40.538887 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.524586 29668 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:40.557675 30888 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.557804 30774 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:40.560317 30782 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.534545 30870 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.561082 30859 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.557583 30778 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:40.530068 30873 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.560206 30758 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:40.566319 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:40.570333 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:40.533315 30734 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.585613 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.619792 29823 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.585539 29817 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.585539 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.589964 29714 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:40.622054 29714 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:40.623453 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:40.590937 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.561736 29742 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:40.594139 29789 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:40.615160 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.627107 29745 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
W20260709 13:10:40.616453 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 105581us
I20260709 13:10:40.619961 29821 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:40.632699 29823 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:40.591866 30888 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.636139 29789 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:40.640166 29821 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:40.592720 30887 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.626724 30858 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:40.616026 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.643074 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.646045 30909 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:40.646394 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.588907 30853 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.616031 30782 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.619254 30870 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.627051 30873 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.626893 30859 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.620816 30881 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:10:40.735200 30882 log.cc:927] Time spent T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:10:40.643949 30758 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.639984 30792 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.663276 29822 raft_consensus.cc:2393] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:40.645387 29740 raft_consensus.cc:2393] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:10:40.734292 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 110925us
I20260709 13:10:40.734318 29817 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:40.736974 29821 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:40.732002 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.729579 30851 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:40.699798 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 82609.8us
I20260709 13:10:40.644701 30888 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.747052 29820 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:40.700279 30858 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:40.768461 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 108009us
I20260709 13:10:40.657126 29668 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.773984 30914 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.767493 30707 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:40.748137 30859 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.769490 29815 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:40.747424 30879 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:40.786966 30914 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.808430 30881 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.833011 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.803728 30707 raft_consensus.cc:697] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:40.833938 29740 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:40.834221 30345 raft_consensus.cc:2368] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:10:40.834865 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.799211 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1033) took 1059 ms. Trace:
I20260709 13:10:40.805739 29668 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.822582 30909 raft_consensus.cc:1064] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:40.835636 29744 raft_consensus.cc:2393] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:40.811283 30872 consensus_queue.cc:1059] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:10:40.814590 30914 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.862723 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 78) took 1554 ms. Trace:
I20260709 13:10:40.864521 30845 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.837132 29814 rpcz_store.cc:276] 0709 13:10:39.730752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.732271 (+  1519us) service_pool.cc:224] Handling call
0709 13:10:39.791488 (+ 59217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.823096 (+ 31608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.824490 (+  1394us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:39.826307 (+  1817us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.249004 (+422697us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:40.439754 (+190750us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.460926 (+ 21172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.464665 (+  3739us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.655867 (+191202us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:40.760207 (+104340us) raft_consensus.cc:1685] finished
0709 13:10:40.771827 (+ 11620us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.789178 (+ 17351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5734,"prepare.queue_time_us":197064,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":16151,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":3243,"spinlock_wait_cycles":2736512,"thread_start_us":535594,"threads_started":2,"wal-append.queue_time_us":674798}
I20260709 13:10:40.859082 30707 consensus_queue.cc:237] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:40.870505 30912 consensus_queue.cc:1175] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "42c443079435463daa8845e244cec9d3" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: [2.2-2.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:40.836804 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:40.810627 30837 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:10:40.863546 29570 rpcz_store.cc:276] 0709 13:10:39.308707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.308863 (+   156us) service_pool.cc:224] Handling call
0709 13:10:40.862648 (+1553785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:39.512358 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:39.512980 (+   622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:39.513013 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:10:39.513033 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:39.513599 (+   566us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:39.513674 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:39.513703 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:39.595108 (+ 81405us) tablet.cc:701] Row locks acquired
0709 13:10:39.600359 (+  5251us) write_op.cc:260] PREPARE: finished
0709 13:10:39.614813 (+ 14454us) write_op.cc:270] Start()
0709 13:10:39.620637 (+  5824us) write_op.cc:276] Timestamp: P: 1783602639612586 usec, L: 0
0709 13:10:39.623771 (+  3134us) op_driver.cc:348] REPLICATION: starting
0709 13:10:39.642031 (+ 18260us) log.cc:844] Serialized 1301 byte log entry
0709 13:10:40.207055 (+565024us) op_driver.cc:464] REPLICATION: finished
0709 13:10:40.464945 (+257890us) write_op.cc:301] APPLY: starting
0709 13:10:40.488040 (+ 23095us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:40.502890 (+ 14850us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:40.520260 (+ 17370us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:40.520787 (+   527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:40.520975 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:10:40.521028 (+    53us) write_op.cc:312] APPLY: finished
0709 13:10:40.521235 (+   207us) log.cc:844] Serialized 34 byte log entry
0709 13:10:40.521409 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:40.521516 (+   107us) write_op.cc:454] Released schema lock
0709 13:10:40.521556 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:40.521941 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:40.521967 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":248199,"apply.run_cpu_time_us":2421,"apply.run_wall_time_us":59642,"num_ops":3,"prepare.queue_time_us":116196,"prepare.run_cpu_time_us":3649,"prepare.run_wall_time_us":130000,"replication_time_us":583121,"thread_start_us":281797,"threads_started":2}]]}
W20260709 13:10:40.881233 30908 log.cc:927] Time spent T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 13:10:40.883369 30906 log.cc:927] Time spent T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:10:40.840727 30907 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.865105 30845 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.846616 30885 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.885099 30880 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.888304 30807 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.883594 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:40.895138 30902 log.cc:927] Time spent T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.246s	user 0.000s	sys 0.003s
I20260709 13:10:40.896826 29818 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.899730 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 543) took 1078 ms. Trace:
I20260709 13:10:40.887344 30858 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:40.898072 30807 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.908062 30845 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.908875 30807 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.909790 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.895529 30870 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:40.883641 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 48277.9us
I20260709 13:10:40.883745 30913 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 13:10:40.908776 30845 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.915272 29639 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:40.894137 30884 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.940572 29639 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:40.895471 30811 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:10:40.963424 29671 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:40.963850 29671 pending_rounds.cc:85] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:40.964097 29671 pending_rounds.cc:107] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:40.964365 29671 raft_consensus.cc:2889] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.966364 30913 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.898238 30880 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:40.897284 30907 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.969231 30734 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.974983 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:40.959815 30870 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:40.975826 29816 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:40.934092 30783 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:10:40.962208 30884 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:40.994565 30910 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:40.971129 30725 raft_consensus.cc:3055] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:40.936667 30885 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:10:40.970453 30886 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.002454 30872 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.005682 29667 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:41.009361 30782 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.009864 30879 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.025661 30879 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.026232 30879 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.028970 30879 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.010588 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:41.030285 29747 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.010972 30725 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:40.944916 30845 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:40.972656 30859 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:40.973147 30880 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.966869 30913 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:40.985873 30870 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:41.043673 29747 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:41.025678 30872 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.059450 30872 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.046274 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:40.973765 30873 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.051015 30907 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.050856 30725 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.062048 29748 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:41.074206 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.075013 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.075289 29747 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:41.076869 29638 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:41.078603 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.080025 29749 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.055801 30870 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.083353 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.078640 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.086012 29638 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:40.900142 29743 rpcz_store.cc:276] 0709 13:10:39.821201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.821362 (+   161us) service_pool.cc:224] Handling call
0709 13:10:39.826227 (+  4865us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.304703 (+478476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.306936 (+  2233us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.344502 (+ 37566us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.512418 (+167916us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:40.596720 (+ 84302us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.641400 (+ 44680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.641496 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.899475 (+257979us) raft_consensus.cc:1685] finished
0709 13:10:40.899499 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.899651 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39678,"prepare.queue_time_us":53122,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":3442,"raft.queue_time_us":157157,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":17418,"thread_start_us":553216,"threads_started":2,"wal-append.queue_time_us":178576}
I20260709 13:10:41.098047 30783 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:41.098485 30783 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:41.098865 30783 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.087567 30782 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.099509 30782 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.102346 30853 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.091887 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.093830 30845 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:41.097034 30683 consensus_meta.cc:287] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.002s
W20260709 13:10:41.097473 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 121060c6c5b14502957b76fd1dfc7b2d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:41.102226 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.104737 30888 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.101693 30782 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.122222 30871 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.053201 30886 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.106154 29668 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:41.142334 30725 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:41.152107 30852 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:41.163578 30888 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:41.118710 30683 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.109445 29638 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:41.102563 29572 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.170614 30683 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.104616 29674 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.171981 30884 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.172201 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:41.172860 29816 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:41.170027 29572 catalog_manager.cc:5697] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.116334 29818 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
W20260709 13:10:41.177935 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.134817 30886 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.152501 30914 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.135416 30913 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:41.194433 29674 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:41.195740 29674 pending_rounds.cc:85] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:41.196398 29674 pending_rounds.cc:107] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:41.197010 29674 raft_consensus.cc:2889] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.174439 29572 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:41.200440 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 91060.5us
I20260709 13:10:41.200215 29572 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.200994 29640 leader_election.cc:400] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:10:41.202936 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:41.188195 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:41.123950 30887 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.180936 30854 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.212852 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:41.213414 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.213574 29746 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.214135 29749 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:41.216220 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.216938 29745 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:41.206717 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:41.234371 29747 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.211313 30346 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:41.203784 29820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5444d738efbb44128f4f34da83448b15"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:41.248458 29820 raft_consensus.cc:606] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:41.248878 29820 raft_consensus.cc:614] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.249758 29640 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:41.250666 30852 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:41.207903 30880 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.251034 30852 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.255137 29746 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:41.256036 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:41.266589 30883 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.273165 30870 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.207214 30783 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.250500 30915 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.215449 30912 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:10:41.252032 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.221510 30854 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.254757 30852 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.254565 29814 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
W20260709 13:10:41.208531 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 469354us
I20260709 13:10:41.297670 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:41.297663 29789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.023s	sys 0.083s
I20260709 13:10:41.312914 29742 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:41.314039 29820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
W20260709 13:10:41.322469 29789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.023s	sys 0.083s
I20260709 13:10:41.300871 30913 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:41.328183 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 692086us
I20260709 13:10:41.328924 29638 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:41.334880 29746 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.342873 30752 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:41.323845 30776 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.334679 30913 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.334192 30872 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:41.340776 29820 raft_consensus.cc:606] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:41.344527 30886 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.342923 30916 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:41.344262 30807 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:41.340999 30683 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:10:41.350138 30915 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.308622 30883 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.383709 30782 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.378804 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:41.419533 29746 raft_consensus.cc:2368] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4.
I20260709 13:10:41.349800 30884 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:10:41.362656 30872 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.424351 30872 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.361887 30913 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:41.418352 29669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.021s	sys 0.060s
I20260709 13:10:41.421934 30314 leader_election.cc:400] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4.
I20260709 13:10:41.373782 30914 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:41.427803 30314 leader_election.cc:403] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:10:41.429411 29669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.021s	sys 0.060s
I20260709 13:10:41.432888 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:41.385205 30886 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:41.359613 30776 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.434912 29746 raft_consensus.cc:2368] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3.
W20260709 13:10:41.435195 29787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.030s	sys 0.100s
W20260709 13:10:41.446501 29787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.033s	sys 0.101s
I20260709 13:10:41.449396 30314 leader_election.cc:400] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3.
I20260709 13:10:41.449777 30314 leader_election.cc:403] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.456771 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.461403 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:41.467906 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.416363 30807 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.491353 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:41.457612 29746 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:41.494803 29746 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.498317 29745 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:41.435611 30837 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.453787 30820 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.432879 30817 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:10:41.424876 30782 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:41.428709 30915 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.423019 30858 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:10:41.451833 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:41.539039 30851 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.547952 29749 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:41.505654 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:41.500842 30849 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.557425 29638 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:41.506035 30887 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.425257 30916 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.568095 30846 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.546545 30783 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.550601 29820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:41.502182 30917 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 13:10:41.452318 30880 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.571110 30884 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:41.564502 30919 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.594115 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.557489 30909 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.592048 30782 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.594965 29749 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:41.607977 30883 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.566762 30851 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.590386 29820 raft_consensus.cc:606] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Received request to transfer leadership to TS 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:41.569375 30849 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.568660 30846 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.618358 30846 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:41.597488 30831 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.176s
W20260709 13:10:41.659180 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.603063 30884 raft_consensus.cc:697] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:41.620419 29820 raft_consensus.cc:614] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.644670 30870 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.577805 30886 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:41.636862 30871 consensus_meta.cc:287] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.005s
I20260709 13:10:41.665758 30915 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.667408 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.678503 30776 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.680773 30884 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.687351 30807 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.662555 30854 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:41.661595 30781 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.637393 30907 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.615330 30919 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.669711 30752 raft_consensus.cc:993] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:41.701745 30871 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:41.726303 30851 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:41.739971 30916 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.723217 30849 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:41.662774 30852 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:41.750517 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.721570 30781 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.723623 30907 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.742488 30854 raft_consensus.cc:1081] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:41.768805 30919 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:41.777526 30849 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.778183 30849 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.779718 30872 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.783281 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:41.783886 29749 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.784523 30781 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.787554 30852 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:41.788793 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:41.780297 30849 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:41.789505 30346 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.795077 30837 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4.
I20260709 13:10:41.795831 30913 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:41.797032 29667 raft_consensus.cc:2368] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:10:41.800235 29749 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:41.802335 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:41.804535 29712 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.020s	sys 0.025s
I20260709 13:10:41.789218 30907 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:41.804869 29712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.020s	sys 0.025s
I20260709 13:10:41.799393 30820 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3.
W20260709 13:10:41.806722 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.807834 29749 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:41.807683 30789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.017s	sys 0.028s
W20260709 13:10:41.800252 30707 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.002s	sys 0.071s
I20260709 13:10:41.804380 30852 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:41.817778 30707 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.002s	sys 0.071s
W20260709 13:10:41.820523 30789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.077s	user 0.018s	sys 0.028s
W20260709 13:10:41.819890 29637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.020s	sys 0.025s
W20260709 13:10:41.823994 30809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.024s	sys 0.022s
W20260709 13:10:41.825366 30315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.016s	sys 0.055s
I20260709 13:10:41.820153 30872 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.824080 30916 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.842934 29749 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
W20260709 13:10:41.846637 29748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.003s	sys 0.043s
W20260709 13:10:41.880817 29748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.003s	sys 0.043s
W20260709 13:10:41.854612 29639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.016s	sys 0.055s
W20260709 13:10:41.914182 29639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.018s	sys 0.060s
W20260709 13:10:41.842180 29637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.021s	sys 0.026s
W20260709 13:10:41.854144 30316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.055s	sys 0.040s
I20260709 13:10:41.917097 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:41.883945 30315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.016s	sys 0.055s
W20260709 13:10:41.921056 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 119320us
W20260709 13:10:41.841168 30879 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.018s	sys 0.061s
I20260709 13:10:41.919823 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:41.847206 30809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.025s	sys 0.023s
I20260709 13:10:41.826756 30852 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:41.839455 30881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.010s	sys 0.037s
I20260709 13:10:41.923899 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:41.976486 29749 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:41.930613 29572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.015s	sys 0.025s
I20260709 13:10:41.931535 30918 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.979015 29572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.016s	sys 0.025s
I20260709 13:10:41.933068 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:41.938701 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:41.982553 29673 raft_consensus.cc:2393] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:41.983575 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:41.984373 29673 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:41.940315 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:41.854046 30807 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:41.974725 29819 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.918612 30849 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.920953 29743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.007s	sys 0.069s
W20260709 13:10:41.993952 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 60944.2us
I20260709 13:10:41.932374 30872 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:41.923205 30879 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.018s	sys 0.061s
W20260709 13:10:41.976164 30881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.010s	sys 0.037s
I20260709 13:10:41.999634 29821 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:41.999810 30913 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:41.996285 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.000371 30913 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:42.000829 29673 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:41.980983 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:41.920797 30316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.055s	sys 0.040s
I20260709 13:10:41.980602 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.002311 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.001014 29817 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:42.002956 29667 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:42.003829 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.001838 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:41.998421 29743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.007s	sys 0.069s
I20260709 13:10:41.914564 30916 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:41.981194 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:42.006968 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.981566 30924 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:41.989426 29749 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:41.996824 30807 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.005185 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.008239 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.008174 30924 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.009146 29671 raft_consensus.cc:2410] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:42.006425 29823 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:42.009693 30807 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.010819 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.004662 30872 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:42.011406 29823 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:42.012110 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:42.012214 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.006122 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.012953 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.013417 29819 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:42.013533 29671 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:42.012971 30870 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.985281 29672 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:42.014479 30870 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:42.014901 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:41.997771 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:41.975142 30871 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.036736 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.007774 29673 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:41.982960 30915 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:42.043977 30683 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.000854 30913 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:42.010564 30924 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.015369 30852 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.044274 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.044960 30872 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.040882 30919 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.045871 30783 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:42.046814 30853 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.047293 30916 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:42.047418 30782 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:42.007676 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.048790 29639 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:42.011425 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.023427 30346 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:42.038522 30807 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:41.998283 30849 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.057175 30345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.009s	sys 0.035s
I20260709 13:10:42.054674 30683 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.086988 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.074453 29819 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:42.015355 30870 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.041600 30871 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.099195 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50481.5us
I20260709 13:10:42.112140 29639 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:42.065058 30852 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:42.074020 30923 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:42.105096 29818 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:42.105742 30925 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.106534 30807 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.107383 30913 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:42.110579 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:42.023115 30918 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:42.065279 30926 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.092419 30781 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.074044 30919 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.067761 30924 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:42.118639 29749 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
W20260709 13:10:42.104488 30345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.010s	sys 0.035s
W20260709 13:10:42.102783 29744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.007s	sys 0.028s
I20260709 13:10:42.098234 30854 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:42.123569 30871 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.068598 30915 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:42.125185 30925 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.098323 30928 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:42.132910 29789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.011s	sys 0.045s
I20260709 13:10:42.090945 30783 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.143496 29789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.011s	sys 0.045s
W20260709 13:10:42.134796 29669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.018s	sys 0.017s
I20260709 13:10:42.092864 30853 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.123827 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 569) took 1048 ms. Trace:
I20260709 13:10:42.116034 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:42.138458 29744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.008s	sys 0.029s
I20260709 13:10:42.138348 29823 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:42.147814 29748 rpcz_store.cc:276] 0709 13:10:41.075591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.110955 (+ 35364us) service_pool.cc:224] Handling call
0709 13:10:41.111257 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.189806 (+ 78549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.189838 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.206345 (+ 16507us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.914273 (+707928us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:41.914311 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.914377 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.123596 (+209219us) raft_consensus.cc:1685] finished
0709 13:10:42.123623 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.123766 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78177,"raft.queue_time_us":95114,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2129,"thread_start_us":645577,"threads_started":1,"wal-append.queue_time_us":906827}
I20260709 13:10:42.118523 30923 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.101022 30782 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:42.144861 29669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.019s	sys 0.017s
W20260709 13:10:42.134704 29740 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.030s	sys 0.034s
I20260709 13:10:42.119230 30852 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:42.146092 29741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.018s	sys 0.003s
W20260709 13:10:42.157128 29787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.000s	sys 0.023s
W20260709 13:10:42.157562 29787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.023s
W20260709 13:10:42.160218 29746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.027s	sys 0.019s
W20260709 13:10:42.160609 29746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.028s	sys 0.019s
I20260709 13:10:42.127679 30781 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.162190 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:42.156080 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.182487 29745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.011s	sys 0.009s
I20260709 13:10:42.141523 30924 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:42.132733 30926 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.154902 29740 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.031s	sys 0.035s
I20260709 13:10:42.139511 30854 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.296657 30854 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:42.300228 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:42.239230 30871 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:42.304186 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:42.306031 30845 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:42.306634 30845 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.171139 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.230517 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.156949 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.235484 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.214258 30923 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:42.316850 29821 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:42.325132 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.325845 29821 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:42.144248 30928 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:42.233259 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.333256 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:42.333251 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:42.215646 30919 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:42.238554 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.214795 30933 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.153662 30752 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:42.158553 30831 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.219305 30852 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:42.217705 30915 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:42.154541 29742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.030s
I20260709 13:10:42.150518 30935 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:42.223516 30807 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:42.370096 29742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.018s	sys 0.033s
W20260709 13:10:42.157022 29741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.019s	sys 0.004s
I20260709 13:10:42.154894 30917 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:42.192963 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.270100 29745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.013s	sys 0.013s
W20260709 13:10:42.270829 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.307943 30345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49712 (request call id 129) took 1117 ms. Trace:
I20260709 13:10:42.237790 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:42.289686 29747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.004s	sys 0.033s
I20260709 13:10:42.290534 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.293762 30781 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.294351 30849 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:42.308902 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 561) took 1235 ms. Trace:
W20260709 13:10:42.399482 29747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.005s	sys 0.033s
I20260709 13:10:42.399621 29817 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:42.332216 29823 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
W20260709 13:10:42.326985 30909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.023s
W20260709 13:10:42.334543 29714 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.009s	sys 0.024s
I20260709 13:10:42.371143 30935 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.297801 30918 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:42.399236 29744 rpcz_store.cc:276] 0709 13:10:41.073474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.073595 (+   121us) service_pool.cc:224] Handling call
0709 13:10:41.073899 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.167769 (+ 93870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.167798 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.177625 (+  9827us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.279074 (+101449us) spinlock_profiling.cc:243] Waited 931 us on lock 0x7b1800326bc0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d0d1 00007fd9e9a78a0f
0709 13:10:42.151214 (+872140us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.151253 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.151314 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.308581 (+157267us) raft_consensus.cc:1685] finished
0709 13:10:42.308602 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.308839 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93395,"raft.queue_time_us":103366,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":9228,"spinlock_wait_cycles":2140928,"thread_start_us":871972,"threads_started":1,"wal-append.queue_time_us":1101526}
I20260709 13:10:42.306906 30926 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.309091 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.368100 29819 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:42.322145 30783 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.332741 30871 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:42.371812 30343 raft_consensus.cc:2410] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:10:42.369982 30752 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.221256 30782 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:42.264089 29638 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:42.435773 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 171783us
I20260709 13:10:42.367055 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:42.438539 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.439152 29668 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:42.377434 30919 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.335543 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:42.375049 29622 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.009s	sys 0.028s
W20260709 13:10:42.403172 29714 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.011s	sys 0.029s
I20260709 13:10:42.404143 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.404397 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.404935 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.370373 30831 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:42.405515 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 75) took 1634 ms. Trace:
I20260709 13:10:42.407119 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 568) took 1331 ms. Trace:
I20260709 13:10:42.376363 30853 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:42.402962 30909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.009s	sys 0.023s
I20260709 13:10:42.443745 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:42.444825 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:42.442404 29821 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:42.447306 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:42.447561 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:42.442337 29622 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.009s	sys 0.029s
I20260709 13:10:42.448464 29749 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:42.446369 29823 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.368443 30933 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:42.376569 30917 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.444446 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:42.450350 30926 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.648180 29818 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:42.448165 29821 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:42.442247 30919 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.555477 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 77573.8us
I20260709 13:10:42.588522 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.653388 29819 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.446395 29669 rpcz_store.cc:276] 0709 13:10:40.795462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.803675 (+  8213us) service_pool.cc:224] Handling call
0709 13:10:40.813593 (+  9918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.432611 (+619018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.432642 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.433091 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.152947 (+719856us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:42.152994 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.153064 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.405280 (+252216us) raft_consensus.cc:1685] finished
0709 13:10:42.405301 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.405454 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80487,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4985,"thread_start_us":1337962,"threads_started":2,"wal-append.queue_time_us":970755}
I20260709 13:10:42.659299 29823 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:42.656919 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:42.665218 29821 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.490154 30781 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.667743 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:42.424825 30935 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:42.669404 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.676031 29821 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
W20260709 13:10:42.407178 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 121060c6c5b14502957b76fd1dfc7b2d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:42.657440 29740 rpcz_store.cc:276] 0709 13:10:41.075363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.110189 (+ 34826us) service_pool.cc:224] Handling call
0709 13:10:41.110604 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.199537 (+ 88933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.203968 (+  4431us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.275219 (+ 71251us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.294838 (+1019619us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.294885 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.294967 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.406915 (+111948us) raft_consensus.cc:1685] finished
0709 13:10:42.406938 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.407060 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69527,"raft.queue_time_us":89092,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4085,"thread_start_us":1003962,"threads_started":1,"wal-append.queue_time_us":1124937}
I20260709 13:10:42.540333 30347 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:42.594653 29815 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.691905 29817 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:42.590081 30783 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:42.448758 30831 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:42.691040 30752 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:42.695757 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.649338 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:42.492364 30916 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:42.698276 29822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.011s	sys 0.043s
I20260709 13:10:42.436192 29814 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:42.451143 30807 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:42.640883 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 214226us
W20260709 13:10:42.695384 29637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.035s	sys 0.035s
I20260709 13:10:42.686914 30907 raft_consensus.cc:1027] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: attempt to promote peer 121060c6c5b14502957b76fd1dfc7b2d: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:10:42.686875 30781 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.687541 30853 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:42.696753 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.712217 29821 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4. Ops: [2.3-3.4]
W20260709 13:10:42.713274 29640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.000s	sys 0.077s
I20260709 13:10:42.696367 30717 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:42.666808 30926 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.695190 30943 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:42.750305 30943 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.751173 30926 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.752318 30943 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:42.719409 29822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.011s	sys 0.043s
W20260709 13:10:42.695152 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 288012us
I20260709 13:10:42.701372 30683 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.702286 30344 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:42.704273 29819 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
W20260709 13:10:42.741466 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.749327 30717 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:42.710887 30783 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.740459 30928 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:42.739411 30947 log.cc:927] Time spent T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:10:42.744920 29640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.078s
I20260709 13:10:42.738655 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.767623 29669 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
W20260709 13:10:42.726217 29637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.035s	sys 0.036s
W20260709 13:10:42.770547 29639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.029s	sys 0.045s
I20260709 13:10:42.725399 30916 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.764355 30919 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:42.770951 29639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.030s	sys 0.045s
I20260709 13:10:42.743604 30853 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:42.795554 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 683483us
W20260709 13:10:42.766016 29665 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.023s	sys 0.061s
I20260709 13:10:42.797103 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:42.797461 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:42.798329 29674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.020s	sys 0.050s
I20260709 13:10:42.724478 30807 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.799686 29816 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.033s	sys 0.046s
I20260709 13:10:42.385644 30345 rpcz_store.cc:276] 0709 13:10:41.190476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.200386 (+  9910us) service_pool.cc:224] Handling call
0709 13:10:41.220854 (+ 20468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.274246 (+ 53392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.274280 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.274809 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.142065 (+867256us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:42.146036 (+  3971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.151765 (+  5729us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:42.307644 (+155879us) raft_consensus.cc:1685] finished
0709 13:10:42.307676 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:42.307851 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":862159,"threads_started":1,"wal-append.queue_time_us":1016471}
I20260709 13:10:42.766572 30783 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.801460 29744 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
W20260709 13:10:42.801054 29674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.020s	sys 0.050s
W20260709 13:10:42.801887 29816 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.033s	sys 0.046s
I20260709 13:10:42.805518 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.720727 30871 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:42.808540 29672 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
W20260709 13:10:42.803167 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.800252 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:42.798221 30853 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.786737 30884 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.798062 30845 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.823210 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.807016 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:42.799683 29665 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.023s	sys 0.069s
I20260709 13:10:42.829793 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:42.823894 30919 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.785486 30879 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:10:42.857386 29787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.042s
W20260709 13:10:42.864238 29787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.000s	sys 0.042s
W20260709 13:10:42.864574 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 705249us
I20260709 13:10:42.875545 29638 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:42.865374 29787 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:42.879627 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.847144 30870 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.027s	sys 0.031s
I20260709 13:10:42.883265 29823 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:42.845793 30933 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.850088 30917 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:42.832830 30884 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:42.902957 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:42.908138 29749 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:42.868846 30683 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:42.920902 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:42.924393 29789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.013s
W20260709 13:10:42.928260 29789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.014s	sys 0.013s
W20260709 13:10:42.932782 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:42.942490 29715 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.015s	sys 0.013s
W20260709 13:10:42.930160 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 617842us
W20260709 13:10:42.944725 29715 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.015s	sys 0.013s
I20260709 13:10:42.899067 30945 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:42.910326 30937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.006s	sys 0.039s
W20260709 13:10:42.887198 30870 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.027s	sys 0.032s
I20260709 13:10:42.896481 29787 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:42.910593 30948 log.cc:927] Time spent T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:10:42.863152 30879 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:42.851368 30919 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:42.955485 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 639211us
W20260709 13:10:42.899780 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50768.9us
W20260709 13:10:42.946801 30940 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:10:42.947067 30837 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:43.010247 30837 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.010687 30837 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.011018 30807 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:43.012470 30955 log.cc:927] Time spent T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:10:43.019368 30879 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:43.021179 30884 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:42.981462 29789 leader_election.cc:400] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:10:43.023327 29789 leader_election.cc:403] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:42.970177 30937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.007s	sys 0.040s
I20260709 13:10:42.992373 29715 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:42.995784 29670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.008s	sys 0.021s
W20260709 13:10:42.992309 30946 log.cc:927] Time spent T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:10:42.946635 30683 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.000383 30919 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.000746 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 549) took 1024 ms. Trace:
I20260709 13:10:43.000923 30959 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:43.001912 30954 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:10:43.003705 30925 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.004616 29742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 579) took 1626 ms. Trace:
I20260709 13:10:42.973694 30717 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:43.006009 30907 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.006790 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1107) took 1064 ms. Trace:
I20260709 13:10:43.134961 29747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 578) took 1803 ms. Trace:
I20260709 13:10:43.006943 30781 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.007851 30924 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:43.009171 30936 log.cc:927] Time spent T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.784s	user 0.004s	sys 0.000s
I20260709 13:10:42.956753 30845 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.027118 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1091) took 1111 ms. Trace:
W20260709 13:10:43.027932 29670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.008s	sys 0.022s
I20260709 13:10:42.999245 30933 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:43.009806 30346 consensus_meta.cc:287] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.001s
I20260709 13:10:43.030510 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:43.028609 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 47297.3us
I20260709 13:10:43.162477 29789 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:42.976752 30928 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.019047 30915 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:43.092695 29745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 582) took 1552 ms. Trace:
W20260709 13:10:43.027845 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 131454us
I20260709 13:10:42.995932 30707 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:43.129245 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 253796us
I20260709 13:10:43.066067 29822 rpcz_store.cc:276] 0709 13:10:41.976650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.976807 (+   157us) service_pool.cc:224] Handling call
0709 13:10:41.977097 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.977402 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.977427 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.983438 (+  6011us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.753843 (+770405us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.753882 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.753969 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.000526 (+246557us) raft_consensus.cc:1685] finished
0709 13:10:43.000547 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.000677 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1781,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":15564,"thread_start_us":713977,"threads_started":1,"wal-append.queue_time_us":959767}
W20260709 13:10:43.038115 30872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.012s	sys 0.032s
I20260709 13:10:43.135370 29747 rpcz_store.cc:276] 0709 13:10:41.331049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.331165 (+   116us) service_pool.cc:224] Handling call
0709 13:10:41.334326 (+  3161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.334537 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.334560 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.343179 (+  8619us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.400226 (+1057047us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.400272 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.400339 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.134740 (+734401us) raft_consensus.cc:1685] finished
0709 13:10:43.134761 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.134900 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1056660,"threads_started":1,"wal-append.queue_time_us":1427005}
I20260709 13:10:43.144114 30717 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:42.997498 30926 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.030129 30943 raft_consensus.cc:2764] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:10:43.150480 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 353432us
I20260709 13:10:43.208704 29639 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:43.030144 30807 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:43.038657 30851 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.166610 29746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 583) took 1621 ms. Trace:
I20260709 13:10:43.163714 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:43.159317 29674 rpcz_store.cc:276] 0709 13:10:41.916093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.916210 (+   117us) service_pool.cc:224] Handling call
0709 13:10:41.916544 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.916781 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:42.807744 (+890963us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.026788 (+219044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.026842 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:43.026882 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.026943 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.027058 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":935418,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7609,"thread_start_us":1094106,"threads_started":2}
I20260709 13:10:43.166983 29745 rpcz_store.cc:276] 0709 13:10:41.540580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.540744 (+   164us) service_pool.cc:224] Handling call
0709 13:10:41.541139 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.541513 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.541539 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.542014 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.374336 (+832322us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.374378 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.374453 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.092421 (+717968us) raft_consensus.cc:1685] finished
0709 13:10:43.092447 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.092626 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2739,"raft.run_cpu_time_us":642,"raft.run_wall_time_us":53592,"thread_start_us":830237,"threads_started":1,"wal-append.queue_time_us":1109570}
W20260709 13:10:43.170727 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.028752 30935 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.138695 30916 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.133401 30919 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.175209 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1092) took 1258 ms. Trace:
I20260709 13:10:43.166991 30346 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:43.146041 30870 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.056092 30315 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:43.182196 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.166929 30915 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.145568 30907 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:43.050308 30913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.009s	sys 0.014s
W20260709 13:10:43.300791 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 92192.3us
I20260709 13:10:43.299733 29670 rpcz_store.cc:276] 0709 13:10:41.917215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.917640 (+   425us) service_pool.cc:224] Handling call
0709 13:10:41.918002 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.918240 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:42.434629 (+516389us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.174846 (+740217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.174909 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:43.174954 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.175021 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.175148 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25315,"prepare.queue_time_us":985144,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"thread_start_us":1163652,"threads_started":2,"wal-append.queue_time_us":736901}
W20260709 13:10:43.296577 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 83652.3us
I20260709 13:10:43.174422 30831 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.172650 30933 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.324564 30831 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.340131 30831 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:43.184489 30872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.014s	sys 0.045s
I20260709 13:10:43.303169 29746 rpcz_store.cc:276] 0709 13:10:41.545408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.552765 (+  7357us) service_pool.cc:224] Handling call
0709 13:10:41.553115 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.562830 (+  9715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.562861 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.570599 (+  7738us) log.cc:844] Serialized 26 byte log entry
0709 13:10:41.646014 (+ 75415us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b48000b2758. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ee9e6aa1 00007fd9ee9ddb37 00007fd9ee9dd9ca 00007fd9eead526f 00007fd9eead4f37 00007fd9eeae955c 00007fd9eeae9508 00007fd9eeae9488 00007fd9eeae9443 00007fd9eeae86ec 00007fd9eda12a96
0709 13:10:42.162923 (+516909us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.162969 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.163043 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.159320 (+996277us) raft_consensus.cc:1685] finished
0709 13:10:43.159339 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.166535 (+  7196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":775,"raft.run_cpu_time_us":1740,"raft.run_wall_time_us":80452,"spinlock_wait_cycles":101869952,"thread_start_us":555825,"threads_started":1,"wal-append.queue_time_us":1121231}
W20260709 13:10:43.300225 30934 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:10:43.166337 30845 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:43.336520 30939 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:10:43.178337 30945 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.150s
I20260709 13:10:43.176347 30928 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:43.324548 30913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.011s	sys 0.015s
I20260709 13:10:43.326974 30346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 91) took 1028 ms. Trace:
I20260709 13:10:43.325656 30984 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:43.217398 30926 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.326301 30915 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.181495 30783 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.371130 29674 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45236
I20260709 13:10:43.394372 29674 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:43.394733 29674 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.187458 29815 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:43.370004 29666 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:43.183375 30707 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:43.366009 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.211735 30717 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.378531 30909 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.350175 30782 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.358814 30924 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.372756 30880 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.358510 30916 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.365458 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:43.373333 30852 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.014s	sys 0.018s
I20260709 13:10:43.393484 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:43.349138 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 322644us
I20260709 13:10:43.334978 30919 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.460839 30919 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.325160 30870 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.342456 30807 raft_consensus.cc:697] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:43.463198 30807 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.463980 30870 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:43.416229 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 252563us
I20260709 13:10:43.378743 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 567) took 2298 ms. Trace:
I20260709 13:10:43.133869 29671 rpcz_store.cc:276] 0709 13:10:41.942288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.016100 (+ 73812us) service_pool.cc:224] Handling call
0709 13:10:42.075104 (+ 59004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.171115 (+ 96011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.205070 (+ 33955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:42.260372 (+ 55302us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.265560 (+  5188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.006531 (+740971us) spinlock_profiling.cc:243] Waited 64.7 ms on lock 0x7b54001f4ad4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:43.006579 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.006724 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148782336}
I20260709 13:10:43.466632 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:43.467355 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:43.468087 29671 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:43.425800 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.470556 29714 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:43.411417 30853 consensus_meta.cc:287] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.573s	user 0.006s	sys 0.004s
I20260709 13:10:43.471565 29744 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:43.471426 30853 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:43.429112 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 114184us
I20260709 13:10:43.472826 29639 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:43.473461 30853 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.432987 29674 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.474269 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.474916 29740 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:43.394102 30978 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:43.475941 30978 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.476346 30978 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.466178 29743 rpcz_store.cc:276] 0709 13:10:41.075131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.098418 (+ 23287us) service_pool.cc:224] Handling call
0709 13:10:41.098858 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.210598 (+111740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.215599 (+  5001us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.249953 (+ 34354us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.006585 (+756632us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.006630 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.006703 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.008630 (+1001927us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:43.305086 (+296456us) raft_consensus.cc:1685] finished
0709 13:10:43.305107 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.365104 (+ 59997us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107544,"raft.queue_time_us":110217,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7771,"spinlock_wait_cycles":83509504,"thread_start_us":756231,"threads_started":1,"wal-append.queue_time_us":933570}
I20260709 13:10:43.478739 29674 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.479272 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45236 (request call id 1046) took 1002 ms. Trace:
I20260709 13:10:43.479586 29674 rpcz_store.cc:276] 0709 13:10:42.476769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.332671 (+855902us) service_pool.cc:224] Handling call
0709 13:10:43.479169 (+146498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.480140 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:43.480504 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:43.480755 29743 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.483935 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:43.484592 29740 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.486569 30853 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:43.481676 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:43.488605 29674 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:43.490447 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:43.492507 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:43.495245 29674 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:43.508785 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1050) took 1030 ms. Trace:
I20260709 13:10:43.384078 30346 rpcz_store.cc:276] 0709 13:10:42.298571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.327051 (+ 28480us) service_pool.cc:224] Handling call
0709 13:10:43.314293 (+987242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2304}
I20260709 13:10:43.511921 29674 rpcz_store.cc:276] 0709 13:10:42.477677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.500145 (+1022468us) service_pool.cc:224] Handling call
0709 13:10:43.503362 (+  3217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.505131 (+  1769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.505337 (+   206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.505665 (+   328us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:43.506033 (+   368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.506714 (+   681us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.508119 (+  1405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:43.402961 30984 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.429692 30880 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:43.527354 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 56893.2us
I20260709 13:10:43.540607 29714 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:43.513255 30852 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.015s	sys 0.019s
I20260709 13:10:43.429869 30985 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.127854 29742 rpcz_store.cc:276] 0709 13:10:41.377991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.383936 (+  5945us) service_pool.cc:224] Handling call
0709 13:10:41.384380 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.489602 (+105222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.499045 (+  9443us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.573217 (+ 74172us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.372504 (+799287us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.372548 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.004180 (+631632us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54003b9054. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:43.004234 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.004294 (+    60us) raft_consensus.cc:1685] finished
0709 13:10:43.004308 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.004543 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18045,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11951,"spinlock_wait_cycles":111587584,"thread_start_us":757736,"threads_started":1,"wal-append.queue_time_us":846139}
I20260709 13:10:43.429250 30924 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.544922 30880 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.546610 30928 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.548029 30845 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:43.515977 30968 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 13:10:43.513847 29667 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:43.562674 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:43.425747 30752 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:10:43.574873 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:43.575212 30970 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 13:10:43.575966 30935 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:43.589862 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 247845us
I20260709 13:10:43.429817 30782 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.632403 30933 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.632983 30854 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.633395 30854 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.525331 30683 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:43.616643 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 54046us
I20260709 13:10:43.633730 30854 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.454550 30916 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.551667 30919 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:43.589433 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 131141us
I20260709 13:10:43.577940 30926 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.564018 30945 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.425999 30909 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.629519 30346 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
W20260709 13:10:43.629824 30977 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:10:43.630693 30961 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:43.631636 30872 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:43.636744 29714 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:43.621289 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 130911us
I20260709 13:10:43.577164 30978 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.627534 30845 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:43.642203 30837 consensus_meta.cc:287] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
I20260709 13:10:43.732398 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.649839 30945 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.647126 30965 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:43.721604 29639 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:43.671954 29747 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:10:43.709673 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 226546us
W20260709 13:10:43.722030 29821 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.006s	sys 0.013s
I20260709 13:10:43.641183 30919 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.733206 29744 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:43.720561 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:43.645808 30907 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.569980 30985 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.737551 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1037) took 1269 ms. Trace:
I20260709 13:10:43.660017 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.657996 29740 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:43.747025 29639 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:43.745162 29821 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.006s	sys 0.013s
I20260709 13:10:43.747634 29816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 551) took 1753 ms. Trace:
I20260709 13:10:43.748201 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:43.750042 30717 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.752439 30783 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.771843 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:43.723328 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 62884.4us
I20260709 13:10:43.778565 29748 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:43.722390 30980 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 13:10:43.784368 29639 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:43.801420 29639 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:43.787492 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.802371 29746 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:43.741822 30945 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.738629 29665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1033) took 2296 ms. Trace:
I20260709 13:10:43.740911 30872 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.792328 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.780247 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.820752 29744 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:43.783799 29816 rpcz_store.cc:276] 0709 13:10:41.994710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.994918 (+   208us) service_pool.cc:224] Handling call
0709 13:10:42.001718 (+  6800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.042423 (+ 40705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.042458 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.052546 (+ 10088us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.809260 (+756714us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:42.809302 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:42.809373 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.743598 (+934225us) raft_consensus.cc:1685] finished
0709 13:10:43.743619 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.747574 (+  3955us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14755,"raft.queue_time_us":35602,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":3843,"thread_start_us":734141,"threads_started":1,"wal-append.queue_time_us":1361473}
I20260709 13:10:43.821115 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.743683 30782 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.803973 29639 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:10:43.804234 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 60817.2us
W20260709 13:10:43.805723 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 53166.5us
I20260709 13:10:43.806161 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:43.808322 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 171631us
I20260709 13:10:43.756523 30919 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.743323 30886 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:10:43.789482 30852 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.818185 30845 raft_consensus.cc:697] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:43.783564 30971 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.836324 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.837450 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.739542 30837 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.744071 30995 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 13:10:43.850803 29748 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:43.856830 29741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 599) took 1186 ms. Trace:
I20260709 13:10:43.843724 30852 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:43.745316 30965 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:43.838416 30783 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.818888 30999 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:43.868410 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:43.837042 30979 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:43.848039 30782 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.850826 30971 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:43.859773 31001 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:43.851881 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:43.866880 30852 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.851629 29743 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:43.934265 30348 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:43.881980 30971 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.947474 29640 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:43.893600 30984 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:43.880539 31001 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:43.898689 30783 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:43.778244 29668 rpcz_store.cc:276] 0709 13:10:42.468350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.469445 (+  1095us) service_pool.cc:224] Handling call
0709 13:10:42.685220 (+215775us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.722317 (+ 37097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.726396 (+  4079us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.792754 (+ 66358us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.159026 (+366272us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:43.166249 (+  7223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.174618 (+  8369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.737287 (+562669us) raft_consensus.cc:1685] finished
0709 13:10:43.737308 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.737485 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7732,"raft.queue_time_us":17375,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4022,"thread_start_us":314098,"threads_started":1,"wal-append.queue_time_us":603811}
I20260709 13:10:43.976025 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:43.934852 31009 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:43.959725 30983 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.325s	user 0.001s	sys 0.001s
I20260709 13:10:43.946794 30916 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:43.936677 29740 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:43.875641 30999 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:43.982781 31007 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:10:43.945571 30997 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:43.934453 30989 raft_consensus.cc:2764] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:43.992161 31009 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.992609 30980 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.982656 31001 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.996685 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:44.000160 30837 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:44.065673 29714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.617s (SENT) [suppressed 12 similar messages]
W20260709 13:10:44.006654 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 121060c6c5b14502957b76fd1dfc7b2d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:10:44.067327 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 63304us
I20260709 13:10:44.070226 30985 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.072880 30965 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:44.073378 31016 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:10:44.033713 30978 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.011705 30926 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.048501 31009 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:43.997038 30880 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.982527 30845 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:44.057945 30909 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:44.107108 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 262202us
W20260709 13:10:44.092653 30969 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.283s	user 0.001s	sys 0.001s
I20260709 13:10:44.088383 29740 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:44.095208 30851 consensus_meta.cc:287] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.763s	user 0.003s	sys 0.008s
I20260709 13:10:44.072897 30999 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:44.143944 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 340018us
I20260709 13:10:44.144966 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:44.130362 30851 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:10:44.153318 30962 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:44.056797 30997 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:43.819973 29665 rpcz_store.cc:276] 0709 13:10:41.432020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.432659 (+   639us) service_pool.cc:224] Handling call
0709 13:10:41.630656 (+197997us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:41.630918 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:41.631427 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:41.631465 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:41.632087 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:10:42.844658 (+1212571us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:43.299221 (+454563us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.565751 (+266530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.591694 (+ 25943us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:43.599561 (+  7867us) raft_consensus.cc:1685] finished
0709 13:10:43.658811 (+ 59250us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.728155 (+ 69344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3343,"prepare.queue_time_us":151517,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":173819,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":23266,"spinlock_wait_cycles":5588224,"thread_start_us":1693101,"threads_started":3,"wal-append.queue_time_us":1509918}
W20260709 13:10:44.152316 29671 consensus_meta.cc:287] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.684s	user 0.014s	sys 0.002s
W20260709 13:10:44.151140 30993 log.cc:927] Time spent T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:10:44.107529 30926 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:44.189630 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:44.191356 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.193126 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.204586 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.203783 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.206218 29823 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:44.207103 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.194590 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.209275 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.194249 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.215243 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.216015 29822 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:44.217164 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.221325 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.222411 29823 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:44.113727 30783 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.253893 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1042) took 2098 ms. Trace:
I20260709 13:10:44.254333 29814 rpcz_store.cc:276] 0709 13:10:42.155680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.739881 (+584201us) service_pool.cc:224] Handling call
0709 13:10:42.740302 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:42.777120 (+ 36818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:42.788371 (+ 11251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:42.831715 (+ 43344us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.214119 (+382404us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:43.512724 (+298605us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.539366 (+ 26642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.550174 (+ 10808us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.224189 (+674015us) raft_consensus.cc:1685] finished
0709 13:10:44.224209 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.253827 (+ 29618us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13966,"prepare.queue_time_us":415357,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":222870,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":55523,"thread_start_us":502336,"threads_started":2,"wal-append.queue_time_us":687677}
I20260709 13:10:44.199544 30924 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.198527 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:44.199976 30997 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:44.195731 30984 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:10:44.254333 31015 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:44.491649 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:44.492014 31015 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.492750 30985 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:44.493285 30985 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:44.478514 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:44.494146 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 972709us
I20260709 13:10:44.494741 29668 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:44.496037 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:44.476840 30879 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:44.499982 30879 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:44.501420 30707 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:44.503274 29638 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:44.195210 29671 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:44.236397 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.534623 29715 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:43.862156 29741 rpcz_store.cc:276] 0709 13:10:42.670040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.684014 (+ 13974us) service_pool.cc:224] Handling call
0709 13:10:42.712512 (+ 28498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.800341 (+ 87829us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:43.127544 (+327203us) log.cc:844] Serialized 14 byte log entry
0709 13:10:43.151362 (+ 23818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.161266 (+  9904us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.166257 (+  4991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.856524 (+690267us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54003624d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:43.856585 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:43.856758 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":413435,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":6676,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":8053,"spinlock_wait_cycles":168387456,"thread_start_us":228691,"threads_started":1,"wal-append.queue_time_us":16909}
W20260709 13:10:44.253782 30967 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:44.547401 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1038) took 2076 ms. Trace:
W20260709 13:10:44.416165 30316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.028s	sys 0.118s
W20260709 13:10:44.343052 31011 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:10:44.226182 30981 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:44.193542 30917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.003s	sys 0.010s
I20260709 13:10:44.557109 29673 rpcz_store.cc:276] 0709 13:10:42.471259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.472164 (+   905us) service_pool.cc:224] Handling call
0709 13:10:42.879446 (+407282us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:42.879668 (+   222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.178597 (+298929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.178626 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.179088 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.358402 (+179314us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:43.358438 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.358509 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.505698 (+1147189us) raft_consensus.cc:1685] finished
0709 13:10:44.505721 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.547336 (+ 41615us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141749,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":30348672,"thread_start_us":477567,"threads_started":2,"wal-append.queue_time_us":684228}
I20260709 13:10:44.555694 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:44.570515 31019 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:44.569015 30717 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:44.579805 30917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.008s	sys 0.017s
I20260709 13:10:44.582207 31013 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:44.582896 31013 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:44.583377 29815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52208 (request call id 60) took 2529 ms (client timeout 1891 ms). Trace:
I20260709 13:10:44.582429 30717 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.582934 31019 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:44.584527 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:44.587682 30717 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:44.562187 30316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.037s	sys 0.124s
W20260709 13:10:44.583906 29815 rpcz_store.cc:269] 0709 13:10:42.054181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.134862 (+ 80681us) service_pool.cc:224] Handling call
0709 13:10:44.583111 (+2448249us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540019d2d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:44.583262 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552053504}
I20260709 13:10:44.569770 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57422 (request call id 77) took 1192 ms. Trace:
I20260709 13:10:44.598392 29671 rpcz_store.cc:276] 0709 13:10:43.384352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.467024 (+ 82672us) service_pool.cc:224] Handling call
0709 13:10:44.553236 (+1086212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:44.601732 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1036) took 2163 ms. Trace:
I20260709 13:10:44.592561 30707 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:44.613313 29667 rpcz_store.cc:276] 0709 13:10:42.438750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.467567 (+ 28817us) service_pool.cc:224] Handling call
0709 13:10:42.697151 (+229584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.625858 (+928707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.601487 (+975629us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54001a40d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:44.601668 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669184256}
I20260709 13:10:44.616485 30348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49706 (request call id 152) took 2249 ms. Trace:
I20260709 13:10:44.592839 30981 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.616926 30348 rpcz_store.cc:276] 0709 13:10:42.372923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.404995 (+ 32072us) service_pool.cc:224] Handling call
0709 13:10:43.003374 (+598379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.934725 (+931351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.575818 (+641093us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540010b8d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:44.616205 (+ 40387us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540010b8d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:44.616384 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3364077568}
I20260709 13:10:44.619051 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.619764 31019 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:44.622906 30981 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.624886 31013 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:44.625447 30707 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.616204 30926 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:44.625902 30707 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.624459 31009 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:44.619967 29744 raft_consensus.cc:2410] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:44.499024 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:44.591928 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 732244us
W20260709 13:10:44.644421 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.645682 31015 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.649065 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:44.649724 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1035) took 2211 ms. Trace:
I20260709 13:10:44.649722 29817 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.652341 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.652771 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:44.650444 29666 rpcz_store.cc:276] 0709 13:10:42.438437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.438582 (+   145us) service_pool.cc:224] Handling call
0709 13:10:42.438905 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.400128 (+961223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.649459 (+1249331us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b5400213c54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:44.649658 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140866944}
I20260709 13:10:44.662509 31009 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.666838 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:44.667578 29815 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:44.667904 29815 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:44.672670 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:44.676879 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.677817 29745 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:44.678169 29815 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.678853 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.679196 29815 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:44.683293 29822 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
W20260709 13:10:44.683326 30992 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 1.078s	user 0.003s	sys 0.000s
I20260709 13:10:44.687716 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1041) took 2212 ms. Trace:
I20260709 13:10:44.688565 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:44.689577 29667 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:44.688109 29669 rpcz_store.cc:276] 0709 13:10:42.475495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.887557 (+412062us) service_pool.cc:224] Handling call
0709 13:10:42.887916 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.171416 (+283500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.171452 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.171957 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.365124 (+193167us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:43.365167 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:43.365266 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.668074 (+1302808us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:44.686358 (+ 18284us) raft_consensus.cc:1685] finished
0709 13:10:44.686380 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.687644 (+  1264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17487,"raft.queue_time_us":240405,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":24796,"spinlock_wait_cycles":14935936,"thread_start_us":472010,"threads_started":2,"wal-append.queue_time_us":378225}
I20260709 13:10:44.688253 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:44.670341 30854 consensus_meta.cc:287] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 1.036s	user 0.013s	sys 0.001s
I20260709 13:10:44.693527 30854 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:44.343019 30990 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.013s	sys 0.072s
W20260709 13:10:44.695394 30990 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.014s	sys 0.081s
I20260709 13:10:44.695565 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:44.357142 29820 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:44.700398 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:44.696753 30707 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.700786 29817 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:44.702703 30707 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.708654 30854 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:44.701668 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.713851 29817 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
W20260709 13:10:44.719482 30852 consensus_meta.cc:287] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.787s	user 0.001s	sys 0.010s
I20260709 13:10:44.719937 30852 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:44.723507 30831 consensus_meta.cc:287] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 1.383s	user 0.012s	sys 0.005s
I20260709 13:10:44.724032 30831 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.724963 30879 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:44.692747 30915 consensus_meta.cc:287] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 1.281s	user 0.012s	sys 0.004s
I20260709 13:10:44.726181 30985 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:44.727780 30945 consensus_meta.cc:287] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.891s	user 0.008s	sys 0.004s
W20260709 13:10:44.729422 30919 consensus_meta.cc:287] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.870s	user 0.004s	sys 0.008s
I20260709 13:10:44.729761 30880 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:44.733793 29816 consensus_meta.cc:287] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.003s
W20260709 13:10:44.734409 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 231224us
W20260709 13:10:44.734674 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 130797us
I20260709 13:10:44.738085 31013 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:44.739605 30717 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.739907 29749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:10:44.768596 29822 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:44.808782 29749 raft_consensus.cc:606] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:44.809266 29749 raft_consensus.cc:614] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:44.740808 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.741636 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:44.742316 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:44.743062 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 86766.2us
I20260709 13:10:44.748270 31015 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:10:44.752970 29789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.037s	sys 0.130s
W20260709 13:10:44.804692 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:44.815246 29789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.037s	sys 0.131s
I20260709 13:10:44.820358 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:44.821291 29749 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:44.738091 30852 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.804919 29816 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:44.825865 29745 raft_consensus.cc:2368] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3.
I20260709 13:10:44.821867 29715 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:44.824759 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.830391 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:44.832257 29787 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.001s	sys 0.097s
I20260709 13:10:44.751814 30915 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:44.834594 29672 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.380s	user 0.048s	sys 0.095s
W20260709 13:10:44.834937 29672 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.049s	sys 0.095s
I20260709 13:10:44.835786 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.836364 29822 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:44.837112 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:44.833446 29787 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.001s	sys 0.097s
W20260709 13:10:44.822233 30871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.032s	sys 0.061s
I20260709 13:10:44.846590 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.848295 29749 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:44.849435 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.837685 29822 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:44.852054 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.857368 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.858853 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.886655 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:44.757432 30919 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.888599 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:44.864122 30871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.032s	sys 0.061s
W20260709 13:10:44.846326 30925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.472s	user 0.032s	sys 0.114s
W20260709 13:10:44.858486 30315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.022s	sys 0.018s
I20260709 13:10:44.832175 31019 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:44.895759 29670 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:44.847390 30924 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:44.887821 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.902534 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.958683 29816 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:44.959559 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:44.960543 31001 consensus_meta.cc:287] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.895s	user 0.008s	sys 0.004s
I20260709 13:10:44.820547 31015 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.905323 30979 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:44.948354 31014 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.950172 30717 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.951303 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.887208 30998 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:44.960608 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.978677 29816 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:44.979571 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:44.961899 29747 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
W20260709 13:10:44.939337 30925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.033s	sys 0.115s
I20260709 13:10:44.844918 31013 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.979776 30998 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:44.906185 30852 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:44.941197 30315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.022s	sys 0.019s
W20260709 13:10:44.958320 30971 consensus_meta.cc:287] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.988s	user 0.004s	sys 0.011s
I20260709 13:10:44.753182 30945 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.937026 31022 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:44.973434 29638 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:44.940707 30917 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:44.986114 31015 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.952638 31019 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:44.980295 29816 raft_consensus.cc:2368] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
W20260709 13:10:44.995359 29748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.114s	user 0.013s	sys 0.009s
I20260709 13:10:44.986284 31013 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:44.974673 29745 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
W20260709 13:10:45.015237 29748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.013s	sys 0.009s
I20260709 13:10:45.016227 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1165) took 1184 ms. Trace:
I20260709 13:10:45.016676 29748 rpcz_store.cc:276] 0709 13:10:43.831499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.860523 (+ 29024us) service_pool.cc:224] Handling call
0709 13:10:43.864233 (+  3710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.864527 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:43.879137 (+ 14610us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.015868 (+1136731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.015928 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.015973 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.016045 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.016168 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14466,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"thread_start_us":1134847,"threads_started":1}
I20260709 13:10:45.018994 29638 leader_election.cc:400] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3.
I20260709 13:10:45.019384 29638 leader_election.cc:403] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:44.966516 31001 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.024389 29819 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:44.995138 30852 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:45.021188 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:44.994940 30965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.013s	sys 0.033s
I20260709 13:10:45.025894 30960 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.014243 31019 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.001731 30925 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:45.050809 29821 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.028s	sys 0.062s
I20260709 13:10:45.049800 30314 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:45.052634 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:45.051177 29821 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.028s	sys 0.062s
I20260709 13:10:44.979079 31014 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.062784 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:44.974066 30979 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:45.050107 30965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.013s	sys 0.034s
I20260709 13:10:45.074352 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1051) took 2897 ms. Trace:
W20260709 13:10:45.051962 30959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.010s	sys 0.014s
I20260709 13:10:45.001377 30917 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:44.993291 30971 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.074985 29821 rpcz_store.cc:276] 0709 13:10:42.164919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.747025 (+582106us) service_pool.cc:224] Handling call
0709 13:10:42.747313 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:42.747501 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:43.066831 (+319330us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.061656 (+1994825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.061727 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.062489 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.062604 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.062735 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22091,"prepare.queue_time_us":841209,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":184089,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10487,"thread_start_us":2276556,"threads_started":3,"wal-append.queue_time_us":1001376,"wal-append.run_cpu_time_us":1137,"wal-append.run_wall_time_us":1001163}
I20260709 13:10:45.081880 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.100906 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:45.026177 30872 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.102453 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:45.063040 29743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.009s	sys 0.013s
I20260709 13:10:45.052736 30925 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:45.027856 29815 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:45.106947 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.106433 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.000123 31022 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.113015 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:45.084792 30959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.010s	sys 0.015s
I20260709 13:10:45.071524 29671 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:45.110591 29816 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.120944 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.122176 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.110121 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.108377 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.071069 31024 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:45.086517 29742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.016s	sys 0.038s
I20260709 13:10:45.116963 29746 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:10:45.106520 29743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.009s	sys 0.013s
I20260709 13:10:45.132237 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.123615 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.104204 30915 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.137609 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1047) took 2660 ms. Trace:
I20260709 13:10:45.106307 30925 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.123219 29822 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.143224 29747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48026 (request call id 1151) took 1365 ms. Trace:
I20260709 13:10:45.121182 30998 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:45.167925 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:45.144467 30884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.005s	sys 0.013s
W20260709 13:10:45.139809 30974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.004s	sys 0.013s
W20260709 13:10:45.108091 30933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.009s	sys 0.015s
W20260709 13:10:45.152815 29639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.003s	sys 0.019s
I20260709 13:10:45.140475 30344 pending_rounds.cc:85] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 2
I20260709 13:10:45.165561 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:45.177083 29639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.003s	sys 0.019s
I20260709 13:10:45.177331 29821 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:45.165736 29747 rpcz_store.cc:276] 0709 13:10:43.771411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.771554 (+   143us) service_pool.cc:224] Handling call
0709 13:10:45.137014 (+1365460us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400223654. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:45.137121 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2690517760}
I20260709 13:10:45.166137 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.165206 29670 rpcz_store.cc:276] 0709 13:10:42.477000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.355059 (+878059us) service_pool.cc:224] Handling call
0709 13:10:43.355418 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.952257 (+1596839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.137382 (+185125us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400022954. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:45.137550 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3541218688}
W20260709 13:10:45.144238 30683 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.003s	sys 0.014s
W20260709 13:10:45.161471 29742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.017s	sys 0.039s
I20260709 13:10:45.109483 30872 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.145849 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:45.152902 31024 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:45.178750 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:45.179463 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.194819 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.195550 29669 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:45.186167 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.196861 29821 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:45.197781 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.194890 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:45.176596 30974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.005s	sys 0.013s
W20260709 13:10:45.170255 30783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.014s	sys 0.018s
I20260709 13:10:45.163637 30919 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:45.169463 30313 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.005s	sys 0.017s
I20260709 13:10:45.165262 30345 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:45.206238 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.182654 30344 pending_rounds.cc:107] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
I20260709 13:10:45.203683 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.203713 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.215523 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.216209 29821 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
W20260709 13:10:45.182890 30933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.010s	sys 0.015s
W20260709 13:10:45.181411 30683 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.004s	sys 0.014s
I20260709 13:10:45.220538 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.221879 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:45.170624 30884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.005s	sys 0.013s
I20260709 13:10:45.208375 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:45.185135 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.208662 31014 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.209004 30872 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:45.209484 31029 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:45.202845 31024 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:45.210544 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:45.250692 29747 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:45.251684 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:45.252326 29747 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:45.211493 29672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1040) took 2736 ms. Trace:
I20260709 13:10:45.219008 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.212848 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:45.206915 30783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.014s	sys 0.018s
I20260709 13:10:45.254038 29672 rpcz_store.cc:276] 0709 13:10:42.475256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.835409 (+360153us) service_pool.cc:224] Handling call
0709 13:10:42.835731 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.394599 (+558868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.394689 (+    90us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.435864 (+ 41175us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.835241 (+1399377us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:44.835280 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.962827 (+127547us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400214154. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:44.962882 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.211175 (+248293us) raft_consensus.cc:1685] finished
0709 13:10:45.211197 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.211416 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91437,"raft.queue_time_us":204626,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":15478,"spinlock_wait_cycles":279421312,"thread_start_us":1834730,"threads_started":2,"wal-append.queue_time_us":1681349}
W20260709 13:10:45.207335 30313 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.005s	sys 0.017s
I20260709 13:10:45.227073 31001 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.223088 30907 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:45.235905 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:45.206445 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:45.149721 30852 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.204013 30945 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.262259 29821 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.218446 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.212569 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1167) took 1366 ms. Trace:
I20260709 13:10:45.285740 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.286530 29821 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.270401 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:45.218691 30344 raft_consensus.cc:2917] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
W20260709 13:10:45.226313 29814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.008s	sys 0.013s
W20260709 13:10:45.287746 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.225066 30943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.004s	sys 0.016s
W20260709 13:10:45.288592 30943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.005s	sys 0.017s
I20260709 13:10:45.279035 29670 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.225344 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:45.290544 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.262262 29815 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.287828 29747 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.307585 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:45.310390 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.303661 30343 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:45.280784 31013 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.288960 30845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.030s	sys 0.049s
I20260709 13:10:45.319720 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.352362 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.424942 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.425133 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:45.425375 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:45.426013 29822 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.314168 30971 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.343304 30347 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:45.348043 29670 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:45.428591 31024 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:45.369776 31035 log.cc:927] Time spent T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:10:45.342877 30344 raft_consensus.cc:2889] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:45.291256 29814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.008s	sys 0.013s
W20260709 13:10:45.356487 31031 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 13:10:45.356077 30845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.030s	sys 0.058s
I20260709 13:10:45.369596 31022 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.351775 31014 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:45.345896 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:45.354501 30945 consensus_queue.cc:1059] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:10:45.351799 30979 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.459582 29674 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:45.290587 30917 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:45.285569 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 529985us
I20260709 13:10:45.482084 29747 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:45.357785 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:45.485431 29714 leader_election.cc:336] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.508s (SENT)
W20260709 13:10:45.495612 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 149791us
I20260709 13:10:45.352981 31013 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.484854 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.524984 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:45.499089 30344 pending_rounds.cc:107] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 3.4
W20260709 13:10:45.503778 31042 log.cc:927] Time spent T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:45.500408 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:45.525326 29822 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:45.585570 29747 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:45.586181 29822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:45.586828 29822 raft_consensus.cc:606] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.525976 29673 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:45.587430 29822 raft_consensus.cc:614] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:45.586567 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:45.585124 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 99735.6us
I20260709 13:10:45.494836 31037 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:45.589877 29714 leader_election.cc:336] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.526s (SENT)
W20260709 13:10:45.579121 31046 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:45.484391 29815 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.527662 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:45.569813 29789 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:45.589663 31047 log.cc:927] Time spent T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:10:45.588721 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:45.607789 29747 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.608834 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.587189 29741 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:45.499934 31027 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:45.596442 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.589365 31024 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.603928 29787 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.615626 29747 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:45.592726 31022 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:45.597019 30344 raft_consensus.cc:2889] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:45.601217 30316 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.619313 31027 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.503265 31014 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:45.611981 31052 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:45.616209 30943 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:45.611636 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.618829 30985 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:45.285682 29743 rpcz_store.cc:276] 0709 13:10:43.845906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.971623 (+125717us) service_pool.cc:224] Handling call
0709 13:10:44.010775 (+ 39152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.058293 (+ 47518us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:44.117819 (+ 59526us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.488903 (+371084us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b180038c440. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69d0522 00007fd9e69d27c1 00007fd9e69d2779 00007fd9e69d2709 00007fd9e69d26d1 00007fd9e69d19cd 000000000038f354 000000000038f199 00007fd9e69b383a
0709 13:10:45.169446 (+680543us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.170997 (+  1551us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.182373 (+ 11376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.193786 (+ 11413us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.206034 (+ 12248us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30374,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":6308,"raft.queue_time_us":2557,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4646,"spinlock_wait_cycles":11321216,"thread_start_us":1023042,"threads_started":1,"wal-append.queue_time_us":1215798}
I20260709 13:10:45.646188 30919 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:45.650068 31050 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:10:45.641228 31038 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 13:10:45.644364 31019 consensus_meta.cc:287] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.577s	user 0.019s	sys 0.000s
I20260709 13:10:45.655375 31027 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:45.666350 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 80420.5us
I20260709 13:10:45.668654 31019 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:45.670698 31053 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:45.627869 30971 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:45.609169 31037 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:45.671303 30971 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.643543 30717 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.673372 30971 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.673808 30717 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.659789 31024 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:45.651639 30965 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:45.674738 31048 log.cc:927] Time spent T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:10:45.677804 30965 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.660562 30943 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:45.661054 31043 log.cc:927] Time spent T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:10:45.665652 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:45.674414 29745 raft_consensus.cc:2393] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:45.678340 30965 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.664951 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 583) took 1388 ms. Trace:
I20260709 13:10:45.641819 31022 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:45.667016 31041 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:10:45.705018 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.622781 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:45.706228 29747 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:45.668299 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:45.670885 31019 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:45.678797 31044 log.cc:927] Time spent T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:10:45.673332 31037 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.691751 29823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 587) took 1021 ms. Trace:
I20260709 13:10:45.708472 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:45.681878 30943 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:45.665011 30985 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:45.711696 29823 rpcz_store.cc:276] 0709 13:10:44.670014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.670154 (+   140us) service_pool.cc:224] Handling call
0709 13:10:44.670508 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.805151 (+134643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.805183 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.814109 (+  8926us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.355918 (+541809us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.689635 (+333717us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.691441 (+  1806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.691516 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.691554 (+    38us) raft_consensus.cc:1685] finished
0709 13:10:45.691565 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.691694 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135311,"raft.queue_time_us":162013,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":21606,"thread_start_us":725824,"threads_started":2,"wal-append.queue_time_us":719804}
I20260709 13:10:45.699206 29743 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:45.706588 30925 consensus_meta.cc:287] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.008s
I20260709 13:10:45.714787 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:45.718130 29823 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:45.720263 29747 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:45.718650 29744 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:45.714005 29741 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.738765 29817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 591) took 1050 ms. Trace:
I20260709 13:10:45.740274 29817 rpcz_store.cc:276] 0709 13:10:44.688454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.714560 (+ 26106us) service_pool.cc:224] Handling call
0709 13:10:44.714906 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.822964 (+108058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.823024 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.845707 (+ 22683us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.948719 (+103012us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b4800220158. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ee9e6aa1 00007fd9ee9ddb37 00007fd9ee9dd9ca 00007fd9eead526f 00007fd9eead4f37 00007fd9eeae955c 00007fd9eeae9508 00007fd9eeae9488 00007fd9eeae9443 00007fd9eeae86ec 00007fd9eda12a96
0709 13:10:45.337995 (+389276us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:45.338051 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.338130 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.738435 (+400305us) raft_consensus.cc:1685] finished
0709 13:10:45.738460 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.738703 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104619,"raft.queue_time_us":118486,"raft.run_cpu_time_us":906,"raft.run_wall_time_us":104774,"spinlock_wait_cycles":4662528,"thread_start_us":366572,"threads_started":1,"wal-append.queue_time_us":712777}
W20260709 13:10:45.735364 29820 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.011s	sys 0.000s
I20260709 13:10:45.741509 31027 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:10:45.748915 29820 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.012s	sys 0.000s
I20260709 13:10:45.734992 30925 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:45.762197 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 579) took 1555 ms. Trace:
W20260709 13:10:45.763304 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 139843us
I20260709 13:10:45.762681 29819 rpcz_store.cc:276] 0709 13:10:44.205315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.209032 (+  3717us) service_pool.cc:224] Handling call
0709 13:10:45.760455 (+1551423us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400018bd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:45.760605 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872994688}
W20260709 13:10:45.770572 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 166834us
I20260709 13:10:45.770148 30945 consensus_queue.cc:1059] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:45.772019 31061 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:45.774030 29787 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.775367 29787 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:45.776831 30960 consensus_meta.cc:287] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.001s
I20260709 13:10:45.777258 30960 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3.
I20260709 13:10:45.778302 30985 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:45.779069 30925 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:45.780055 31061 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:45.773584 30945 raft_consensus.cc:3055] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:45.780859 30945 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:45.688977 29814 rpcz_store.cc:276] 0709 13:10:44.276523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.646464 (+369941us) service_pool.cc:224] Handling call
0709 13:10:44.653764 (+  7300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.654028 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.654058 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.654553 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.497934 (+843381us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:45.500493 (+  2559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.520942 (+ 20449us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.660488 (+139546us) raft_consensus.cc:1685] finished
0709 13:10:45.661388 (+   900us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.664882 (+  3494us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":827798,"threads_started":1,"wal-append.queue_time_us":842104}
I20260709 13:10:45.767464 31014 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.788841 31030 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:45.789546 31030 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.790899 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.791188 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:45.791496 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.791821 29819 raft_consensus.cc:2368] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:45.790011 31030 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:45.792196 29817 raft_consensus.cc:2376] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3. Re-sending same reply.
I20260709 13:10:45.793695 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.794231 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.794557 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.794920 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:45.794867 29814 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.795253 29823 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.796667 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.796693 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:45.797658 29823 raft_consensus.cc:2393] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:45.766623 30917 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:10:45.802489 31027 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.802683 31022 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.803367 31027 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:45.803614 31030 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:45.805114 30344 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:45.802100 31060 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:45.773355 30717 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:45.802204 29820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 592) took 1113 ms. Trace:
I20260709 13:10:45.781850 30945 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.807797 30945 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:45.810031 31068 consensus_queue.cc:1175] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "42c443079435463daa8845e244cec9d3" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:10:45.806550 31060 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:45.809733 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.802500 30917 consensus_queue.cc:1243] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:45.811713 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.812386 29670 raft_consensus.cc:2368] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:45.813143 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.815029 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.815631 29670 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.816497 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.814126 29820 rpcz_store.cc:276] 0709 13:10:44.688695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.716829 (+ 28134us) service_pool.cc:224] Handling call
0709 13:10:44.717260 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.823978 (+106718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.824016 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:44.936813 (+112797us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.660625 (+723812us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e69b30ac 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b
0709 13:10:45.757944 (+ 97319us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:45.760354 (+  2410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.762116 (+  1762us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.800050 (+ 37934us) raft_consensus.cc:1685] finished
0709 13:10:45.800080 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.802136 (+  2056us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102370,"raft.queue_time_us":116222,"spinlock_wait_cycles":116474880,"thread_start_us":805403,"threads_started":1,"wal-append.queue_time_us":817804}
I20260709 13:10:45.817099 29670 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:45.818012 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.818223 30965 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.818758 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.819644 29670 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.820295 30965 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.820537 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.816984 31060 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:45.823105 30943 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.834568 29787 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.836546 31060 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:45.826058 30917 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:45.837570 30945 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:45.826089 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 80) took 2188 ms. Trace:
I20260709 13:10:45.826400 31039 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.836941 29787 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:45.839658 31039 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:45.841504 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.836979 31060 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:45.842767 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.842919 31072 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:45.843977 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.843125 31060 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.839079 29674 rpcz_store.cc:276] 0709 13:10:43.717694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.721360 (+  3666us) service_pool.cc:224] Handling call
0709 13:10:43.723919 (+  2559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.498598 (+1774679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.825803 (+327205us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b540027d3d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:45.826013 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3925849344}
I20260709 13:10:45.844079 31039 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.848198 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:45.838572 31026 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.902s	user 0.004s	sys 0.000s
I20260709 13:10:45.849433 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.848299 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.850082 29667 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:45.850298 29674 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:45.846724 30943 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.851079 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.851137 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.851835 29674 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:45.851959 29667 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:45.852609 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.825825 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.857652 29674 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:45.857820 29670 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:45.859267 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.859845 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.860323 29670 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:45.860574 29674 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:45.862017 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.863049 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.864066 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.864739 29674 raft_consensus.cc:2393] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:45.865456 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.866217 31060 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:45.868177 29674 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:45.869598 31060 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:45.870267 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.871050 29674 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:45.872073 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.872018 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:45.883065 29667 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 13:10:46.544215 29714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.002s	sys 0.032s
W20260709 13:10:46.544894 29714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.002s	sys 0.032s
W20260709 13:10:46.545256 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 898734us
I20260709 13:10:46.660813 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 626) took 1690 ms. Trace:
I20260709 13:10:46.661384 29744 rpcz_store.cc:276] 0709 13:10:44.970283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.745658 (+775375us) service_pool.cc:224] Handling call
0709 13:10:46.660123 (+914465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.660452 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:46.660479 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.660521 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:46.660553 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.660615 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.660750 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:46.663281 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 628) took 1692 ms. Trace:
I20260709 13:10:46.812333 29714 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:46.882635 29744 rpcz_store.cc:276] 0709 13:10:44.970747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.662468 (+1691721us) service_pool.cc:224] Handling call
0709 13:10:46.662789 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.662962 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.662998 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.663041 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:46.663069 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.663119 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.663225 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:47.351583 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 539126us
W20260709 13:10:47.354177 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.414585 30933 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.415853 30933 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:47.419582 30933 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.425324 29714 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:47.426949 29714 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:47.519407 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 92679.2us
I20260709 13:10:47.524290 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:47.525179 31057 log.cc:927] Time spent T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 1.875s	user 0.017s	sys 0.001s
I20260709 13:10:47.532218 29714 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:47.518633 31077 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.534375 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 631) took 2562 ms. Trace:
I20260709 13:10:47.544036 31077 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.544845 31077 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.544106 29744 rpcz_store.cc:276] 0709 13:10:44.971413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.354015 (+2382602us) service_pool.cc:224] Handling call
0709 13:10:47.354837 (+   822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.355456 (+   619us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:47.518181 (+162725us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.533650 (+ 15469us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.533727 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:47.533771 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.533853 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.534118 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":83146,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":91,"thread_start_us":173005,"threads_started":2,"wal-append.queue_time_us":15417}
I20260709 13:10:47.546092 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:47.547710 29669 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:47.548007 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 633) took 2434 ms. Trace:
I20260709 13:10:47.548570 29744 rpcz_store.cc:276] 0709 13:10:45.113626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.546734 (+2433108us) service_pool.cc:224] Handling call
0709 13:10:47.547218 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.547576 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.547622 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.547698 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:47.547732 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.547791 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.547932 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:47.548539 29669 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1115) took 2368 ms (client timeout 2305 ms). Trace:
I20260709 13:10:47.551393 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1169) took 2236 ms. Trace:
W20260709 13:10:47.551118 29669 rpcz_store.cc:269] 0709 13:10:45.180051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.196280 (+ 16229us) service_pool.cc:224] Handling call
0709 13:10:47.545602 (+2349322us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:47.548323 (+  2721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3425152}
I20260709 13:10:47.553375 29744 rpcz_store.cc:276] 0709 13:10:45.315529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.549911 (+2234382us) service_pool.cc:224] Handling call
0709 13:10:47.550572 (+   661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.550955 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.550984 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.551116 (+   132us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:47.551147 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.551207 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.551332 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.556638 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1170) took 2218 ms. Trace:
I20260709 13:10:47.557040 29744 rpcz_store.cc:276] 0709 13:10:45.338487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.555446 (+2216959us) service_pool.cc:224] Handling call
0709 13:10:47.555886 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.556320 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.556345 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.556399 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:47.556426 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.556476 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.556581 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.558373 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.560078 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.561360 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:47.548763 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:47.561902 29666 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:47.564640 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1111) took 2385 ms. Trace:
I20260709 13:10:47.564996 29666 rpcz_store.cc:276] 0709 13:10:45.178858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.179219 (+   361us) service_pool.cc:224] Handling call
0709 13:10:47.561029 (+2381810us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:47.561363 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.564282 (+  2919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.564534 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468736}
I20260709 13:10:47.568117 29669 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:47.569983 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:47.572301 29669 raft_consensus.cc:2376] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4. Re-sending same reply.
W20260709 13:10:47.574853 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.575766 30933 consensus_queue.cc:1059] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:47.577247 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:47.580330 30316 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:47.581733 30933 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:47.582312 30933 raft_consensus.cc:697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:47.583328 29818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 580) took 3371 ms. Trace:
I20260709 13:10:47.583817 29818 rpcz_store.cc:276] 0709 13:10:44.212153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.216227 (+  4074us) service_pool.cc:224] Handling call
0709 13:10:44.823998 (+607771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.288619 (+464621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.288669 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.288749 (+    80us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:45.288798 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.288882 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.582791 (+2293909us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b540012a2d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:47.583017 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6449,"raft.queue_time_us":103904,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":1397048576,"thread_start_us":402504,"threads_started":1}
I20260709 13:10:47.583909 30933 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:47.592103 29743 consensus_meta.cc:287] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 1.849s	user 0.020s	sys 0.015s
I20260709 13:10:47.592741 29743 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
W20260709 13:10:47.593535 29743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 88) took 2018 ms (client timeout 2133 ms). Trace:
W20260709 13:10:47.594926 29743 rpcz_store.cc:269] 0709 13:10:45.575135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.665339 (+ 90204us) service_pool.cc:224] Handling call
0709 13:10:47.593443 (+1928104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.602777 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:47.563737 29665 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
W20260709 13:10:47.611225 29665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1113) took 2431 ms (client timeout 1805 ms). Trace:
W20260709 13:10:47.611658 29665 rpcz_store.cc:269] 0709 13:10:45.179417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.181158 (+  1741us) service_pool.cc:224] Handling call
0709 13:10:45.427680 (+246522us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:47.548357 (+2120677us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998e9c 00007fd9e6998a5b 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:47.611150 (+ 62793us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149463296}
I20260709 13:10:47.562603 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:47.608790 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 76794.5us
I20260709 13:10:47.615173 29714 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:47.612804 29668 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1131) took 2313 ms (client timeout 1529 ms). Trace:
I20260709 13:10:47.615097 30971 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.616223 30971 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:10:47.616173 29668 rpcz_store.cc:269] 0709 13:10:45.299245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.602646 (+303401us) service_pool.cc:224] Handling call
0709 13:10:47.612580 (+2009934us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.616840 30971 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.617100 30924 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:47.617627 30924 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.619094 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.620199 29743 raft_consensus.cc:2410] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:47.621097 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.622781 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:47.623647 29743 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:47.627806 30831 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.628620 30831 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:47.629050 31077 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.629304 30831 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.630331 29744 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:47.631000 31082 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:47.631351 29714 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:47.631538 31082 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.632035 31082 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.632377 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1171) took 2277 ms. Trace:
I20260709 13:10:47.633220 30831 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.633848 30831 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:47.635294 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1060) took 2434 ms. Trace:
I20260709 13:10:47.638690 30831 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:47.639238 30917 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.644435 30917 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.646843 30917 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.637189 29670 rpcz_store.cc:276] 0709 13:10:45.200753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.874427 (+673674us) service_pool.cc:224] Handling call
0709 13:10:47.634356 (+1759929us) spinlock_profiling.cc:243] Waited 8.18 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998eee 0000000000375939 00007fd9eea0c1e0 00007fd9eead50c4 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:47.634569 (+   213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.634884 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.634906 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.634941 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:47.634965 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.635012 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.635122 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18820352}
I20260709 13:10:47.632314 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:47.648409 29674 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:47.648921 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1062) took 2447 ms. Trace:
I20260709 13:10:47.648823 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:47.649288 29674 rpcz_store.cc:276] 0709 13:10:45.201354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.874792 (+673438us) service_pool.cc:224] Handling call
0709 13:10:47.631984 (+1757192us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:47.648864 (+ 16880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27023616}
I20260709 13:10:47.645167 31082 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.615934 31079 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.651189 31079 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.651576 31079 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:47.652117 31082 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:47.652452 29789 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.855s	user 0.008s	sys 0.024s
W20260709 13:10:47.652953 29789 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.855s	user 0.008s	sys 0.024s
I20260709 13:10:47.653083 31082 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:47.653698 31082 raft_consensus.cc:697] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:47.655102 31082 consensus_queue.cc:237] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.655706 30998 raft_consensus.cc:3055] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:47.651927 31079 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.656179 30998 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:47.625785 30971 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.649746 29816 raft_consensus.cc:2368] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:47.643038 30924 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:47.659142 29816 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51156 (request call id 1103) took 2487 ms (client timeout 1575 ms). Trace:
W20260709 13:10:47.659513 29816 rpcz_store.cc:269] 0709 13:10:45.171424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.175793 (+  4369us) service_pool.cc:224] Handling call
0709 13:10:47.648440 (+2472647us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b58001d0498. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:47.659002 (+ 10562us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21032320}
I20260709 13:10:47.657584 30998 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:47.661911 30998 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.663692 30971 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:47.663288 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 1.86662e+06us
I20260709 13:10:47.661021 30924 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.664772 30924 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.665470 30924 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.665874 30917 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:47.674317 31083 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:47.675328 30917 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:47.675791 30917 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:47.667532 31077 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.677132 29714 leader_election.cc:400] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:47.677245 30917 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:47.678603 29714 leader_election.cc:403] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.679512 30917 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:47.679713 30831 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:47.681125 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08000d93c0 after lost signal to thread 28568
I20260709 13:10:47.682154 31077 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.684963 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1053) took 3551 ms. Trace:
I20260709 13:10:47.681959 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:47.688269 29673 rpcz_store.cc:276] 0709 13:10:44.133798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.591292 (+457494us) service_pool.cc:224] Handling call
0709 13:10:44.602900 (+ 11608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.588290 (+985390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.684457 (+2096167us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b5400145fd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:47.684806 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2122401152}
I20260709 13:10:47.690824 31040 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:47.691589 31040 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.683990 30924 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.689713 29714 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:47.700169 30971 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:47.701866 30971 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.704684 31079 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:47.705639 31045 log.cc:927] Time spent T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 2.219s	user 0.000s	sys 0.024s
I20260709 13:10:47.707003 31079 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.714442 31083 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.740679 31083 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:47.741161 31083 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.705296 30971 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.715584 31082 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.744056 31082 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.744494 31082 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.700894 31077 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
W20260709 13:10:47.759946 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:47.717360 29747 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.978s	user 0.009s	sys 0.013s
W20260709 13:10:47.760941 29747 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.022s	user 0.010s	sys 0.014s
W20260709 13:10:47.728185 31049 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 2.141s	user 0.008s	sys 0.017s
I20260709 13:10:47.730185 30917 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:47.762738 30917 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:47.738440 31040 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.770371 30917 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:47.761907 29787 connection.cc:256] RPC call timeout handler was delayed by -1.0649869700000636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33210000000000006s for a response
W20260709 13:10:47.773293 29787 connection.cc:256] RPC call timeout handler was delayed by -1.059314148999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:10:47.773633 29787 connection.cc:256] RPC call timeout handler was delayed by -1.0044141490000129s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 13:10:47.776449 29741 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
W20260709 13:10:47.777438 29741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48026 (request call id 1181) took 2236 ms (client timeout 2108 ms). Trace:
W20260709 13:10:47.777887 29741 rpcz_store.cc:269] 0709 13:10:45.540900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.664627 (+123727us) service_pool.cc:224] Handling call
0709 13:10:47.777327 (+2112700us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.779130 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.780599 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.770195 31083 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.783846 31027 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:47.784314 31027 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:47.781690 30917 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:47.785755 30917 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:47.770803 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.771047 30831 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:47.632809 29743 rpcz_store.cc:276] 0709 13:10:45.352318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.624236 (+2271918us) service_pool.cc:224] Handling call
0709 13:10:47.624680 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.625042 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.629529 (+  4487us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.629608 (+    79us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:47.629644 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.629709 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.629842 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.790552 31090 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:47.792332 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:47.794834 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 99209.3us
I20260709 13:10:47.784667 31083 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.783993 31082 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.797292 29744 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:47.800762 31050 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.785529 31027 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.791662 30998 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.795223 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:47.803264 31058 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 2.112s	user 0.003s	sys 0.013s
W20260709 13:10:47.804953 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.809005 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 618) took 3064 ms. Trace:
I20260709 13:10:47.814102 30831 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.823662 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1175) took 2364 ms. Trace:
I20260709 13:10:47.826448 31082 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.841230 29744 rpcz_store.cc:276] 0709 13:10:45.458812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.796063 (+2337251us) service_pool.cc:224] Handling call
0709 13:10:47.797080 (+  1017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.822840 (+ 25760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.823082 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.827310 31050 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.832986 31090 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.833827 31040 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:47.834573 29638 connection.cc:256] RPC call timeout handler was delayed by -1.5622817890000533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:10:47.844412 29638 connection.cc:256] RPC call timeout handler was delayed by -1.5145817889999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
I20260709 13:10:47.844558 31040 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.834777 29743 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:47.836452 30917 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:47.838547 31027 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.843650 30845 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:47.846308 29638 connection.cc:256] RPC call timeout handler was delayed by -1.0494757170000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 13:10:47.840902 29740 rpcz_store.cc:276] 0709 13:10:44.744768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.901375 (+156607us) service_pool.cc:224] Handling call
0709 13:10:44.946400 (+ 45025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.993774 (+ 47374us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:45.028784 (+ 35010us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.425257 (+396473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.425448 (+   191us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.425595 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.524156 (+2098561us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:47.808521 (+284365us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b540031a6d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:47.808585 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.808813 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24968,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":144,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":83625088,"thread_start_us":369191,"threads_started":1,"wal-append.queue_time_us":596132}
I20260709 13:10:47.851341 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:47.852092 29673 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.852972 30831 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.853583 30831 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:47.854274 30831 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.855661 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:47.856841 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:47.857075 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:47.857856 29666 raft_consensus.cc:2410] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:47.857975 29668 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.859622 30945 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.860263 30945 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.862449 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:47.863081 31050 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.863762 31050 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.864467 31050 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:47.866456 31040 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:47.851711 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:47.869176 31090 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.849787 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.870841 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.871001 31090 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:47.871526 29744 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:47.871680 31090 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.875375 29673 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:47.880667 30998 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:47.878530 30831 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.883064 30945 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.886968 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1174) took 2486 ms. Trace:
I20260709 13:10:47.887493 29743 rpcz_store.cc:276] 0709 13:10:45.400788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.794366 (+2393578us) service_pool.cc:224] Handling call
0709 13:10:47.834518 (+ 40152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.849058 (+ 14540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.886873 (+ 37815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.888744 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1107) took 2098 ms. Trace:
I20260709 13:10:47.880292 31090 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:47.896883 29822 rpcz_store.cc:276] 0709 13:10:45.790212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.790353 (+   141us) service_pool.cc:224] Handling call
0709 13:10:45.790660 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.822530 (+ 31870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.822560 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.822603 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:45.822631 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.888287 (+2065656us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b54000d2354. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:47.888347 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.888562 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10139,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":4795264,"thread_start_us":29406,"threads_started":1}
I20260709 13:10:47.888741 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:47.953661 30346 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:47.956799 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:47.960049 30348 raft_consensus.cc:2393] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
W20260709 13:10:47.960511 30348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 95) took 2959 ms (client timeout 2145 ms). Trace:
W20260709 13:10:47.960897 30348 rpcz_store.cc:269] 0709 13:10:45.024841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.026878 (+  2037us) service_pool.cc:224] Handling call
0709 13:10:47.956503 (+2929625us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:47.960418 (+  3915us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20165376}
I20260709 13:10:47.955128 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:47.964524 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:47.970587 29714 connection.cc:256] RPC call timeout handler was delayed by -1.4288967749999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260709 13:10:47.964197 29747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 625) took 3212 ms. Trace:
I20260709 13:10:47.964236 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:47.974255 29714 leader_election.cc:400] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:47.976239 29714 leader_election.cc:403] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.973065 30343 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:47.981441 29744 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.984547 30345 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:47.985392 30345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 100) took 2761 ms. Trace:
I20260709 13:10:47.986662 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:47.971206 29747 rpcz_store.cc:276] 0709 13:10:44.752694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.722207 (+969513us) service_pool.cc:224] Handling call
0709 13:10:45.722445 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.722619 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:47.761455 (+2038836us) log.cc:844] Serialized 14 byte log entry
0709 13:10:47.839944 (+ 78489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:47.840146 (+   202us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:47.841260 (+  1114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.847447 (+  6187us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.964086 (+116639us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":123110,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":458,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":159,"thread_start_us":2097152,"threads_started":2,"wal-append.queue_time_us":119121}
I20260709 13:10:47.994773 31082 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:47.996819 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:47.998440 30348 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:47.998603 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:47.985795 30345 rpcz_store.cc:276] 0709 13:10:45.270313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.983467 (+2713154us) service_pool.cc:224] Handling call
0709 13:10:47.983918 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:47.985027 (+  1109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.985301 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:47.999881 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:48.000571 30343 raft_consensus.cc:2376] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4. Re-sending same reply.
I20260709 13:10:48.002357 31005 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.002801 31090 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:48.003791 30945 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:48.003580 31090 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.004698 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.004549 30945 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.005820 29818 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:48.006024 31090 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.006646 31090 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.007045 30945 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.007226 31090 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.003589 31094 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:48.007247 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.009302 31050 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:48.002413 29669 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:48.008719 29822 raft_consensus.cc:2410] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:48.008828 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.010941 29816 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:47.993427 30998 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.003105 31005 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.017596 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.017962 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.018524 29816 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:48.018746 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.006557 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.031347 29740 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:48.032513 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.022975 31091 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.034365 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.034888 31040 raft_consensus.cc:1064] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:48.035168 29740 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
W20260709 13:10:48.035372 31040 raft_consensus.cc:1068] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:48.008781 31094 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.036998 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1176) took 2568 ms. Trace:
I20260709 13:10:48.039880 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:48.041954 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:48.048022 29746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48026 (request call id 1164) took 4216 ms (client timeout 3321 ms). Trace:
W20260709 13:10:48.048491 29746 rpcz_store.cc:269] 0709 13:10:43.831283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.837209 (+  5926us) service_pool.cc:224] Handling call
0709 13:10:48.047620 (+4210411us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003b9054. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:48.047831 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2919987968}
I20260709 13:10:48.050702 29749 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:48.050797 31091 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.019224 31005 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.024890 29669 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:48.054039 29670 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:48.030167 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.030576 31090 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.057514 29816 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:48.061875 31094 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.062086 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.064316 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.069073 29668 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:48.069097 29674 raft_consensus.cc:2368] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:48.066256 29741 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:48.070937 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.071784 29674 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:10:48.072562 30314 connection.cc:256] RPC call timeout handler was delayed by -1.5045489940000607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
I20260709 13:10:48.068590 31004 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:48.073478 31004 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:48.068092 31091 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.074198 29816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:48.074999 29816 raft_consensus.cc:606] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.072779 29741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1180) took 2568 ms. Trace:
I20260709 13:10:48.071002 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1179) took 2570 ms. Trace:
W20260709 13:10:48.075892 31034 log.cc:927] Time spent T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 2.431s	user 0.011s	sys 0.007s
I20260709 13:10:48.076210 29748 rpcz_store.cc:276] 0709 13:10:45.500169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.069839 (+2569670us) service_pool.cc:224] Handling call
0709 13:10:48.070419 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.070696 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.070719 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.070773 (+    54us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:48.070804 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.070851 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.070953 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.075450 29816 raft_consensus.cc:614] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:48.072716 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:48.079279 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:48.074462 31004 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.091650 31004 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.092262 29742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1166) took 4255 ms. Trace:
I20260709 13:10:48.092684 29742 rpcz_store.cc:276] 0709 13:10:43.836563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.872296 (+ 35733us) service_pool.cc:224] Handling call
0709 13:10:43.953883 (+ 81587us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:44.029435 (+ 75552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.035930 (+  6495us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:44.075651 (+ 39721us) log.cc:844] Serialized 52 byte log entry
0709 13:10:45.206712 (+1131061us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:45.213144 (+  6432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.223602 (+ 10458us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:48.075226 (+2851624us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:48.091776 (+ 16550us) raft_consensus.cc:1685] finished
0709 13:10:48.091804 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.092078 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3647,"raft.queue_time_us":6167,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":32620,"spinlock_wait_cycles":18838400,"thread_start_us":1108063,"threads_started":1,"wal-append.queue_time_us":1530295}
I20260709 13:10:48.094339 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:48.095155 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.095824 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.095912 29673 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:48.096568 29668 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:48.096670 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.097088 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.097506 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.098047 29673 raft_consensus.cc:2368] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:48.092796 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:48.098452 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1059) took 3962 ms. Trace:
I20260709 13:10:48.097826 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.099006 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.100455 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.101246 29673 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:48.102151 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.102326 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:48.106581 29744 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:48.117064 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.119333 29746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1177) took 2635 ms. Trace:
W20260709 13:10:48.120940 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 54144.7us
I20260709 13:10:48.123050 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.075822 29741 rpcz_store.cc:276] 0709 13:10:45.504897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.071639 (+2566742us) service_pool.cc:224] Handling call
0709 13:10:48.072226 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.072443 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.072475 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.072527 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:48.072561 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.072619 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.072726 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.128073 29789 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:10:48.037405 29740 rpcz_store.cc:276] 0709 13:10:45.469040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.035937 (+2566897us) service_pool.cc:224] Handling call
0709 13:10:48.036334 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.036631 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.036660 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.036713 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:48.036746 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.036810 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.036936 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:48.129317 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.130600 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.117931 29818 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:10:48.132432 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.126873 31091 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.133937 31013 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:48.135972 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.136562 31091 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.139789 31091 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:48.142439 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.143723 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.144773 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.145325 29674 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:48.124243 29746 rpcz_store.cc:276] 0709 13:10:45.484425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.049281 (+2564856us) service_pool.cc:224] Handling call
0709 13:10:48.049685 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.052168 (+  2483us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:48.052514 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 13:10:48.118977 (+ 66463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:48.119040 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:48.119085 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.119153 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:48.119273 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2582,"prepare.queue_time_us":202,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":32265,"spinlock_wait_cycles":6400,"thread_start_us":33933,"threads_started":1,"wal-append.queue_time_us":34345}
I20260709 13:10:48.147749 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.098894 29671 rpcz_store.cc:276] 0709 13:10:44.135431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.600513 (+465082us) service_pool.cc:224] Handling call
0709 13:10:44.600866 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.138764 (+537898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.098006 (+2959242us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54001446d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:48.098299 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034940160}
I20260709 13:10:48.148488 29667 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:48.148914 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.149468 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.150856 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.151737 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.151104 29571 catalog_manager.cc:5697] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:48.149601 29671 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.154865 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.152830 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.152803 29571 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.152113 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.159555 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.155838 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:48.160797 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.163141 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.164354 29673 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:48.164275 31091 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:48.167210 31091 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:48.167703 31091 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:48.168388 29745 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 84) took 3215 ms (client timeout 1738 ms). Trace:
I20260709 13:10:48.165117 29571 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
W20260709 13:10:48.168783 29745 rpcz_store.cc:269] 0709 13:10:44.952523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.101895 (+149372us) service_pool.cc:224] Handling call
0709 13:10:48.168011 (+3066116us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54001676d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:48.168222 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289215872}
I20260709 13:10:48.170358 29748 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:48.170128 29571 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.171690 29571 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:48.172153 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.173195 29571 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:48.174204 29744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dff620b2062c4139940ec520664442a1"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:10:48.174834 29744 raft_consensus.cc:606] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:10:48.163548 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 47206.1us
W20260709 13:10:48.176954 30315 connection.cc:256] RPC call timeout handler was delayed by -2.2950121240000954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 13:10:48.177320 30315 connection.cc:256] RPC call timeout handler was delayed by -1.7226121240000793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2736s for a response
I20260709 13:10:48.169067 29668 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:48.182948 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 202) took 8527 ms. Trace:
I20260709 13:10:48.183094 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.184129 30845 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:48.184484 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.185288 29822 raft_consensus.cc:2410] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:48.185389 29749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 620) took 3440 ms. Trace:
W20260709 13:10:48.186192 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.186935 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.193091 29673 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:48.194675 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 72432.9us
W20260709 13:10:48.196111 29715 connection.cc:256] RPC call timeout handler was delayed by -2.1755288629999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:10:48.196496 29715 connection.cc:256] RPC call timeout handler was delayed by -2.1566288630000372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260709 13:10:48.196811 29715 connection.cc:256] RPC call timeout handler was delayed by -2.0765288630000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 13:10:48.197093 29715 connection.cc:256] RPC call timeout handler was delayed by -2.0432288629999675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:10:48.197365 29715 connection.cc:256] RPC call timeout handler was delayed by -2.0333288629999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
W20260709 13:10:48.197644 29715 connection.cc:256] RPC call timeout handler was delayed by -2.0153288630000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:10:48.185842 29749 rpcz_store.cc:276] 0709 13:10:44.745240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.904842 (+159602us) service_pool.cc:224] Handling call
0709 13:10:48.050310 (+3145468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:48.051510 (+  1200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:48.185152 (+133642us) spinlock_profiling.cc:243] Waited 3.14 s on lock 0x7b54003b9050. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:48.185328 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7233289088}
I20260709 13:10:48.192227 30845 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.201076 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.204553 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:48.197903 29715 connection.cc:256] RPC call timeout handler was delayed by -1.9811288629999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 13:10:48.200062 30314 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.203786 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.211472 29818 raft_consensus.cc:2410] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:48.211841 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.213133 31039 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.213649 31039 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:48.214669 31039 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.215068 31081 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:48.210268 29816 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
W20260709 13:10:48.210391 29715 connection.cc:256] RPC call timeout handler was delayed by -1.9568288629999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 13:10:48.218878 29715 connection.cc:256] RPC call timeout handler was delayed by -1.8704288630000292s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 13:10:48.219321 29715 connection.cc:256] RPC call timeout handler was delayed by -1.8353152049999153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
I20260709 13:10:48.205749 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:48.201828 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9e80 after lost signal to thread 29606
W20260709 13:10:48.219739 29715 connection.cc:256] RPC call timeout handler was delayed by -1.834428862999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:10:48.224086 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.226037 29715 connection.cc:256] RPC call timeout handler was delayed by -1.8173288629999433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:10:48.226220 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.199106 31052 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:10:48.226476 29715 connection.cc:256] RPC call timeout handler was delayed by -1.8038152049999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:10:48.216480 29743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dff620b2062c4139940ec520664442a1"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:10:48.226998 29820 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.230219 29743 raft_consensus.cc:606] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Received request to transfer leadership
W20260709 13:10:48.229373 29715 connection.cc:256] RPC call timeout handler was delayed by -1.8038152049999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 13:10:48.232534 29715 connection.cc:256] RPC call timeout handler was delayed by -1.7498288629999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:10:48.232780 29715 connection.cc:256] RPC call timeout handler was delayed by -1.7435152049999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:10:48.233983 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:48.234666 29715 connection.cc:256] RPC call timeout handler was delayed by -1.7336288630000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
W20260709 13:10:48.235064 29715 connection.cc:256] RPC call timeout handler was delayed by -1.7336288630000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:10:48.234998 29816 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:48.235572 29715 connection.cc:256] RPC call timeout handler was delayed by -1.6697288629999321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:10:48.235805 29715 connection.cc:256] RPC call timeout handler was delayed by -1.5272557529998494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:10:48.236011 29715 connection.cc:256] RPC call timeout handler was delayed by -1.519415204999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 13:10:48.236202 29715 connection.cc:256] RPC call timeout handler was delayed by -1.4834152049999147s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:10:48.236398 29715 connection.cc:256] RPC call timeout handler was delayed by -1.477755752999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
W20260709 13:10:48.236609 29715 connection.cc:256] RPC call timeout handler was delayed by -1.3754152049999675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:10:48.236810 29715 connection.cc:256] RPC call timeout handler was delayed by -1.3754152049999675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 13:10:48.237013 29715 connection.cc:256] RPC call timeout handler was delayed by -1.3517557529999067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 13:10:48.237211 29715 connection.cc:256] RPC call timeout handler was delayed by -1.3472557529998994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:10:48.237435 29715 connection.cc:256] RPC call timeout handler was delayed by -1.2707557529998894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:10:48.237735 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080031b760 after lost signal to thread 29698
I20260709 13:10:48.257668 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:48.257985 29770 debug-util.cc:398] Leaking SignalData structure 0x7b0800386ce0 after lost signal to thread 29699
I20260709 13:10:48.258505 29741 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:48.258867 30348 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:48.238106 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.238226 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:48.259167 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080037dc60 after lost signal to thread 29773
I20260709 13:10:48.243518 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.260152 29668 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:48.260349 29822 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:48.229031 31052 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:48.245399 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.245949 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.248059 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.248359 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.248059 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.248873 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.205165 30315 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.250146 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.250631 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.252163 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.254434 29823 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:48.254284 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.255517 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.268024 29745 raft_consensus.cc:2393] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.256615 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.256910 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.259166 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:48.232120 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 49716.9us
I20260709 13:10:48.243748 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.183490 29572 rpcz_store.cc:276] 0709 13:10:39.622374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.622501 (+   127us) service_pool.cc:224] Handling call
0709 13:10:39.660749 (+ 38248us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54001bec54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a27090 00007fd9e9ac5f3a 00007fd9ef87c1cc 00007fd9ef97a37e 00007fd9ede3b2a4 00007fd9ede3b232 00007fd9ede3b161 00007fd9ede3b0dc 00007fd9ede3a392 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:48.149830 (+8489081us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:42.043305 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:42.106374 (+ 63069us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:42.106414 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:10:42.106433 (+    19us) tablet.cc:662] Decoding operations
0709 13:10:42.107035 (+   602us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:42.107097 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:42.107134 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:10:42.107525 (+   391us) tablet.cc:701] Row locks acquired
0709 13:10:42.107541 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:10:42.107704 (+   163us) write_op.cc:270] Start()
0709 13:10:42.107835 (+   131us) write_op.cc:276] Timestamp: P: 1783602642107655 usec, L: 0
0709 13:10:42.107855 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:10:42.139344 (+ 31489us) log.cc:844] Serialized 1759 byte log entry
0709 13:10:43.647302 (+1507958us) op_driver.cc:464] REPLICATION: finished
0709 13:10:44.851464 (+1204162us) write_op.cc:301] APPLY: starting
0709 13:10:44.886394 (+ 34930us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:44.905481 (+ 19087us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:44.940492 (+ 35011us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:44.947789 (+  7297us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:44.947980 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:10:44.948026 (+    46us) write_op.cc:312] APPLY: finished
0709 13:10:45.013697 (+ 65671us) log.cc:844] Serialized 40 byte log entry
0709 13:10:45.425541 (+411844us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:45.425909 (+   368us) write_op.cc:454] Released schema lock
0709 13:10:45.426081 (+   172us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:45.426693 (+   612us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:45.426744 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":32083328,"child_traces":[["op",{"apply.queue_time_us":1173116,"apply.run_cpu_time_us":35641,"apply.run_wall_time_us":592820,"num_ops":4,"prepare.queue_time_us":757801,"prepare.run_cpu_time_us":51491,"prepare.run_wall_time_us":1007259,"raft.queue_time_us":499456,"raft.run_cpu_time_us":95895,"raft.run_wall_time_us":1048758,"replication_time_us":1539281,"thread_start_us":3261557,"threads_started":5,"wal-append.queue_time_us":1598156,"wal-append.run_cpu_time_us":21270,"wal-append.run_wall_time_us":2335206}]]}
I20260709 13:10:48.262856 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:48.270229 29816 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
W20260709 13:10:48.261081 29715 connection.cc:256] RPC call timeout handler was delayed by -1.2584152050000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:10:48.267997 29748 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:48.267617 29823 pending_rounds.cc:85] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 1
W20260709 13:10:48.271744 29715 connection.cc:256] RPC call timeout handler was delayed by -1.2584152050000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 13:10:48.272500 29715 connection.cc:256] RPC call timeout handler was delayed by -1.2284557529999347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 13:10:48.272655 29817 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
W20260709 13:10:48.273361 29715 connection.cc:256] RPC call timeout handler was delayed by -1.2122557529999085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 13:10:48.273941 29715 connection.cc:256] RPC call timeout handler was delayed by -1.1756152049999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:10:48.274330 29715 connection.cc:256] RPC call timeout handler was delayed by -1.1105557529998578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:10:48.274225 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:48.274857 29715 connection.cc:256] RPC call timeout handler was delayed by -1.0205557529999396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
I20260709 13:10:48.276346 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.277030 29669 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:48.265794 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080037dc80 after lost signal to thread 29774
I20260709 13:10:48.273350 29747 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:48.272110 29823 pending_rounds.cc:107] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:48.282337 29823 raft_consensus.cc:2889] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:48.283643 29742 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.285180 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.286082 29822 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.289122 29746 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:48.261135 29671 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:48.293291 29670 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:48.293558 30919 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:48.294044 29819 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:48.289808 29640 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:48.296325 31022 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:48.296851 31022 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:48.297128 29820 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:48.298429 29814 raft_consensus.cc:2410] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:48.297856 31022 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.245414 31091 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.267323 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:48.294171 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.307094 29821 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:48.299489 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.309149 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.311893 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.308321 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.312990 29819 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.314472 29747 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.309063 29715 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.307188 31004 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.316591 30919 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:48.317636 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 112587us
I20260709 13:10:48.318573 30315 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.319183 31052 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.320407 31052 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:48.315745 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080022fe20 after lost signal to thread 29847
W20260709 13:10:48.321146 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080028ff00 after lost signal to thread 29848
W20260709 13:10:48.322292 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080009a180 after lost signal to thread 30374
I20260709 13:10:48.322681 29667 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
W20260709 13:10:48.322607 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080024b620 after lost signal to thread 30375
I20260709 13:10:48.324716 29746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dff620b2062c4139940ec520664442a1"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:10:48.325405 29746 raft_consensus.cc:606] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:10:48.323088 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.317803 30919 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.328951 31009 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.328877 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.331617 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.329180 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.333545 30845 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.328998 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.334849 29742 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.335386 29819 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:48.336113 29821 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:48.340052 29715 leader_election.cc:336] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.508s (SENT)
I20260709 13:10:48.342336 29715 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.342983 29669 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
W20260709 13:10:48.337375 31039 raft_consensus.cc:2771] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Leader pre-election decision while not in active config. Result: Term 5: won. RaftConfig: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:48.346951 30348 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:48.349145 31009 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:48.326757 30919 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.351094 29787 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.360249 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.367075 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:48.368129 30925 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.368654 30925 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:48.368986 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:48.369755 31009 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:48.370154 31009 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:48.370115 31082 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.326959 30315 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:48.370669 31009 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.371455 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.329304 30852 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:10:48.374531 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:48.337669 30845 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:48.386022 31039 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:48.386328 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.386958 29823 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.389078 31094 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:48.390060 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.391743 29821 raft_consensus.cc:2393] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:48.369004 30925 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.392890 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.400954 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.400290 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.407553 29823 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
W20260709 13:10:48.412743 29715 leader_election.cc:336] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.520s (SENT)
I20260709 13:10:48.411846 29821 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:48.415588 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.416630 29747 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.396127 29742 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.395440 31094 raft_consensus.cc:697] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:48.425465 31094 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.426832 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.428130 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.411760 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.429256 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.429936 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.429870 29819 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:48.431918 29819 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:48.432798 30959 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:48.395979 30852 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:48.395066 31091 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:48.399740 31009 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.438580 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.439236 29742 raft_consensus.cc:2376] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3. Re-sending same reply.
I20260709 13:10:48.440013 31009 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:48.436725 30959 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:48.440694 30959 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:48.440845 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.441592 29742 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
W20260709 13:10:48.397184 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 77106.1us
I20260709 13:10:48.443876 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:48.444007 30959 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.437064 29821 raft_consensus.cc:1240] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:10:48.445241 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:10:48.445302 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.438434 30852 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:48.446779 30852 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.450757 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.446113 31039 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.452826 29822 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:48.453264 29747 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:10:48.455081 29715 leader_election.cc:336] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.529s (SENT)
I20260709 13:10:48.453850 29746 raft_consensus.cc:2376] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3. Re-sending same reply.
W20260709 13:10:48.457327 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.459681 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.460215 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.461005 29740 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.461838 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.465238 29638 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:48.468762 29715 leader_election.cc:336] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.575s (SENT)
I20260709 13:10:48.445405 30959 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.454833 31039 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.472541 31024 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:48.478639 31040 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.481110 29789 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:48.481519 31039 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:48.493299 29715 leader_election.cc:336] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.617s (SENT)
I20260709 13:10:48.497023 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.497431 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.497635 29748 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.500521 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.485584 31024 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.503544 29745 raft_consensus.cc:2393] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:48.507576 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.508292 29746 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:48.491662 31040 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:48.517091 29745 pending_rounds.cc:85] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 2
I20260709 13:10:48.504761 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:48.505195 31024 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.526074 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.526904 29816 raft_consensus.cc:2376] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4. Re-sending same reply.
I20260709 13:10:48.497246 30919 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.528916 29749 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:48.535516 31022 raft_consensus.cc:1064] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:10:48.536049 31022 raft_consensus.cc:1068] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:48.538555 29742 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:48.540056 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.541504 29742 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:48.543797 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.526163 29787 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.515825 31040 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.520761 31090 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.547137 29747 raft_consensus.cc:1240] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:48.553895 29787 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.517432 29745 pending_rounds.cc:107] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
I20260709 13:10:48.554857 29745 raft_consensus.cc:2917] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
I20260709 13:10:48.557644 29745 raft_consensus.cc:2889] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:48.558859 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.559577 29669 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:48.555933 29787 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.564685 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:48.567015 29715 leader_election.cc:336] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.686s (SENT)
I20260709 13:10:48.556941 30924 consensus_queue.cc:1059] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:10:48.553416 31090 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:48.569844 30925 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.561019 30917 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.572180 30917 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:48.572371 29743 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:48.571444 31090 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.569836 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:48.574010 31068 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.574402 31068 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.574734 31068 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.575145 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.575673 29744 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.575976 29820 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:48.578594 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:48.580430 29789 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:48.581367 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.581772 31091 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.582299 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:48.583150 29787 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.584429 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:48.583150 30345 raft_consensus.cc:2393] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:48.586743 31004 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:48.587031 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:48.589210 31009 consensus_queue.cc:1059] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:48.590147 31009 raft_consensus.cc:3055] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:48.590458 31009 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:10:48.590867 29715 leader_election.cc:336] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.720s (SENT)
I20260709 13:10:48.591756 30924 raft_consensus.cc:3055] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:48.592133 30924 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:48.592996 31091 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:48.593441 31091 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.594359 31022 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.591305 29715 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.595430 31004 consensus_queue.cc:1059] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:48.596433 31004 raft_consensus.cc:3055] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:48.591595 30917 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.596771 31004 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:48.592964 30924 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.599449 30924 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.596663 31061 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.594570 30919 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:48.601367 30852 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.610859 29746 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:48.612712 29748 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:48.615147 29789 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.616480 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.620667 29744 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:48.617650 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:10:48.611889 29715 leader_election.cc:336] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.751s (SENT)
I20260709 13:10:48.595222 31022 raft_consensus.cc:3055] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:48.642282 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:48.642752 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:48.606338 31061 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.644704 31027 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.645183 31027 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:48.645582 31027 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.650700 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.651876 30965 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.652654 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.657061 31027 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.661234 30965 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.662587 29789 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.663435 30965 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:48.663767 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:48.664539 30965 raft_consensus.cc:2764] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:48.591358 31009 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.669198 31027 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:48.689110 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 106041us
I20260709 13:10:48.606999 30925 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:48.624814 31094 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.624626 31052 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.695880 29787 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.624734 31082 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:48.717199 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 105334us
I20260709 13:10:48.597774 31004 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.643056 31022 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:48.721001 29787 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:48.642728 31040 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:48.732602 31116 log.cc:927] Time spent T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:10:48.738590 29744 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:48.730280 29715 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.805s (SENT)
I20260709 13:10:48.743242 29715 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.724788 29814 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:48.731717 31030 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.730101 31027 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:48.748921 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 134473us
I20260709 13:10:48.729569 31094 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.730618 31009 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.739984 30852 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:48.769439 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:48.746042 31004 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.784228 31068 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.747246 31024 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:48.786579 31120 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.184s	user 0.000s	sys 0.002s
I20260709 13:10:48.747753 30919 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:48.787885 31024 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:48.788620 31024 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:48.778172 31027 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:48.790666 31027 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.792517 31081 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:48.792929 31081 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:48.750952 31030 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:48.768390 31005 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:48.795995 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 74403us
I20260709 13:10:48.766690 31094 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:48.800762 29787 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:48.803582 29715 leader_election.cc:336] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.866s (SENT)
W20260709 13:10:48.766386 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 56062.7us
W20260709 13:10:48.813089 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58050.6us
I20260709 13:10:48.815562 29745 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:48.816208 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 151339us
I20260709 13:10:48.797989 31030 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.818642 29787 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.804464 31094 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.807937 31131 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:48.786608 31090 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.828285 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:48.832111 29715 leader_election.cc:336] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.870s (SENT)
I20260709 13:10:48.832664 29715 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.798923 30917 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.773281 31022 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.835161 29789 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.836719 30919 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:48.837646 29715 leader_election.cc:336] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.981s (SENT)
I20260709 13:10:48.838088 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.838093 29787 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:48.793823 31081 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.839470 31081 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:48.840260 31124 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:48.840605 31082 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:48.843238 30965 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:48.844429 30965 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.847569 31005 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.848076 31005 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.848959 31061 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.849833 31061 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.850533 31061 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.851305 31061 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:48.851660 31061 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:48.824296 31052 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:48.863022 31052 raft_consensus.cc:697] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:48.864051 31052 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.866566 31022 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:48.855836 29814 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:48.871575 31005 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.817847 31039 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:48.875528 31039 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:48.876010 29639 connection.cc:256] RPC call timeout handler was delayed by -2.6669463790000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:10:48.876426 29639 connection.cc:256] RPC call timeout handler was delayed by -2.6471463789999916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 13:10:48.876698 29639 connection.cc:256] RPC call timeout handler was delayed by -2.6417463789999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:10:48.876986 29639 connection.cc:256] RPC call timeout handler was delayed by -2.4527463790000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 13:10:48.877255 29639 connection.cc:256] RPC call timeout handler was delayed by -2.450046379000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:10:48.877511 29639 connection.cc:256] RPC call timeout handler was delayed by -2.4428463790000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 13:10:48.853375 31061 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.879127 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.857932 31068 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:48.882856 31123 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:48.860122 31040 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:48.853278 29820 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:48.854341 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:48.886365 29815 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:48.824100 31133 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:10:48.834575 30344 raft_consensus.cc:1240] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:48.888123 30917 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:48.887892 30965 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:48.889941 31061 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:48.877760 29639 connection.cc:256] RPC call timeout handler was delayed by -2.430246378999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 13:10:48.883451 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:48.890450 29639 connection.cc:256] RPC call timeout handler was delayed by -2.3042463790000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
W20260709 13:10:48.890792 29639 connection.cc:256] RPC call timeout handler was delayed by -2.2988463789999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:10:48.823159 31091 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:48.899523 31091 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:48.891973 31131 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:48.900643 30348 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:48.900916 31131 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:48.902357 31129 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:10:48.904417 29639 connection.cc:256] RPC call timeout handler was delayed by -2.2952463789999911s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:10:48.904857 29639 connection.cc:256] RPC call timeout handler was delayed by -2.2619463790000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:10:48.905086 29639 connection.cc:256] RPC call timeout handler was delayed by -2.2610463790000495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 13:10:48.905308 29639 connection.cc:256] RPC call timeout handler was delayed by -2.2277463789999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:10:48.905532 29639 connection.cc:256] RPC call timeout handler was delayed by -2.1899463790000482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 13:10:48.905748 29639 connection.cc:256] RPC call timeout handler was delayed by -2.1413463789999696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:10:48.905977 29639 connection.cc:256] RPC call timeout handler was delayed by -2.0351463790000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:10:48.906193 29639 connection.cc:256] RPC call timeout handler was delayed by -1.9595463790000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2332s for a response
W20260709 13:10:48.906400 29639 connection.cc:256] RPC call timeout handler was delayed by -1.8299463790000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24760000000000001s for a response
W20260709 13:10:48.906615 29639 connection.cc:256] RPC call timeout handler was delayed by -1.6805463790000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2642s for a response
W20260709 13:10:48.906821 29639 connection.cc:256] RPC call timeout handler was delayed by -1.2251463789999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3148s for a response
W20260709 13:10:48.907024 29639 connection.cc:256] RPC call timeout handler was delayed by -1.1864463790000173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3191s for a response
I20260709 13:10:48.873648 31005 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:48.911715 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.890211 31090 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:48.926245 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 88619us
W20260709 13:10:48.972091 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 86595.8us
I20260709 13:10:48.972926 31081 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:48.988747 31094 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:48.999501 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 161472us
W20260709 13:10:49.000026 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 164939us
I20260709 13:10:49.002795 29789 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.003170 29638 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:49.003978 29715 leader_election.cc:336] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 2.070s (SENT)
I20260709 13:10:49.004431 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.004505 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.005839 29789 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.006496 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.008597 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.009733 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.023257 31052 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.029886 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.032063 29748 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.032002 29747 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.033246 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:48.990093 31030 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:49.004369 31127 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:49.036554 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.041566 29748 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:49.023851 31027 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:49.024104 31140 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.070375 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.035193 30919 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:49.064843 29715 leader_election.cc:336] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 2.083s (SENT)
I20260709 13:10:49.024638 31004 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:49.064939 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:49.066438 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.080013 29742 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.074724 29789 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.075744 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.037029 31146 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:10:49.086498 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.087073 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.087451 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.089270 29748 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:49.087451 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.090914 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.066900 31027 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:49.067557 31129 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.096632 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.097321 29746 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.100061 29749 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.103298 29787 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.093982 30924 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:49.107110 30314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.101697 29715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.68:42165 timed out after 2.156s (SENT) [suppressed 77 similar messages]
I20260709 13:10:49.092603 30919 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.095077 31027 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:49.117658 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 107769us
I20260709 13:10:49.066562 31127 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:49.125528 31138 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:49.120342 31061 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.104271 31129 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.109338 31146 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.142377 29746 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:49.168748 31040 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.169691 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:49.133353 29715 leader_election.cc:336] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Timed out: RequestConsensusVote RPC to 127.27.229.68:42165 timed out after 2.248s (SENT)
I20260709 13:10:49.172437 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.173518 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.174253 29671 raft_consensus.cc:2410] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:49.118647 29743 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.175915 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.176740 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.178853 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.149209 31138 raft_consensus.cc:697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:49.180647 29746 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.182001 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.187161 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.150993 31094 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:49.183139 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:49.183663 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.184227 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.184415 29714 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.181908 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.190649 29666 raft_consensus.cc:2410] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:49.186054 29674 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.111435 31091 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:10:49.171167 29741 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.190783 29672 raft_consensus.cc:2376] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3. Re-sending same reply.
I20260709 13:10:49.182312 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:49.187935 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 69388.5us
I20260709 13:10:49.150527 31061 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:49.189862 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.185206 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:49.195288 29671 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:49.195363 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.200820 29746 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:49.202152 29787 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.183295 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.172554 31009 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:10:49.226274 29714 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.230890 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:49.194967 31142 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.159s	user 0.003s	sys 0.000s
I20260709 13:10:49.236208 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.237360 29671 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.202523 30919 raft_consensus.cc:2764] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:49.247537 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.203271 29665 raft_consensus.cc:2376] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3. Re-sending same reply.
W20260709 13:10:49.253845 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 76271.3us
I20260709 13:10:49.232059 31082 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.232223 31137 raft_consensus.cc:2764] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:49.261698 29669 raft_consensus.cc:1240] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:49.263072 30344 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:49.274487 29671 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:49.229717 29668 raft_consensus.cc:2376] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3. Re-sending same reply.
I20260709 13:10:49.185143 31146 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.280275 29639 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:10:49.281708 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 79661.6us
I20260709 13:10:49.246783 31094 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:10:49.295469 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 64676.9us
I20260709 13:10:49.296291 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.268508 31027 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.299852 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.231935 31129 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:49.277619 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:49.283195 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:49.308061 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:49.288496 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:49.326654 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:49.286015 31068 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:49.299312 31137 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.298105 31030 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:49.327925 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 47742.7us
I20260709 13:10:49.304944 30919 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.338799 29638 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:49.341399 29639 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:49.343742 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:49.335022 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.328915 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:49.306631 31094 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.345458 31132 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.340715 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:49.295974 31061 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.340359 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.351122 30348 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:49.338099 30345 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:49.395205 30344 raft_consensus.cc:2410] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:10:49.398396 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 57080.1us
I20260709 13:10:49.400522 29742 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:49.290640 31138 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.415745 29671 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.394668 31005 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.430362 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 122357us
I20260709 13:10:49.435413 31128 consensus_queue.cc:1059] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:49.393724 31027 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:49.411036 31121 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:49.418531 31155 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:49.411226 31009 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.441002 29823 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.441300 29817 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.442802 29789 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.434463 29715 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:49.412917 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.343930 31068 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:49.445179 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 148957us
I20260709 13:10:49.446929 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:49.413982 31160 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:49.450966 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.453631 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.454666 29816 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.458065 29789 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.436751 31137 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:49.443117 31082 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:49.460780 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.485225 29789 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.459890 29714 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.467509 29671 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:49.468655 31168 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.471071 31127 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:49.470974 31161 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:10:49.474478 30917 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.476737 29639 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.477857 31134 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.479866 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:49.480520 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:49.481043 31068 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:49.481567 31166 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.482995 31137 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:49.486486 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 52137.6us
I20260709 13:10:49.430897 31141 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:10:49.507001 29816 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:49.443621 31005 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:49.459695 31160 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:49.491634 29714 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.481614 30852 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.462761 31159 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.519869 31163 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.520274 31169 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.520460 31163 raft_consensus.cc:697] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:49.520802 31169 raft_consensus.cc:697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:49.521492 31163 consensus_queue.cc:237] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.521651 31169 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.513167 31121 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.524679 31137 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:49.515467 30852 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.527799 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.529423 29639 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.513804 31160 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.534181 29743 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:49.534394 31094 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:49.535656 31005 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:49.535296 30852 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.537609 29740 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.506645 31162 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.548451 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.508908 31068 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.508720 30345 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:10:49.514590 30919 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:49.541800 30852 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.550014 31132 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:49.524780 30917 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:10:49.551981 31009 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.519785 31166 consensus_queue.cc:1059] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:10:49.562179 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:49.580929 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 53213.2us
W20260709 13:10:49.593062 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50820.2us
W20260709 13:10:49.600719 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.602355 31166 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:49.602593 31009 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.564325 31082 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.607108 31129 raft_consensus.cc:1064] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:10:49.609197 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 60825.5us
W20260709 13:10:49.617954 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 131597us
I20260709 13:10:49.618853 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.620999 31178 raft_consensus.cc:3055] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:49.621351 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.621426 31178 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:49.624706 31178 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:49.625839 29671 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:49.626549 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.627068 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.627619 31022 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.628051 31094 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.602845 31166 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.628667 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:49.630861 29669 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.627835 31178 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.635984 31172 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.636854 31167 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.637089 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.639180 31005 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.644052 31164 raft_consensus.cc:2764] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:49.636794 31022 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:49.649436 29787 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.657402 31165 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.658310 31132 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.637815 31166 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.669142 31027 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.669773 31027 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:49.640159 30919 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.670670 31027 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.675777 31167 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.676956 31166 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.656066 31022 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.677438 29715 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.678732 31181 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.678567 31022 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.679833 31022 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.657397 31005 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:49.682147 31005 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.682564 31005 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.683772 31160 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.663637 29639 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.685719 31183 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.662516 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.687048 29639 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.687526 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.688298 29639 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.684597 29715 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.689465 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.689654 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.695127 29669 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:49.707159 29789 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.708523 29789 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.711648 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.699069 30965 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:49.698777 31168 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.715337 31164 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:49.717729 31161 raft_consensus.cc:993] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: : Instructing follower 121060c6c5b14502957b76fd1dfc7b2d to start an election
I20260709 13:10:49.718420 31176 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.719007 31176 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:49.719879 31176 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.711124 31009 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.722376 31146 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.722766 31146 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.726194 31146 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.726493 31052 consensus_queue.cc:1059] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:49.727555 31146 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.710137 31094 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.730284 31171 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.730834 31171 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:49.731745 31171 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.713374 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.734980 31094 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.735250 31159 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:49.735149 29789 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.737051 31144 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:49.727689 31052 raft_consensus.cc:3055] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:49.738766 31052 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:49.739670 31052 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.740937 31052 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:49.742269 29741 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.691491 31183 raft_consensus.cc:2764] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:49.701397 31165 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.735625 31159 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:10:49.745793 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.691623 31167 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:49.762897 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:49.763935 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.766518 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.767158 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.769258 29668 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.770902 29668 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.774085 29669 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.777742 31039 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:49.782166 29639 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.781394 31039 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:49.775604 31040 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:49.779985 30925 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.779676 31162 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.791290 31009 raft_consensus.cc:2764] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:10:49.804491 31027 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.796103 31185 consensus_queue.cc:1059] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:10:49.765061 31159 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.808338 31172 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:49.809401 31009 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.829995 29748 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.809288 30924 raft_consensus.cc:3055] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.811947 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:49.816836 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:49.839663 29746 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:49.839951 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 128373us
I20260709 13:10:49.810678 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:49.841038 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 62010.7us
I20260709 13:10:49.843268 29745 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:49.842321 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:49.849650 29749 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:49.817607 31068 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.818025 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:49.798269 30965 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:10:49.843304 31163 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.879667 30345 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:49.842851 30924 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.881644 30924 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.882655 30924 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.888793 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:49.891819 31161 raft_consensus.cc:1081] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Signalling peer 121060c6c5b14502957b76fd1dfc7b2d to start an election
W20260709 13:10:49.892475 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 77744.1us
I20260709 13:10:49.879767 31039 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:49.893164 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:49.872670 31027 consensus_queue.cc:1243] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:49.894196 29665 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:49.894877 31005 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.896351 31160 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:49.896982 31005 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:49.848095 31173 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:10:49.829865 30919 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:10:49.870508 31009 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.872193 29814 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:49.870118 30346 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:49.818394 30925 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.897867 29815 raft_consensus.cc:1240] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:49.878260 31159 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.830055 31040 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.916018 31040 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:49.916989 31081 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:49.898550 31173 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.920647 31173 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:49.899324 29740 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.900064 30919 raft_consensus.cc:3055] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.891713 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:49.922402 30919 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:49.922890 29747 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:49.923295 30919 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:49.923884 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:49.924628 30919 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.894124 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:49.921561 31173 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:49.927662 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.918114 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:49.958966 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:49.965399 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 71387.7us
I20260709 13:10:49.905484 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:49.992956 29747 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:49.994550 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.905020 30925 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:49.953250 31131 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.900465 31009 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:49.952854 29741 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
W20260709 13:10:49.996513 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 207319us
I20260709 13:10:49.997013 29787 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:49.928766 31081 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:49.991319 31005 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:49.957706 30316 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:49.991464 31040 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.992273 31166 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:50.005666 29787 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:50.007153 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
W20260709 13:10:50.002638 31061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.026s	sys 0.012s
W20260709 13:10:50.012001 31061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.026s	sys 0.013s
I20260709 13:10:50.029026 29748 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.043535 29748 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:50.007818 31132 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:50.104674 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 94610.1us
I20260709 13:10:50.130465 29639 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:50.126578 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 119974us
I20260709 13:10:50.132138 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:10:50.127434 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 121858us
I20260709 13:10:50.127959 31052 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.000938 31185 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:10:50.009526 29820 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:50.002869 31162 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
W20260709 13:10:50.126670 31191 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:10:50.146529 31052 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:50.006922 30917 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
I20260709 13:10:50.013952 31040 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.154274 31094 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.093665 31132 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.124876 31136 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:50.173642 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.070044 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 61086.7us
W20260709 13:10:50.196329 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 65959.6us
I20260709 13:10:50.206194 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.231662 31137 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.248435 29816 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:50.197731 31052 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.197069 31005 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.205219 31132 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:50.253885 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 47784us
I20260709 13:10:50.256217 31081 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.258450 29639 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.192322 31061 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.252166 31194 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.275660 31194 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.268710 31022 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:10:50.280532 29639 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.258504 30924 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.285774 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:50.279771 31159 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.273942 31137 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.294296 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.294768 29817 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:50.304785 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.295387 31127 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.296514 31194 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.296824 31159 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:50.304961 30924 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.313031 29820 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:50.312640 31137 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:50.316921 31137 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:50.317353 31137 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:50.320839 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.326416 31199 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:50.325964 31129 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:50.327045 31137 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.311956 31185 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.339429 29639 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.343907 31137 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:50.350391 31040 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:50.339576 31185 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.353307 31185 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.355887 29571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50500 (request call id 196) took 10878 ms. Trace:
I20260709 13:10:50.302619 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:50.359480 29570 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:10:50.367871 31192 log.cc:927] Time spent T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.490s	user 0.010s	sys 0.024s
W20260709 13:10:50.377627 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.380767 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.381522 29673 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:50.383363 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:50.386565 29666 raft_consensus.cc:1240] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:50.337549 31052 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.389379 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.391511 29672 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.384826 31131 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:50.394968 31131 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:50.395900 31131 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.398854 29639 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.401217 29665 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.401623 29665 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:50.402388 29665 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.403565 29665 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.408046 31136 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.410491 31132 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:50.412701 31132 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:50.390547 31203 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.415664 29672 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:50.417649 29639 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.356315 29571 rpcz_store.cc:276] 0709 13:10:39.477683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.477819 (+   136us) service_pool.cc:224] Handling call
0709 13:10:50.355818 (+10877999us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:48.393446 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:48.446964 (+ 53518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:48.447023 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:10:48.447102 (+    79us) tablet.cc:662] Decoding operations
0709 13:10:48.447926 (+   824us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:48.448048 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:48.448081 (+    33us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:10:48.448711 (+   630us) tablet.cc:701] Row locks acquired
0709 13:10:48.448758 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:10:48.448933 (+   175us) write_op.cc:270] Start()
0709 13:10:48.449084 (+   151us) write_op.cc:276] Timestamp: P: 1783602648448872 usec, L: 0
0709 13:10:48.449120 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:10:48.461942 (+ 12822us) log.cc:844] Serialized 2481 byte log entry
0709 13:10:49.010491 (+548549us) op_driver.cc:464] REPLICATION: finished
0709 13:10:49.232256 (+221765us) write_op.cc:301] APPLY: starting
0709 13:10:49.249291 (+ 17035us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:49.275489 (+ 26198us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:49.279800 (+  4311us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:49.399351 (+119551us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:49.399631 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:10:49.399691 (+    60us) write_op.cc:312] APPLY: finished
0709 13:10:49.400011 (+   320us) log.cc:844] Serialized 52 byte log entry
0709 13:10:49.400192 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:49.400303 (+   111us) write_op.cc:454] Released schema lock
0709 13:10:49.400367 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:49.400762 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:49.400789 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":482414,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":164246,"apply.run_cpu_time_us":3765,"apply.run_wall_time_us":205396,"num_ops":6,"prepare.queue_time_us":61782,"prepare.run_cpu_time_us":11096,"prepare.run_wall_time_us":151099,"raft.queue_time_us":205149,"raft.run_cpu_time_us":44176,"raft.run_wall_time_us":143311,"replication_time_us":547404,"thread_start_us":323263,"threads_started":4,"wal-append.queue_time_us":140049}]]}
I20260709 13:10:50.420096 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:50.389515 31159 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.413823 31203 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.423467 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.426744 31022 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.429076 31165 raft_consensus.cc:3055] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.429354 29816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:50.429538 31052 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.429962 29816 raft_consensus.cc:606] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:50.428857 31014 consensus_queue.cc:1059] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:10:50.421591 31061 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.433373 31061 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.435513 31061 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.436079 31160 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.438181 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:50.438915 29816 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.436600 31160 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.440704 31160 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:50.442442 29823 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:50.443470 29822 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:50.430156 31167 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:50.450243 29820 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.451413 30346 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:50.419613 31040 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.418596 31204 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:50.441387 29817 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:50.424885 31196 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:50.460798 29816 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
W20260709 13:10:50.468385 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:50.469260 31171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.006s	sys 0.020s
I20260709 13:10:50.427218 31203 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.472000 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:50.469668 31171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.006s	sys 0.020s
I20260709 13:10:50.453372 31165 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:50.478597 29819 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.474721 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:50.476029 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:50.476389 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:50.484338 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:50.463047 29820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:50.491580 29816 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:50.491696 29821 raft_consensus.cc:1240] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.471185 31204 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:50.489179 31027 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.474248 30924 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:10:50.494874 31009 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.473201 31127 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:10:50.479967 31196 raft_consensus.cc:697] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:50.497886 31165 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.498406 31196 consensus_queue.cc:237] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:50.501997 31193 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.378s	user 0.006s	sys 0.013s
I20260709 13:10:50.502467 29822 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:50.510306 31197 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.381s	user 0.004s	sys 0.000s
I20260709 13:10:50.515192 31173 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.493566 31027 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.519270 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1140) took 1079 ms. Trace:
I20260709 13:10:50.519884 31027 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.492828 29820 raft_consensus.cc:606] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:50.519761 29814 rpcz_store.cc:276] 0709 13:10:49.440140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.443497 (+  3357us) service_pool.cc:224] Handling call
0709 13:10:49.458865 (+ 15368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.900788 (+441923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.518957 (+618169us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54000190d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:50.519173 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890528640}
I20260709 13:10:50.534339 31204 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.534548 31169 consensus_queue.cc:1059] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:50.536234 31161 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.539965 29668 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:50.544224 29673 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:50.544685 29673 pending_rounds.cc:85] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:50.544929 29673 pending_rounds.cc:107] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:50.545185 29673 raft_consensus.cc:2889] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.546408 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.548138 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.548996 29674 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:50.544685 29670 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:50.551487 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.552067 31133 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.553036 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.556067 29674 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:50.552696 31133 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:50.557948 29674 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:50.542855 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:50.547699 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.536283 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:50.562448 30346 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.565351 31030 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.565776 31030 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:50.566224 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:50.566588 31030 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.567003 29820 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:50.567847 31030 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.542058 30919 consensus_queue.cc:1059] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:10:50.570664 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:50.572495 31165 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.574008 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.574720 29665 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
W20260709 13:10:50.531886 31186 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.694s	user 0.013s	sys 0.027s
I20260709 13:10:50.576467 31005 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.543256 31161 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:10:50.578073 31190 log.cc:927] Time spent T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.696s	user 0.017s	sys 0.023s
I20260709 13:10:50.561333 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:50.572736 29666 raft_consensus.cc:3055] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.581378 29666 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:50.592108 29638 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:50.595490 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:50.596385 29819 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:50.596676 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.597379 29670 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:50.599011 29666 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.606238 29666 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.603255 31009 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.609477 29744 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.595590 31162 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.610317 31162 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.610672 31162 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.610886 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.611248 31171 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.612052 29745 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:50.612591 31133 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:50.612973 31127 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.613381 31127 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.613721 31127 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.593524 31169 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:50.616559 29816 raft_consensus.cc:1240] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:50.614509 31082 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:50.593372 31005 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.617612 29748 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:50.618547 29742 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:50.618767 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:50.620252 29620 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:10:50.620729 29620 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for dff620b2062c4139940ec520664442a1 already in progress
I20260709 13:10:50.622409 29746 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:50.626017 29669 raft_consensus.cc:1240] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:50.621069 29620 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for dff620b2062c4139940ec520664442a1 already in progress
I20260709 13:10:50.628021 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.628754 29745 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:50.629626 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:50.630381 29816 raft_consensus.cc:2393] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 2: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:50.630874 29746 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:50.633610 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.634372 29748 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
W20260709 13:10:50.638684 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.639225 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.639647 31052 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.640215 31005 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.640421 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.641034 29747 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:50.641858 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.642612 29747 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:50.645344 29669 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.646369 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.647403 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.628878 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:50.644469 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.649610 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.650907 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.651531 29667 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:50.576709 31090 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:10:50.579741 31166 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:10:50.643412 31202 raft_consensus.cc:993] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:50.654524 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.617614 31082 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:50.661047 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.672212 29672 raft_consensus.cc:2376] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3. Re-sending same reply.
I20260709 13:10:50.576715 31177 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:10:50.664004 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:50.664901 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.665069 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.622071 31169 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:50.621040 31161 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:50.614665 31163 raft_consensus.cc:3055] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.670185 29822 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:50.604033 31137 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:10:50.603399 31164 consensus_queue.cc:1059] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:10:50.594002 31204 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:10:50.672822 30314 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:50.677237 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.678771 29787 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:50.680353 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.686532 29667 raft_consensus.cc:2410] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:10:50.685671 29674 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:50.685233 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:50.681521 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.683326 31161 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.683949 31163 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:50.608367 30344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dff620b2062c4139940ec520664442a1"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
 from {username='slave'} at 127.0.0.1:43540
I20260709 13:10:50.682494 31169 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.704772 31164 consensus_queue.cc:1243] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:50.687495 29667 raft_consensus.cc:1240] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:50.706784 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.688908 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.690011 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.691819 29666 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:50.665612 31005 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.733688 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.734099 31005 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.700820 31163 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:50.734429 29667 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:50.693176 31194 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:10:50.700732 31205 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:50.746207 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.668741 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.627539 31183 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:10:50.698628 29665 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.694970 31133 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.684741 31014 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:10:50.733172 31203 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.652380 31178 consensus_queue.cc:1059] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:10:50.733453 31138 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.735152 31163 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.735351 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.795768 29667 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:50.698141 29815 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:50.747469 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.756683 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:50.693665 31176 raft_consensus.cc:1081] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:50.759176 29822 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:50.759269 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.797814 29746 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.698523 31009 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 13:10:50.761284 29817 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:50.763458 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.734486 31005 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.727147 29666 pending_rounds.cc:85] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:50.701416 31177 consensus_queue.cc:1243] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:50.705228 31082 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.698151 31022 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:10:50.792877 31138 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.815064 31138 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.798031 29822 raft_consensus.cc:606] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:50.816339 29822 raft_consensus.cc:614] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:50.673494 31146 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:10:50.819878 29746 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:10:50.755833 30344 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:50.800794 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:50.803839 29666 pending_rounds.cc:107] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:50.825847 29666 raft_consensus.cc:2889] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:50.804387 29669 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:50.788733 31133 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.810854 29639 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.791854 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.788275 31167 raft_consensus.cc:3055] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.828493 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.825475 29674 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:50.839185 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.792528 30346 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:10:50.833098 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.834280 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:50.821884 31223 log.cc:927] Time spent T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:10:50.840569 29666 raft_consensus.cc:2368] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4.
I20260709 13:10:50.839262 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:50.843264 29639 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.846113 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:50.820297 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:50.827802 30344 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.850679 29639 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.834425 31133 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.833732 30919 raft_consensus.cc:3055] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.859673 30919 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:50.860530 30919 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.861843 29742 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:50.863464 31162 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:50.863971 29742 raft_consensus.cc:1240] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.836679 31183 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:50.856175 29672 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:50.837294 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:50.861692 30919 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.867869 29746 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:50.842126 31082 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:50.843429 31167 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:50.849088 31131 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.880326 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:10:50.841650 29740 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:50.882493 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:50.851516 31172 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:50.864151 31137 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.883234 29822 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:50.838165 31040 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:10:50.865777 31162 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.892009 31211 consensus_queue.cc:1059] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
W20260709 13:10:50.894596 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.880452 31161 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:50.884377 31171 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:50.921868 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 71224.6us
I20260709 13:10:50.923825 29639 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:50.894701 29818 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:50.888733 31172 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:50.925760 31068 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.929378 31068 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:50.931684 31068 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:50.948315 31161 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.948895 31161 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:50.955747 29789 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:50.956638 31068 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.957031 31068 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.957350 31068 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.957412 31014 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:50.928355 31171 raft_consensus.cc:697] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:50.990483 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 79) took 7830 ms. Trace:
I20260709 13:10:50.990861 31185 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.992034 29670 pending_rounds.cc:85] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:51.003006 29670 pending_rounds.cc:107] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:51.003340 29670 raft_consensus.cc:2889] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:50.979702 31224 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:10:50.993010 29570 rpcz_store.cc:276] 0709 13:10:43.176182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.186531 (+ 10349us) service_pool.cc:224] Handling call
0709 13:10:50.990381 (+7803850us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:50.475702 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:50.476239 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:50.476272 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:10:50.476288 (+    16us) tablet.cc:662] Decoding operations
0709 13:10:50.476634 (+   346us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:50.476710 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:50.476742 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:50.476930 (+   188us) tablet.cc:701] Row locks acquired
0709 13:10:50.476948 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:50.477081 (+   133us) write_op.cc:270] Start()
0709 13:10:50.477186 (+   105us) write_op.cc:276] Timestamp: P: 1783602650477043 usec, L: 0
0709 13:10:50.477205 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:50.478017 (+   812us) log.cc:844] Serialized 535 byte log entry
0709 13:10:50.597754 (+119737us) op_driver.cc:464] REPLICATION: finished
0709 13:10:50.655231 (+ 57477us) write_op.cc:301] APPLY: starting
0709 13:10:50.666274 (+ 11043us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:50.679488 (+ 13214us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:50.679636 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:50.698007 (+ 18371us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:50.759086 (+ 61079us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:10:50.759148 (+    62us) write_op.cc:312] APPLY: finished
0709 13:10:50.766696 (+  7548us) log.cc:844] Serialized 22 byte log entry
0709 13:10:50.766920 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.767010 (+    90us) write_op.cc:454] Released schema lock
0709 13:10:50.767063 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:50.788509 (+ 21446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:50.790186 (+  1677us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":869362,"reported_tablets":6,"spinlock_wait_cycles":769792,"child_traces":[["op",{"apply.queue_time_us":7326,"apply.run_cpu_time_us":2317,"apply.run_wall_time_us":162004,"mutex_wait_us":2171,"num_ops":1,"prepare.queue_time_us":97940,"prepare.run_cpu_time_us":18399,"prepare.run_wall_time_us":68293,"raft.queue_time_us":51087,"raft.run_cpu_time_us":1848,"raft.run_wall_time_us":7610,"replication_time_us":120399,"thread_start_us":151650,"threads_started":4,"wal-append.queue_time_us":65891}]]}
W20260709 13:10:51.014602 31225 log.cc:927] Time spent T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:51.026688 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:51.029107 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:51.030061 31226 log.cc:927] Time spent T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:51.033010 31127 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.035483 31172 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.036502 29745 raft_consensus.cc:3055] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:51.036872 29745 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:50.941884 31167 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.038019 31167 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.039064 29814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:51.039673 29814 raft_consensus.cc:606] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.004197 31203 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:51.082717 31173 consensus_meta.cc:287] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 13:10:51.089994 29823 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:51.095194 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.096233 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:51.037607 29745 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:51.106802 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 75656.5us
I20260709 13:10:51.110195 31136 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.110486 29666 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:10:51.111075 31136 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.111939 29666 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:51.112294 29666 pending_rounds.cc:85] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:51.112493 29666 pending_rounds.cc:107] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:51.112691 29666 raft_consensus.cc:2889] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.113395 31136 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:51.114449 31127 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.116465 31068 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.124157 29666 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:51.125540 29745 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.126986 29747 raft_consensus.cc:3055] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:51.127418 29747 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:51.137856 29787 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.009219 31185 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.164029 29666 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:10:51.166136 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 242477us
I20260709 13:10:51.179123 30344 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.180073 31133 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.128139 29747 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.184976 29747 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.184748 31227 consensus_queue.cc:1059] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:51.185743 31227 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:51.188832 31138 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.192549 31068 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:51.198231 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:51.199016 29815 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:51.209858 31185 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:51.210705 30925 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:51.211186 30925 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:51.211964 30925 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.213173 30925 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.213366 31183 raft_consensus.cc:3055] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:51.213786 31183 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:51.214584 31183 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.215262 29787 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.215710 31183 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.120770 31177 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.216650 31177 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:51.217041 31177 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.221773 31162 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:51.224570 31161 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:51.163314 31171 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.183172 31091 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:51.230499 31009 raft_consensus.cc:3055] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:51.235191 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.235478 29745 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:51.224718 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.231258 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:51.220770 29823 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:51.233294 29747 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:51.247287 29823 raft_consensus.cc:606] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.270625 29671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45236
I20260709 13:10:51.271317 29671 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:51.273336 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:51.274628 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:51.275164 29669 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.271644 29671 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.294517 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:51.295253 29748 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.300910 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:51.253548 31166 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:10:51.233996 31009 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:10:51.259202 31164 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:10:51.304994 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 410858us
W20260709 13:10:51.308180 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 52910.9us
I20260709 13:10:51.309219 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:51.313192 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.248754 29668 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:51.321856 29667 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.328536 29787 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:51.333845 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.295920 31131 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:51.300242 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:51.351220 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.370446 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.298827 31169 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:51.310145 31039 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.330027 29665 raft_consensus.cc:2410] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:10:51.321803 31005 consensus_meta.cc:287] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
W20260709 13:10:51.390447 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.392155 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48132.1us
W20260709 13:10:51.394167 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 223794us
I20260709 13:10:51.395049 29639 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:51.313966 31061 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:10:51.471156 29671 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:51.471760 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 76817.2us
I20260709 13:10:51.470271 29669 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:51.346544 31162 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:51.476073 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 79612.6us
W20260709 13:10:51.383531 31165 consensus_meta.cc:287] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.003s
W20260709 13:10:51.392771 31199 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:10:51.489260 29667 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:51.490542 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:51.491283 29669 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.391212 29740 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.503398 29669 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:51.504982 29671 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.468918 31202 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.351323 31144 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 13:10:51.392241 31137 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:51.466460 31167 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.388720 31185 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:10:51.526829 31177 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.383744 31131 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.519658 30919 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:10:51.534829 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 58004.1us
I20260709 13:10:51.398247 31090 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 13:10:51.388499 31169 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.397248 31005 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.584873 29823 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:51.391608 31039 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.511780 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:51.513295 31165 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.499540 31146 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:51.521166 31133 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.575783 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:51.557570 31211 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.548818 31138 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:51.532610 31202 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
W20260709 13:10:51.606850 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.551507 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:51.550127 31221 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:51.528820 31127 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:10:51.494855 31009 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.614545 31160 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.612444 29748 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 4 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:10:51.532092 31167 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.629798 29821 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:51.633078 31177 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.677556 31009 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.645081 31131 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.609750 30924 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:51.619112 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:51.634081 31211 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.584508 30919 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.629334 29668 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:51.648414 29820 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:51.662860 31173 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:51.689653 29715 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.694727 29715 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.653721 31221 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.623375 31165 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.701745 29746 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:51.698828 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:51.710485 29745 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:51.713359 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.691002 30924 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.715101 31173 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.725121 31039 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.726729 31005 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:51.728024 31169 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.729727 31211 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.692525 29818 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.725574 31173 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.742271 29818 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:51.745380 30919 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.748390 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:51.706588 31221 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:51.750571 29745 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.718008 31166 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.685105 31160 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.716022 31177 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.756939 29715 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.761579 29715 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.765836 29745 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:51.766742 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:51.752794 31173 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:51.768816 29745 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:51.768821 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.768734 30919 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:51.783092 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.788537 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.766723 31166 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.792250 30919 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:51.794147 29740 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:51.795922 31167 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:51.782019 31202 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:51.794818 30346 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:51.797665 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:51.798329 31160 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.799105 31165 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:51.787411 31082 consensus_meta.cc:287] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.908s	user 0.007s	sys 0.003s
W20260709 13:10:51.799800 30925 consensus_meta.cc:287] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.586s	user 0.003s	sys 0.006s
I20260709 13:10:51.805824 29740 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:51.807291 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:51.807977 29740 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:51.814263 31183 consensus_meta.cc:287] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.007s
W20260709 13:10:51.818274 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.819281 29740 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:51.820950 29740 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:51.826315 29740 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:51.826803 29740 pending_rounds.cc:85] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 1
W20260709 13:10:51.830497 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 61745.1us
I20260709 13:10:51.831672 29745 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:51.831748 29715 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.832125 29740 pending_rounds.cc:107] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:51.833293 29740 raft_consensus.cc:2889] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.833307 31164 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:51.836103 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.837836 31164 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.838507 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.839660 29715 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.818535 31221 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.841149 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.841421 31221 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:51.838061 29743 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:51.841876 31161 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:51.846480 31221 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:51.850641 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:51.851415 29818 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:10:51.857260 31165 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.857803 31165 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.859371 31176 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.859827 31165 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:51.877341 31232 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 13:10:51.842752 29715 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.843714 31173 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.920158 31173 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:51.859861 31176 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.930132 31173 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:51.931298 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 88602.3us
I20260709 13:10:51.932093 29715 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:51.933383 29715 leader_election.cc:400] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4.
I20260709 13:10:51.933836 31173 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.934993 31173 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:51.935477 31173 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.930214 31176 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:51.942253 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.943406 31164 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.943737 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:51.944754 29715 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:51.945597 31164 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:51.946115 31164 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:51.948890 31039 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.950068 31205 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:51.950579 31205 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.952865 31205 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:51.954326 29741 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
W20260709 13:10:51.954743 29714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.018s	sys 0.023s
W20260709 13:10:51.955031 29714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.018s	sys 0.023s
W20260709 13:10:51.955278 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 586765us
I20260709 13:10:51.947017 31164 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.949442 31039 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.968876 31039 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:51.971192 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 174571us
I20260709 13:10:51.972903 30925 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:51.973203 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:51.973788 31161 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.974305 31161 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:51.976461 31161 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:51.982092 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:51.982362 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.983016 29817 raft_consensus.cc:2410] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:51.985235 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:51.986068 31144 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:51.988513 29741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:10:51.988721 31144 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:51.989181 29741 raft_consensus.cc:606] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:51.989548 29741 raft_consensus.cc:614] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.991024 31144 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:51.973308 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:51.996702 29823 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:51.998420 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:51.999070 29823 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:52.006726 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62053.9us
I20260709 13:10:52.007514 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:52.026679 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:52.156656 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 148736us
I20260709 13:10:52.254222 31039 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.254854 31039 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:52.257015 31039 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.258961 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:52.307387 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 299923us
I20260709 13:10:52.309715 29823 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
W20260709 13:10:52.339722 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 84895.4us
I20260709 13:10:52.000747 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.262429 31144 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.339310 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 392102us
I20260709 13:10:52.339561 31176 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.342371 31204 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.342769 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.340375 31247 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:52.364290 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:52.368971 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.353435 31163 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:52.348982 31256 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:10:52.374334 31221 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:52.371135 31177 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:52.359293 31082 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:10:52.358685 31144 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.378010 29814 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:52.371611 31176 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:52.407140 30314 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:52.373404 31204 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.415127 31204 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:52.411998 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.413034 31247 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.416321 31247 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:52.418006 29815 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:52.418736 31247 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:52.419325 31247 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.419755 31247 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.421841 29745 raft_consensus.cc:2410] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:52.381729 31163 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.387553 31173 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.421222 31237 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.392329 31221 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:52.442699 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 101070us
I20260709 13:10:52.451508 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:52.430897 31178 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.423663 31161 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:52.434908 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.450133 31237 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:52.396174 31177 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:52.462821 30349 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 4. Ops: []
I20260709 13:10:52.467834 31221 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.464838 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:52.465749 31247 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.455986 31161 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.470243 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.459491 31237 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.456285 31178 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.475828 30347 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.477370 31266 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:52.486615 31266 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:52.491065 29740 raft_consensus.cc:2393] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 6: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:52.486505 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:52.498517 30350 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
W20260709 13:10:52.490705 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 121060c6c5b14502957b76fd1dfc7b2d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:52.499162 30314 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:52.504297 31263 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:52.490631 31266 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:52.508497 29820 consensus_meta.cc:287] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.004s
I20260709 13:10:52.508955 29820 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:52.493244 31176 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:52.493294 31144 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:52.516920 30347 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:10:52.518049 31261 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.519693 31173 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.529323 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.530278 31163 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.530712 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.519604 31177 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:52.531801 31163 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.531797 31178 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.532997 31163 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:52.531790 31161 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.532855 29665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1173) took 1282 ms. Trace:
I20260709 13:10:52.540745 29665 rpcz_store.cc:276] 0709 13:10:51.250912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.515389 (+264477us) service_pool.cc:224] Handling call
0709 13:10:51.552470 (+ 37081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.629737 (+ 77267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.634989 (+  5252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:51.653502 (+ 18513us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:51.662879 (+  9377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.532573 (+869694us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b540030eb54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:52.532645 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.532789 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128235264}
I20260709 13:10:52.539956 31163 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:52.540216 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.538763 31144 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.549273 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.549885 29787 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:52.550817 31204 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.545768 31144 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.551203 31204 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.551553 31204 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.549810 30924 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.567343 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:52.568140 30343 raft_consensus.cc:2376] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6. Re-sending same reply.
I20260709 13:10:52.552649 31144 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:52.613138 31234 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 1.118s	user 0.005s	sys 0.000s
I20260709 13:10:52.616631 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1162) took 1990 ms. Trace:
I20260709 13:10:52.617009 29670 rpcz_store.cc:276] 0709 13:10:50.625708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.629246 (+  3538us) service_pool.cc:224] Handling call
0709 13:10:50.991612 (+362366us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:50.991831 (+   219us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.008476 (+ 16645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.008510 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.008965 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.297433 (+288468us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:51.297483 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.297561 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.607653 (+1310092us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:52.616397 (+  8744us) raft_consensus.cc:1685] finished
0709 13:10:52.616419 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.616568 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124047488,"thread_start_us":288148,"threads_started":1,"wal-append.queue_time_us":373013}
I20260709 13:10:52.639312 31237 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:52.646095 31236 log.cc:927] Time spent T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 1.118s	user 0.006s	sys 0.004s
I20260709 13:10:52.658224 31237 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:52.663389 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1180) took 1397 ms. Trace:
I20260709 13:10:52.663856 29667 rpcz_store.cc:276] 0709 13:10:51.265980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.514569 (+248589us) service_pool.cc:224] Handling call
0709 13:10:51.514854 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.530796 (+ 15942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.530828 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.533911 (+1003083us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b2c000014c8. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e83b6a11 00007fd9e83c6372 00007fd9e9af8a01 00007fd9e9abd43a 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2
0709 13:10:52.534351 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.543667 (+  9316us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:52.543702 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.543769 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.663056 (+119287us) raft_consensus.cc:1685] finished
0709 13:10:52.663078 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.663321 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15572,"raft.queue_time_us":150444,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":17005,"spinlock_wait_cycles":3288320,"thread_start_us":9001,"threads_started":1,"wal-append.queue_time_us":78611}
I20260709 13:10:52.714284 31171 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:52.714897 31171 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.717015 31171 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:52.724921 29569 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50490 (request call id 186) took 12346 ms (client timeout 15000 ms). Trace:
W20260709 13:10:52.726663 29569 rpcz_store.cc:269] 0709 13:10:40.378663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.379224 (+   561us) service_pool.cc:224] Handling call
0709 13:10:52.724733 (+12345509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2588,"reported_tablets":11,"spinlock_wait_cycles":1479424}
I20260709 13:10:52.772995 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.773751 29741 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:10:52.774775 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.775385 29741 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:52.776324 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.776885 29741 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
W20260709 13:10:52.781384 29743 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48028 (request call id 691) took 2174 ms (client timeout 1813 ms). Trace:
W20260709 13:10:52.781853 29743 rpcz_store.cc:269] 0709 13:10:50.607180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.614907 (+  7727us) service_pool.cc:224] Handling call
0709 13:10:51.028937 (+414030us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:52.781190 (+1752253us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54003b9554. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:52.781314 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784104576}
I20260709 13:10:52.784844 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:52.796069 31171 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.796689 31171 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:52.799476 31171 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:52.807756 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:52.819605 31171 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.825059 31171 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.827310 31171 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:52.777688 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:52.831360 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.838961 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.832463 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:52.836110 29715 connection.cc:256] RPC call timeout handler was delayed by -1.3512038830000392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 13:10:52.842809 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.843681 29817 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:52.845315 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.846671 29741 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:52.840330 31171 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:52.851881 31171 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:52.859930 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 310088us
I20260709 13:10:52.860854 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:52.862272 31194 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:52.862797 31194 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:52.863691 31194 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.869283 29787 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:52.873346 31194 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:52.874078 31194 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:52.875087 31194 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.885247 30344 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.886147 30344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:43540 (request call id 115) took 2300 ms. Trace:
I20260709 13:10:52.888654 30344 rpcz_store.cc:276] 0709 13:10:50.585415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.589394 (+  3979us) service_pool.cc:224] Handling call
0709 13:10:52.884116 (+2294722us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b4c001ff380. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e7d89a20 00007fd9e7d9aa29 00007fd9e7d9b13f 00007fd9e7d5f2ab 00007fd9e7d8cf3c 00007fd9e7d8d3fe 00007fd9e801a88b 00007fd9e9a19495 00007fd9e9a6a30f 00007fd9e9ab4a55 00007fd9eea84cd0
0709 13:10:52.886011 (+  1895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7089024}
I20260709 13:10:52.897275 29787 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:52.899351 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 922231us
I20260709 13:10:52.902000 31201 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:52.902563 31201 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:52.903429 31201 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.905342 30924 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:52.906107 30924 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.906893 31276 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:52.908545 30924 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:52.909965 29638 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:52.918169 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:52.920094 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:52.920487 31171 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:52.924635 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1158) took 2248 ms. Trace:
I20260709 13:10:52.925112 29821 rpcz_store.cc:276] 0709 13:10:50.675911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.676060 (+   149us) service_pool.cc:224] Handling call
0709 13:10:50.676348 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:51.681990 (+1005642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.924310 (+1242320us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400325854. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:52.924553 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192358784}
I20260709 13:10:52.930454 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:52.940356 31281 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.940872 31281 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.941239 31281 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.942683 31204 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.945061 31204 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:52.906765 29741 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:52.946377 31171 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:52.947705 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:52.948307 29821 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:52.948612 29821 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:52.949295 29821 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:52.949957 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.959563 29819 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:52.960558 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.962905 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.959035 29821 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.950268 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:52.951265 29820 raft_consensus.cc:1240] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:52.957623 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 115088us
W20260709 13:10:52.973050 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.975461 29715 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:52.976380 29715 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:52.978102 31082 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:52.978515 31082 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.978825 31082 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:52.957623 29742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 700) took 1713 ms. Trace:
I20260709 13:10:52.982197 29742 rpcz_store.cc:276] 0709 13:10:51.244428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.249015 (+  4587us) service_pool.cc:224] Handling call
0709 13:10:51.684281 (+435266us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:51.922454 (+238173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.922859 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.922904 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.923441 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.381246 (+457805us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:52.385831 (+  4585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.389717 (+  3886us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.515003 (+125286us) raft_consensus.cc:1685] finished
0709 13:10:52.515024 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:52.957393 (+442369us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54002d3cd0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:52.957527 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3831,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":120,"spinlock_wait_cycles":559388800,"thread_start_us":448899,"threads_started":1,"wal-append.queue_time_us":528564}
I20260709 13:10:52.984774 31266 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:52.985370 31266 raft_consensus.cc:697] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:52.986279 31266 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:52.946964 31171 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.004240 29714 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.006333 31267 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:53.006788 31267 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.007120 31267 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.007249 31164 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.007884 31164 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.005808 31163 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.010725 31163 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.011348 31171 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:53.014935 31164 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.019989 29821 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:53.020172 31082 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.020846 31281 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.030333 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:52.550045 29740 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 1.
I20260709 13:10:53.032835 29814 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:53.034488 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.037963 29572 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:10:53.043401 31229 log.cc:927] Time spent T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 1.548s	user 0.006s	sys 0.000s
I20260709 13:10:53.040506 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.044086 29822 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:53.044442 31163 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:53.046036 31082 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:53.043064 29572 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:53.047259 31178 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:53.047842 31178 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:53.048746 31178 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.051169 31163 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.051805 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.052325 31082 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:53.052512 30344 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:53.052987 31267 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.054301 31082 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:53.055650 29819 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:53.054188 30348 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:10:53.054077 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 84783.7us
I20260709 13:10:53.056556 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.060997 29816 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:53.062042 29672 raft_consensus.cc:1217] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 13:10:53.061911 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1163) took 2371 ms. Trace:
I20260709 13:10:53.062572 29672 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:53.058418 29572 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.063975 29714 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.064172 29822 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:53.066715 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:53.062572 29674 rpcz_store.cc:276] 0709 13:10:50.690922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.845265 (+154343us) service_pool.cc:224] Handling call
0709 13:10:50.845611 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:50.845982 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:50.846010 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:50.858558 (+ 12548us) log.cc:844] Serialized 52 byte log entry
0709 13:10:51.260728 (+402170us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:51.313568 (+ 52840us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.630921 (+317353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.630994 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.042947 (+1411953us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:53.057411 (+ 14464us) raft_consensus.cc:1685] finished
0709 13:10:53.061689 (+  4278us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.061852 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4763,"prepare.queue_time_us":52527,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":71956,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":15844,"spinlock_wait_cycles":113109376,"thread_start_us":691939,"threads_started":2,"wal-append.queue_time_us":448439}
I20260709 13:10:53.067062 31266 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:10:53.069319 31161 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:53.070130 31091 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:53.070540 31091 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.067445 31164 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:53.070901 31091 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.071099 31164 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.071552 31164 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.078393 31091 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.078846 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.069706 30343 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:53.081401 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.083250 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.084595 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:53.087620 29816 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:53.088171 31164 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.089022 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.090276 31164 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.090808 31267 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.090566 31176 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:53.099362 31039 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.092422 31082 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.099926 31039 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.100389 31082 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.105162 29572 catalog_manager.cc:5697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:53.107769 31133 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.108397 31133 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.111083 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.111940 30347 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:53.112934 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.114351 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:53.114977 30350 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:53.116905 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 48587.9us
I20260709 13:10:53.106875 29572 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:53.118729 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:53.123674 29816 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.123147 29572 catalog_manager.cc:5697] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 3, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.123147 31237 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.128077 29572 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:53.131750 29572 catalog_manager.cc:5697] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:53.133430 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.142316 30314 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.150905 30314 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:53.151139 29816 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:53.138139 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.154590 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.156543 29747 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.154882 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.157768 29745 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:53.155545 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.151926 29572 catalog_manager.cc:5697] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:53.134043 31237 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.166965 29572 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 3, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:53.153949 31291 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.174203 31291 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.174357 31133 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.174634 31291 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.165201 31082 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.175359 31082 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.177510 31082 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.178227 31039 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.179965 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.180320 31237 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.180721 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:53.180841 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.181107 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.182045 31082 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.182417 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.182983 29819 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:53.183570 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.184227 29745 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:53.185092 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.186360 31164 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.182587 31082 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.186908 31164 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.189195 31164 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:53.190214 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.192193 29572 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 3, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:53.170135 30350 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:53.162403 31178 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:10:53.193966 29572 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:10:53.195420 29572 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:10:53.197772 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.196426 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 78829.6us
I20260709 13:10:53.192301 31082 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.194353 31164 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:53.197311 29747 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:53.209040 30314 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.209833 31237 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:53.210309 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.210932 29747 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:53.210335 31237 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:53.212021 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.212837 31039 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:53.213208 31039 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.213569 31039 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.212311 31237 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.218983 29714 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:53.219244 29672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1200) took 2517 ms. Trace:
I20260709 13:10:53.219964 29672 rpcz_store.cc:276] 0709 13:10:50.701456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:50.867417 (+165961us) service_pool.cc:224] Handling call
0709 13:10:53.061844 (+2194427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.062919 (+  1075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.219055 (+156136us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b5400269150. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:53.219187 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5045975424}
I20260709 13:10:53.220705 31177 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:53.221803 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.194808 31261 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:53.197017 29715 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.195828 31291 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:53.228279 31246 log.cc:927] Time spent T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 1.575s	user 0.002s	sys 0.015s
I20260709 13:10:53.230398 31291 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.230605 31091 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:53.227213 31082 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:53.231369 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 699) took 1987 ms. Trace:
I20260709 13:10:53.232569 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:53.233131 29819 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:53.233665 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.234025 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.234603 29746 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.240867 29746 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:10:53.231427 31082 raft_consensus.cc:697] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:53.245213 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.231787 29744 rpcz_store.cc:276] 0709 13:10:51.244113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.246408 (+  2295us) service_pool.cc:224] Handling call
0709 13:10:51.246768 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.279083 (+ 32315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.279116 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.301839 (+ 22723us) log.cc:844] Serialized 26 byte log entry
0709 13:10:51.612926 (+311087us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:51.629201 (+ 16275us) log.cc:844] Serialized 14 byte log entry
0709 13:10:51.629836 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.630047 (+   211us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.222639 (+1592592us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:53.231063 (+  8424us) raft_consensus.cc:1685] finished
0709 13:10:53.231173 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.231313 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1340,"prepare.queue_time_us":15845,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":45,"raft.queue_time_us":57785,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":4131,"spinlock_wait_cycles":3655936,"thread_start_us":258487,"threads_started":1,"wal-append.queue_time_us":326900}
I20260709 13:10:53.248066 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.250278 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.251861 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:53.253755 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.255118 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.243604 31082 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.259262 31194 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:53.259719 31194 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.260056 31194 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.261247 29744 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:53.262420 29819 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:10:53.263600 30315 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.264783 31039 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.265444 31171 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:53.273643 31171 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.274037 31171 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.274806 31039 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.262012 31276 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.273113 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:53.278694 30350 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:53.278298 31276 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.280596 31276 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.268045 31291 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:53.281373 31291 raft_consensus.cc:697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:53.282298 31291 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.265265 31176 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:53.286867 31176 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.287304 31176 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.287542 31267 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:53.288012 31267 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:53.288908 31267 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:53.287323 31022 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:53.294975 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.295668 29742 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.295975 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.269203 31281 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.293399 31022 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:53.298725 31137 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.299233 31137 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.299808 31022 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.300459 31022 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:53.300884 31022 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.303073 31183 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.303591 31183 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.305632 31183 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.306432 31039 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.306743 31267 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.307615 31227 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.311349 31244 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:10:53.319351 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 98936.2us
W20260709 13:10:53.321722 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53179.1us
I20260709 13:10:53.349766 30343 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:53.301312 31137 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.350749 31227 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.361485 29749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1284) took 2124 ms. Trace:
I20260709 13:10:53.361997 29749 rpcz_store.cc:276] 0709 13:10:51.237316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.237444 (+   128us) service_pool.cc:224] Handling call
0709 13:10:51.348350 (+110906us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:51.348605 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.384860 (+ 36255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:51.384892 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:51.651310 (+266418us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b48000b2758. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ee9e6aa1 00007fd9ee9ddb37 00007fd9ee9dd9ca 00007fd9eead526f 00007fd9eead4f37 00007fd9eeae955c 00007fd9eeae9508 00007fd9eeae9488 00007fd9eeae9443 00007fd9eeae86ec 00007fd9eda12a96
0709 13:10:53.171210 (+1519900us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b2c0001c328. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e83b6a11 00007fd9e83c6372 00007fd9e9af8a01 00007fd9e9abd43a 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2
0709 13:10:53.171640 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.265997 (+ 94357us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:53.360955 (+ 94958us) log.cc:844] Serialized 14 byte log entry
0709 13:10:53.361169 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.361241 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.361278 (+    37us) raft_consensus.cc:1685] finished
0709 13:10:53.361291 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.361420 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6830,"prepare.queue_time_us":94239,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":7536,"raft.run_cpu_time_us":2174,"raft.run_wall_time_us":270945,"spinlock_wait_cycles":25015680,"thread_start_us":188532,"threads_started":2,"wal-append.queue_time_us":94338}
I20260709 13:10:53.316768 31129 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.317219 31253 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:53.317556 31022 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:53.381484 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 54732.8us
I20260709 13:10:53.322408 31039 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.380519 31129 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.392678 31129 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.414762 31082 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.417531 31082 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.420737 31082 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.381536 31253 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:53.461823 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 75224.6us
I20260709 13:10:53.412829 31194 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.435814 31176 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.465672 29742 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:10:53.483884 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:53.484292 31303 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:53.496549 31227 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.516052 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.516531 31009 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.516731 29749 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:10:53.517474 31176 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.518610 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.519348 31237 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:53.519645 29743 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:53.519735 31237 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.520241 31237 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.511739 31091 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:53.517190 31009 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.522521 31194 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.523442 31009 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.521423 31091 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.525513 31091 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.528432 31253 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:53.528676 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:53.529524 29816 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:53.530192 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:53.531030 29815 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:53.533546 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.535313 29815 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:53.536604 31171 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.538379 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.539402 30343 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:53.549988 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.550714 29674 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:10:53.542843 31255 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:53.543516 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 633664us
I20260709 13:10:53.545135 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:53.558696 29638 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:10:53.546800 31305 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:53.546958 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:53.547448 31235 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.547577 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.547705 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:53.547864 31131 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.550990 31146 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:53.595237 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:53.551920 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:53.595983 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.552620 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.549993 29816 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:53.553369 31137 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.551168 31211 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.554076 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.554530 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:53.551241 31183 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.555733 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:53.584342 29667 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:53.605523 29669 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.584059 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.550779 31278 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.519351 31039 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:53.599478 29749 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:53.549366 30924 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:53.553929 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 121551us
I20260709 13:10:53.607916 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.611884 29744 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
W20260709 13:10:53.612762 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 148010us
I20260709 13:10:53.614573 29714 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.557613 31255 raft_consensus.cc:697] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:53.621268 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:53.641500 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:53.642032 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.554597 31267 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:10:53.597107 31227 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:53.586211 31295 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.604647 31133 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:53.595062 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:53.667269 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53789.3us
I20260709 13:10:53.604820 31281 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:53.685519 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.585270 31040 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:10:53.615473 31253 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.704722 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.605440 31178 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:10:53.658885 31022 raft_consensus.cc:476] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:53.609371 31131 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.614552 31129 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.614140 31183 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:53.662120 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8920 after lost signal to thread 28568
I20260709 13:10:53.731901 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.705397 29747 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:53.732507 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:53.778445 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.779085 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.779771 29746 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:53.595250 31235 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.697646 29669 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:10:53.676621 31266 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:53.613417 31137 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.610978 31146 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.613269 31211 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.618180 31171 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:53.746208 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 131064us
I20260709 13:10:53.793210 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:53.675058 31279 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.772781 30350 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:53.773444 31127 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.778258 31178 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.774590 31309 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.258s	user 0.003s	sys 0.000s
I20260709 13:10:53.617528 30924 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.772681 31129 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:53.702437 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 106734us
I20260709 13:10:53.782893 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.614401 31278 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:53.692809 31295 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.735505 31319 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:53.773463 31311 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:10:53.775897 29748 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:53.791896 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.767897 31133 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:53.773985 29814 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:53.690212 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:53.704337 31281 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.735241 31253 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.815404 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:53.788357 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 93899.7us
I20260709 13:10:53.800632 31266 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:53.819684 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.818820 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:53.844260 29672 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.844938 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:10:53.812549 29695 debug-util.cc:398] Leaking SignalData structure 0x7b080019e780 after lost signal to thread 29606
I20260709 13:10:53.819926 31252 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.850652 29745 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.814953 31171 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:53.850232 29787 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:53.822396 31040 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.832815 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:53.874738 29745 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:53.804509 31127 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:53.846892 31316 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:10:53.880425 29787 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:53.863308 29672 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:53.876296 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.844323 31227 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:53.803185 31279 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.882424 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.883548 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.883647 31279 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.884176 29671 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:53.885315 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.886788 29749 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:53.787703 31255 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.884936 31227 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.895442 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:53.816995 31178 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.898877 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:53.823581 31239 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:53.858661 31183 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.858351 31144 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:53.835047 31237 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:53.888701 31201 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:53.853688 31196 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:10:53.888741 31009 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.921111 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:53.903012 31022 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:53.878942 31040 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.927395 30924 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.900460 29665 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:53.967739 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:53.975167 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 107087us
W20260709 13:10:53.917382 31310 log.cc:927] Time spent T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:10:53.841591 31319 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:53.929850 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3dc0 after lost signal to thread 29698
W20260709 13:10:53.994722 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 62500.2us
I20260709 13:10:53.917838 31091 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:53.918156 31144 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.857749 31252 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:53.917136 31161 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:53.976411 29742 raft_consensus.cc:2410] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:53.976629 31183 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:54.011046 31326 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:10:54.014176 31131 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.016050 31040 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.016192 29749 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:10:54.016429 31325 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:54.054042 31319 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.005203 31022 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.055871 31253 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.056310 31022 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.041808 30924 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:10:54.057473 31146 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.994958 31009 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.058189 31252 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:53.928429 31133 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:54.059870 31009 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.060060 31177 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:54.060585 31177 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:54.028960 31183 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:54.024731 31144 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.061779 31183 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:54.062990 31183 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.067473 31295 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.068611 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.017560 31127 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.069587 29672 raft_consensus.cc:2410] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:53.975901 31266 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.072702 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:53.990888 29665 pending_rounds.cc:85] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:53.915786 30316 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:53.960456 31201 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.906334 31279 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.100s
W20260709 13:10:54.001773 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.022279 29669 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:10:54.008216 29695 debug-util.cc:398] Leaking SignalData structure 0x7b0800355be0 after lost signal to thread 29699
W20260709 13:10:54.030345 29638 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45248 dropped due to backpressure: service queue is full with 50 items
I20260709 13:10:54.029692 31171 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:54.036440 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:54.005043 31137 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.021414 31278 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:54.083117 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 202757us
I20260709 13:10:54.104663 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.124140 29672 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
W20260709 13:10:54.105602 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.083945 30348 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:54.125155 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:54.081997 29665 pending_rounds.cc:107] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 3.2
W20260709 13:10:54.114001 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 124238us
I20260709 13:10:54.106932 31201 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:54.127780 29715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.563s (SENT) [suppressed 14 similar messages]
I20260709 13:10:54.029603 31161 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:54.129438 29715 leader_election.cc:336] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.603s (SENT)
I20260709 13:10:54.111964 31163 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.132556 29822 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:54.111718 31295 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:54.135286 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 100208us
I20260709 13:10:54.115186 31235 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.124171 31324 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.140832 29787 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:54.129087 31239 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.128582 29665 raft_consensus.cc:2889] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:54.158908 31239 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:54.159387 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:54.159744 31239 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:54.134233 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 237220us
I20260709 13:10:54.160961 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.161723 30316 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:54.162649 29748 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.167352 29822 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:54.123034 31267 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:10:54.149993 31301 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:54.175652 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.156469 31161 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.156903 31144 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.157644 31237 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:54.157742 31177 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.139375 31279 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:54.145197 31276 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:54.195145 31276 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:54.196777 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.198045 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.169346 31291 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.198658 29673 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:54.204751 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.171459 29748 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:54.171216 31171 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:54.162175 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.139663 31295 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.111901 29638 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45248 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1228)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1219)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1237)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1243)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1239)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1217)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1232)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1190)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1230)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1222)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1244)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1218)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1207)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1187)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1234)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1246)
W20260709 13:10:54.146677 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003a68a0 after lost signal to thread 29773
I20260709 13:10:54.160915 31239 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:54.174935 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.174732 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:54.147636 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 109806us
I20260709 13:10:54.159683 31211 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.165869 30350 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:54.193215 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:54.161128 30344 raft_consensus.cc:1240] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:54.195626 31276 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.228443 29819 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:54.137785 31163 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:54.208693 29673 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:54.212031 29749 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:54.198944 31279 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.257086 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:54.212626 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003b86c0 after lost signal to thread 29774
I20260709 13:10:54.228844 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.251569 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:54.251732 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 118486us
I20260709 13:10:54.266512 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.267138 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.267798 29672 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:54.267938 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.268671 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:54.269089 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.270239 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.270864 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:54.271229 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.271488 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.254256 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.255401 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.257599 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.188864 31324 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:10:54.258031 29821 raft_consensus.cc:2393] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:54.258997 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.259806 31163 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:54.177385 31235 consensus_queue.cc:1059] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:10:54.262079 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:54.265702 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.175190 31052 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.269747 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.546792 29672 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:54.269688 29820 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:54.482488 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:54.303694 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.386015 29674 raft_consensus.cc:2410] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:54.550343 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:54.215813 31177 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:54.560405 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.386866 29665 raft_consensus.cc:2368] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:54.412165 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:54.567097 29749 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.275727 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:54.386613 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.553169 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:54.561681 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.561978 29744 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:54.569955 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:54.553071 29748 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.485817 29670 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:54.215477 31183 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:54.559886 29666 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:54.261709 31211 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:54.572851 29815 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:54.408550 29743 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:54.574754 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.262394 31279 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.254839 29745 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:54.556185 31266 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.271953 31178 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:54.484277 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.577729 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.631958 29816 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:54.570734 29744 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.483135 31267 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:54.508953 31144 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:54.250335 31146 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.321s
I20260709 13:10:54.622617 29818 raft_consensus.cc:2393] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:54.591849 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.386173 31196 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.576692 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:54.627173 29745 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:54.626598 29748 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:54.577316 31163 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:10:54.604466 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 389426us
I20260709 13:10:54.647979 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.648313 31163 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:54.648958 31312 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.649434 31312 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.650053 31129 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.650408 31163 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:54.650911 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.651409 31312 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:54.652072 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.653317 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.654528 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.654983 29814 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:54.527575 31137 consensus_queue.cc:1059] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:10:54.658949 30316 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:54.659408 31176 raft_consensus.cc:993] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:54.660070 31176 raft_consensus.cc:1081] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:54.660993 31291 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:54.577417 31022 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:54.637449 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.603544 31295 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.580451 30924 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:54.627954 29695 debug-util.cc:398] Leaking SignalData structure 0x7b080036e920 after lost signal to thread 29847
I20260709 13:10:54.617826 31183 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:54.616658 31052 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:54.616439 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.631210 31204 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:54.682898 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.634351 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.632892 31266 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.638602 31178 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:10:54.694032 31163 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:54.705909 31163 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.707950 31163 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:54.709025 31349 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:54.710289 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.711772 29819 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:54.712338 30344 raft_consensus.cc:1240] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:54.704352 31009 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:54.713940 31009 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.640825 31267 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.714318 31239 consensus_queue.cc:1059] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:54.716243 31267 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.704613 31312 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.717190 31312 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:54.719914 31281 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:54.697119 29670 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:54.604157 31211 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.699048 29744 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:54.663131 30346 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:54.723981 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.725311 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:54.726063 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 154324us
I20260709 13:10:54.741900 29715 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:54.742893 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.743484 29715 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:54.744201 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.703044 31204 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:54.746085 31267 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.747792 31171 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:54.748075 31348 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:54.748448 31348 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:54.748792 31348 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.703404 29820 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:54.752363 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:54.753043 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:54.753901 31354 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:54.756031 31348 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.756675 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:54.758412 31348 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.734094 29638 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:54.737761 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:54.758476 31353 log.cc:927] Time spent T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:54.759403 31354 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:54.759865 31354 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:54.760073 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:54.759451 29671 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.760833 31278 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:54.761209 31278 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:54.761396 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:54.762566 31137 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:54.762924 31137 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.766916 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:54.768335 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:54.769536 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:54.771368 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:54.730374 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.773279 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:54.664644 31196 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.780985 29744 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.700440 31052 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.774051 31354 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.761597 31278 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.773847 31137 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:54.783659 29671 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:54.722159 31146 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.786437 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:54.789011 31276 consensus_meta.cc:287] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.003s
I20260709 13:10:54.789453 31276 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.791639 31276 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:54.794430 31009 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.795981 29665 raft_consensus.cc:2410] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:54.795542 31354 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.698540 30924 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.797856 31183 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.762836 31266 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.695696 31022 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.747754 31204 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:54.809222 29817 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
W20260709 13:10:54.807596 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62628.8us
I20260709 13:10:54.822214 31312 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:54.783924 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.800180 31146 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.813844 31278 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:54.819595 31022 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:54.799901 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6e80 after lost signal to thread 30374
W20260709 13:10:54.844671 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6fc0 after lost signal to thread 30375
I20260709 13:10:54.844899 31279 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.846072 29666 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:54.847952 31323 raft_consensus.cc:3055] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:54.848057 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.848579 31323 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:54.849465 31323 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:54.821064 31201 consensus_meta.cc:287] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.003s
I20260709 13:10:54.821739 29668 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:54.850880 31323 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:54.851193 31201 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:54.853271 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1210) took 1038 ms. Trace:
I20260709 13:10:54.828981 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:54.854889 29670 raft_consensus.cc:2368] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:10:54.855767 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.829468 29715 leader_election.cc:400] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:54.802402 31321 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:54.840194 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.861737 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.862500 29673 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:54.778882 29638 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45236 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1229)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1240)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1235)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1251)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1220)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1252)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1221)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1194)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1247)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1241)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1253)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1238)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1214)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1249)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1215)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1216)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1188)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1213)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1250)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1187)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1225)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1227)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1234)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1236)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1242)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1246)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1210)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1211)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1217)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1220)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1221)
I20260709 13:10:54.841789 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.886281 29667 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:54.887320 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.888010 29667 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:54.843917 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:54.853645 29668 rpcz_store.cc:276] 0709 13:10:53.815228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.816883 (+  1655us) service_pool.cc:224] Handling call
0709 13:10:54.821281 (+1004398us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b5800002a98. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998eee 0000000000375939 00007fd9eea0c1e0 00007fd9eead50c4 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:10:54.821433 (+   152us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.852981 (+ 31548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.853189 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16208640}
I20260709 13:10:54.856647 29715 leader_election.cc:403] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:54.896440 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.897454 29668 raft_consensus.cc:2410] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:54.858551 29666 raft_consensus.cc:2410] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:54.898825 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.900008 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.901070 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:54.853873 29823 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:54.859454 29749 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:54.904439 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:54.905083 29749 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:54.910498 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.911506 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.912460 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1197) took 1020 ms. Trace:
I20260709 13:10:54.915234 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.828428 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.878475 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.881243 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:54.846582 30924 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:54.937515 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:54.980176 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 154856us
I20260709 13:10:54.930809 29818 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:54.936905 31354 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:54.974779 31266 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3.
I20260709 13:10:54.987116 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:54.987617 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:54.987919 29749 raft_consensus.cc:2393] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:54.988842 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:54.991645 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:54.992265 29668 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:54.994009 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.999361 29715 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:54.838243 31009 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:10:54.912868 29666 rpcz_store.cc:276] 0709 13:10:53.892048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.901896 (+1009848us) service_pool.cc:224] Handling call
0709 13:10:54.912391 (+ 10495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.000969 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.001624 29639 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:54.808846 31177 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:10:54.884730 31129 raft_consensus.cc:3055] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:54.978583 29667 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:10:55.008858 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1233) took 1009 ms. Trace:
I20260709 13:10:54.903347 31358 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.978946 29740 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
I20260709 13:10:55.008965 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.013957 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:55.015286 29668 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:55.015888 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1203) took 1106 ms. Trace:
I20260709 13:10:55.016206 29668 rpcz_store.cc:276] 0709 13:10:53.909704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.991321 (+1081617us) service_pool.cc:224] Handling call
0709 13:10:55.015828 (+ 24507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.009490 29667 rpcz_store.cc:276] 0709 13:10:53.999341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.888646 (+889305us) service_pool.cc:224] Handling call
0709 13:10:55.008800 (+120154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.019702 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.020330 29668 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:55.005705 29639 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:54.880685 29744 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:55.022017 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.023377 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.023851 29744 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:55.024454 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.024884 29744 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:55.024925 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:54.993028 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 325964us
I20260709 13:10:55.027024 30316 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.028190 31279 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.028939 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:55.029613 30344 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:55.011090 31052 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:55.003922 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:55.030802 31237 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:55.003965 31235 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:55.020494 29715 leader_election.cc:336] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.942s (SENT)
I20260709 13:10:55.042271 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.008523 31129 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:55.043215 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.044097 31363 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:55.044822 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.044034 31129 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.045889 31129 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.050820 31253 raft_consensus.cc:3055] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:55.051263 31253 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:55.052027 31253 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.053184 31253 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.047132 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.056286 29668 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:55.057266 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.057614 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.057889 29668 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:55.058354 29667 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:55.058929 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.049592 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 707) took 1454 ms. Trace:
I20260709 13:10:55.017737 31201 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:55.017735 31211 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.060047 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.003504 30924 consensus_queue.cc:1059] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:10:55.017349 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.065280 29668 raft_consensus.cc:2410] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:10:55.067308 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 61648.6us
I20260709 13:10:55.031965 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.074255 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.075582 29748 raft_consensus.cc:2393] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:55.068917 29639 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.023047 31293 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.021109 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48028 (request call id 710) took 1413 ms. Trace:
I20260709 13:10:55.073562 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:55.077654 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.074955 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.080977 31293 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.080029 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.018927 31358 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.071767 31235 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.069710 29742 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:55.037930 31294 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:10:55.083364 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.096525 31211 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.063673 29743 rpcz_store.cc:276] 0709 13:10:53.594844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.604991 (+ 10147us) service_pool.cc:224] Handling call
0709 13:10:53.675052 (+ 70061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.616515 (+941463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.048356 (+431841us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b540014cba0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a34dc0 00007fd9e9ac0a02 00007fd9e9abcdd6 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2
0709 13:10:55.049315 (+   959us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400224554. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:55.049519 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327553280}
I20260709 13:10:55.101507 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.102288 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.087325 31082 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.086282 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.103256 29667 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.103394 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.104813 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.105868 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.106796 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.088601 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.107699 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.107924 31211 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:55.108232 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.109189 29639 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.109330 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.110008 29744 raft_consensus.cc:2393] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
W20260709 13:10:55.084365 31359 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:55.114789 29639 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.085395 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.115496 29668 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:55.084213 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.071273 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.083274 29715 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.113042 29667 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:55.117311 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1188) took 1237 ms. Trace:
I20260709 13:10:55.082743 31146 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.116298 29748 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 1.
W20260709 13:10:55.099751 29789 leader_election.cc:336] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 2.011s (SENT)
I20260709 13:10:55.117709 29715 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.111871 29743 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:55.119644 29715 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.085608 31293 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.117728 29667 rpcz_store.cc:276] 0709 13:10:53.879671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.086013 (+1206342us) service_pool.cc:224] Handling call
0709 13:10:55.117256 (+ 31243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.092453 31278 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.089418 31266 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:55.081176 29740 rpcz_store.cc:276] 0709 13:10:53.607261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.614266 (+  7005us) service_pool.cc:224] Handling call
0709 13:10:54.843779 (+1229513us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998e9c 00007fd9e6998a5b 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:55.019175 (+175396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21989120}
I20260709 13:10:55.147938 31196 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:54.846589 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:55.149123 31358 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.150637 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.151407 29665 raft_consensus.cc:2376] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3. Re-sending same reply.
I20260709 13:10:55.151973 29665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1208) took 1142 ms. Trace:
I20260709 13:10:55.152441 29665 rpcz_store.cc:276] 0709 13:10:54.009782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.150229 (+1140447us) service_pool.cc:224] Handling call
0709 13:10:55.151896 (+  1667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.154753 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.155581 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1240) took 1154 ms. Trace:
I20260709 13:10:55.122274 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.155930 29671 rpcz_store.cc:276] 0709 13:10:54.000887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.154495 (+1153608us) service_pool.cc:224] Handling call
0709 13:10:55.155511 (+  1016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.122519 31082 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:55.128075 31163 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:55.127635 29715 leader_election.cc:400] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:10:55.123917 31164 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:55.127686 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.132855 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.151870 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:55.133889 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.135733 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.140762 29745 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:55.141260 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.142344 29742 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:10:55.126456 31235 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:55.169188 29745 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.156639 29668 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.125255 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.153599 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.160025 29715 leader_election.cc:403] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:55.171030 29667 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:10:55.172394 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44888.7us
I20260709 13:10:55.173596 29715 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.119877 31211 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:55.161559 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 203) took 5883 ms. Trace:
I20260709 13:10:55.163177 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1209) took 1348 ms. Trace:
W20260709 13:10:55.177120 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.164897 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:55.178248 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.148156 29740 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.169164 29789 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.170722 29745 raft_consensus.cc:1240] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.180918 29789 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.179529 29819 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.174696 29715 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.177677 29669 rpcz_store.cc:276] 0709 13:10:53.814924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.815101 (+   177us) service_pool.cc:224] Handling call
0709 13:10:55.162975 (+1347874us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400214154. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:55.163116 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408654592}
I20260709 13:10:55.165889 31082 raft_consensus.cc:697] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:55.182574 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.183667 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.185168 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.172128 31052 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.186550 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.186812 29789 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.185267 29715 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.178315 31358 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:10:55.179808 31211 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.187347 29669 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:55.192832 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.193951 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.179045 29572 rpcz_store.cc:276] 0709 13:10:49.336576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.340756 (+  4180us) service_pool.cc:224] Handling call
0709 13:10:55.161494 (+5820738us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:53.226254 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:53.375427 (+149173us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:53.375462 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:10:53.375479 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:53.376563 (+  1084us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:53.376621 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:53.376648 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:10:53.391720 (+ 15072us) tablet.cc:701] Row locks acquired
0709 13:10:53.391741 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:53.391885 (+   144us) write_op.cc:270] Start()
0709 13:10:53.392014 (+   129us) write_op.cc:276] Timestamp: P: 1783602653391840 usec, L: 0
0709 13:10:53.392037 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:53.392719 (+   682us) log.cc:844] Serialized 5240 byte log entry
0709 13:10:53.605126 (+212407us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:54.192794 (+587668us) op_driver.cc:464] REPLICATION: finished
0709 13:10:54.662959 (+470165us) write_op.cc:301] APPLY: starting
0709 13:10:54.690930 (+ 27971us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:54.720746 (+ 29816us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:54.720770 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:54.759687 (+ 38917us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:54.759928 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:10:54.759981 (+    53us) write_op.cc:312] APPLY: finished
0709 13:10:54.760316 (+   335us) log.cc:844] Serialized 94 byte log entry
0709 13:10:54.760507 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.760661 (+   154us) write_op.cc:454] Released schema lock
0709 13:10:54.760707 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:54.761067 (+   360us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:54.761097 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":829380,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":438387,"apply.run_cpu_time_us":3667,"apply.run_wall_time_us":121356,"num_ops":13,"prepare.queue_time_us":15442,"prepare.run_cpu_time_us":42764,"prepare.run_wall_time_us":240049,"raft.queue_time_us":326182,"raft.run_cpu_time_us":25254,"raft.run_wall_time_us":324448,"replication_time_us":800613,"spinlock_wait_cycles":73318784,"thread_start_us":606900,"threads_started":4,"wal-append.queue_time_us":88463}]]}
I20260709 13:10:55.179778 29665 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:55.189970 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.172286 29818 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:55.198737 29746 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:55.185158 31196 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:55.185907 31354 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.186059 31201 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:55.205760 29670 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:55.213084 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.231935 29669 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:55.232954 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.210302 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.233799 29671 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.211418 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.234615 29667 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 1.
I20260709 13:10:55.188592 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.218245 31082 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.190953 31357 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.189230 31306 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:55.190748 31281 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:55.189101 31194 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:55.186036 31293 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:55.220489 29668 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:10:55.221204 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:55.223248 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:55.208240 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.197786 31211 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.251637 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:55.273628 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 85141us
I20260709 13:10:55.274397 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1207) took 1290 ms. Trace:
I20260709 13:10:55.273679 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.274902 29668 rpcz_store.cc:276] 0709 13:10:53.983886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.251300 (+1267414us) service_pool.cc:224] Handling call
0709 13:10:55.274324 (+ 23024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.275382 29667 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:55.276149 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.277036 29668 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:55.242811 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.277606 29669 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:55.277938 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.278452 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.278995 29669 raft_consensus.cc:2376] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4. Re-sending same reply.
I20260709 13:10:55.272119 29674 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:55.282624 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1231) took 1283 ms. Trace:
I20260709 13:10:55.282966 29674 rpcz_store.cc:276] 0709 13:10:53.998860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.207928 (+1209068us) service_pool.cc:224] Handling call
0709 13:10:55.282545 (+ 74617us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.284377 29818 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:55.285374 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.232519 31196 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:55.290856 31196 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.291712 31211 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.294263 31211 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.295277 29714 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:55.234793 31354 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:55.236114 31358 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.301005 29671 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:55.238178 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.311671 29672 raft_consensus.cc:2410] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:55.312505 29674 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.243459 31357 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.243793 31281 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.315781 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1192) took 1435 ms. Trace:
I20260709 13:10:55.317257 29674 rpcz_store.cc:276] 0709 13:10:53.880647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.307690 (+1427043us) service_pool.cc:224] Handling call
0709 13:10:55.307985 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.315533 (+  7548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.315732 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.318544 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.242401 31312 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:55.318629 29674 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.319259 29667 raft_consensus.cc:2368] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4.
I20260709 13:10:55.242352 31194 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:55.320611 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 131499us
I20260709 13:10:55.323318 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1225) took 1325 ms. Trace:
I20260709 13:10:55.324097 29674 rpcz_store.cc:276] 0709 13:10:53.997455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.318110 (+1320655us) service_pool.cc:224] Handling call
0709 13:10:55.318431 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.323080 (+  4649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.323264 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.243672 31306 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:55.311707 31354 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.312445 31358 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.329466 29669 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.320016 31357 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.330947 29668 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:55.320406 31281 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.322780 31301 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.327134 31306 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.327581 31194 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.336840 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1187) took 1457 ms. Trace:
I20260709 13:10:55.327527 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:55.335203 31137 consensus_meta.cc:287] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:10:55.329771 31358 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.340051 29668 rpcz_store.cc:276] 0709 13:10:53.879303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.315548 (+1436245us) service_pool.cc:224] Handling call
0709 13:10:55.330612 (+ 15064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.335661 (+  5049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.336783 (+  1122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.351621 30344 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:10:55.352087 30344 pending_rounds.cc:85] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 2
I20260709 13:10:55.352339 30344 pending_rounds.cc:107] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:10:55.352592 30344 raft_consensus.cc:2917] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:10:55.352985 30344 raft_consensus.cc:2889] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:55.339569 31301 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.356101 31301 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.357759 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:55.362704 31380 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.363240 31380 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.363585 31380 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.365341 31253 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:55.353848 31164 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:55.333310 31360 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:10:55.368760 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 72142.2us
I20260709 13:10:55.346400 31137 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.371866 29668 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:10:55.368568 31301 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:55.378158 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 82950.5us
W20260709 13:10:55.378479 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 52964.8us
I20260709 13:10:55.379424 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.374784 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1234) took 1375 ms. Trace:
I20260709 13:10:55.365900 31253 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.385124 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.396423 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.397706 29715 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.417955 29668 rpcz_store.cc:276] 0709 13:10:53.999559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.344794 (+1345235us) service_pool.cc:224] Handling call
0709 13:10:55.371648 (+ 26854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.373003 (+  1355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.373281 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.423162 29673 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:55.416664 31295 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:55.416961 31301 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.442325 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.443035 29743 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:55.443696 31338 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 1.290s	user 0.006s	sys 0.008s
I20260709 13:10:55.444923 31177 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.445622 31177 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.446712 31194 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.448140 29820 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:55.449816 29746 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.450309 31133 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:55.450753 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.451200 31331 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:55.442392 31382 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.451601 31331 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:55.452450 31331 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.453441 31331 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.453783 31039 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:55.422812 31171 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:10:55.454530 29815 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:55.456555 31194 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:55.449832 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.451395 29639 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.452791 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:10:55.468398 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.474205 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.435321 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.445051 31295 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.481966 31281 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:55.486409 29789 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.486958 29743 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:55.492776 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:55.494150 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.487715 29668 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:55.495774 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1242) took 1494 ms. Trace:
I20260709 13:10:55.496146 29668 rpcz_store.cc:276] 0709 13:10:54.001539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.431255 (+1429716us) service_pool.cc:224] Handling call
0709 13:10:55.487367 (+ 56112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.495488 (+  8121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.495714 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.443768 31301 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.453466 31137 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.502813 29638 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.490706 31362 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.512591 29819 raft_consensus.cc:2368] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:10:55.490260 31196 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:55.498557 31363 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:55.511970 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 114344us
I20260709 13:10:55.515547 29638 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.500321 31312 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:55.491400 31358 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.502343 31052 consensus_queue.cc:1059] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:10:55.530426 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1204) took 1613 ms. Trace:
I20260709 13:10:55.519701 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:55.497080 31194 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.502681 31201 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:55.524775 29638 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.522162 29715 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.525319 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.484411 31177 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:55.526260 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.529105 29818 raft_consensus.cc:2410] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:55.527712 31279 raft_consensus.cc:3055] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:55.530860 29671 rpcz_store.cc:276] 0709 13:10:53.916917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.310725 (+1393808us) service_pool.cc:224] Handling call
0709 13:10:55.321761 (+ 11036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.321995 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:55.501806 (+179811us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.530099 (+ 28293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:55.530152 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:55.530190 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.530250 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.530369 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3999,"thread_start_us":195516,"threads_started":2,"wal-append.queue_time_us":23769}
I20260709 13:10:55.532876 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:55.585785 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:55.577232 31396 log.cc:927] Time spent T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:10:55.533529 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.537865 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.512835 31171 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:10:55.527556 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.597040 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.597703 29747 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:10:55.598165 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.603273 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 81167.4us
I20260709 13:10:55.527099 31312 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:10:55.580727 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 56025.8us
I20260709 13:10:55.605322 29638 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.578882 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.534535 29817 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:55.508334 31133 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:55.584137 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.513549 31362 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.587239 29668 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:55.580312 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.534108 31363 raft_consensus.cc:697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:55.604236 29715 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.579984 31163 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.579295 29741 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.584281 31279 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:55.535116 29570 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 3 to 4, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:55.606854 29638 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.532469 31137 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:55.526696 31196 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:55.522142 31380 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.614900 29715 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.605832 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.627046 29745 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:55.616958 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.625703 31323 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:55.621574 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.622777 29747 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:55.621150 29570 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 2, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 2 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.628984 29743 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:55.608072 31183 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.610999 31362 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.611403 31295 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:55.632937 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.635282 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.636833 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.619087 31360 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:55.647809 29745 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:55.613013 31312 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:55.649794 29745 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.619405 31253 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:55.654845 29745 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:55.611327 31146 consensus_queue.cc:1059] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:10:55.651764 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.668972 29746 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:55.615828 31306 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.659042 31196 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.648874 31267 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:55.661375 29744 raft_consensus.cc:2368] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5.
W20260709 13:10:55.681989 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 46776us
I20260709 13:10:55.650990 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:55.656608 29638 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.623649 31137 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:55.686060 29638 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.672067 29671 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:55.674016 31393 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:55.677542 31380 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.646245 31295 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:55.680018 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.661331 31323 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:55.650631 31211 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:55.687093 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1245) took 1684 ms. Trace:
I20260709 13:10:55.669834 31082 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.700506 29671 rpcz_store.cc:276] 0709 13:10:54.002284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.649972 (+1647688us) service_pool.cc:224] Handling call
0709 13:10:55.671904 (+ 21932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.686863 (+ 14959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.687044 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.687834 31253 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.703155 31253 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.704476 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1246) took 1702 ms. Trace:
I20260709 13:10:55.688467 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.705250 31253 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:55.706140 29638 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.706806 31380 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.707547 31129 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:55.707331 31380 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.707963 31129 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.708400 31129 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:55.709602 31380 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.710631 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:55.694618 31235 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:55.711881 31235 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.712268 31235 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.712903 31312 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.704854 29671 rpcz_store.cc:276] 0709 13:10:54.002501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.703715 (+1701214us) service_pool.cc:224] Handling call
0709 13:10:55.704013 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.704186 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.704210 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:55.704248 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:55.704275 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.704323 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.704425 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:55.715140 31312 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:55.683507 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.685549 31267 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.716598 31267 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:55.716861 29715 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.718103 29715 leader_election.cc:400] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4.
I20260709 13:10:55.718357 29715 leader_election.cc:403] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:55.718982 31392 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:55.719370 31392 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.719726 31392 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.691267 31360 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:55.721347 31360 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.721712 31360 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.722208 31386 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:55.722723 31386 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:55.723580 31386 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.688608 31137 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:55.726125 31394 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4.
I20260709 13:10:55.650964 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.729417 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.707238 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:55.701823 29817 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:55.688701 31183 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.686502 31146 consensus_queue.cc:1243] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:55.700596 31281 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:55.694794 31295 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:55.744334 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:55.751917 31387 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:10:55.753101 31391 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:55.753816 29671 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:55.701268 29665 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
W20260709 13:10:55.752974 31390 log.cc:927] Time spent T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:10:55.747591 31399 log.cc:927] Time spent T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:10:55.747020 31146 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:55.734380 31082 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:55.781599 29670 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1221) took 1785 ms (client timeout 2157 ms). Trace:
W20260709 13:10:55.782733 29670 rpcz_store.cc:269] 0709 13:10:53.996393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.861463 (+865070us) service_pool.cc:224] Handling call
0709 13:10:55.781423 (+919960us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400268754. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:55.781536 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519672192}
I20260709 13:10:55.774729 31146 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.783833 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:55.784406 31137 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.787281 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.767788 31253 raft_consensus.cc:2764] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:55.768200 31358 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.738068 31394 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:10:55.790227 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:55.794775 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 49295us
I20260709 13:10:55.787791 31146 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:55.697299 31363 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.801857 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.905812 29823 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.851732 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:55.905647 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.871965 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:55.878613 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:55.860467 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1191) took 1980 ms. Trace:
I20260709 13:10:56.080121 29823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 678) took 1085 ms. Trace:
I20260709 13:10:55.857815 29819 raft_consensus.cc:1240] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.812964 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:55.850041 29672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1239) took 1849 ms (client timeout 1825 ms). Trace:
I20260709 13:10:55.864269 29749 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:10:55.941283 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.082994 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1220) took 1185 ms. Trace:
I20260709 13:10:56.015158 29639 leader_election.cc:400] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:10:55.904454 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1204) took 1255 ms. Trace:
I20260709 13:10:56.086066 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.901958 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.082489 29669 rpcz_store.cc:276] 0709 13:10:53.880413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.308973 (+1428560us) service_pool.cc:224] Handling call
0709 13:10:55.309339 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.329987 (+ 20648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.860227 (+530240us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54001f45d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:55.860410 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45835648}
I20260709 13:10:56.083590 29666 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:56.096155 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:56.097131 29666 raft_consensus.cc:2410] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:10:56.083562 29672 rpcz_store.cc:269] 0709 13:10:54.000673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.132566 (+1131893us) service_pool.cc:224] Handling call
0709 13:10:55.849798 (+717232us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400267854. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:55.849967 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333921024}
I20260709 13:10:55.866022 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:10:55.805850 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 98682.5us
W20260709 13:10:55.938373 29673 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1194) took 2057 ms (client timeout 2280 ms). Trace:
W20260709 13:10:56.104743 29673 rpcz_store.cc:269] 0709 13:10:53.881140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.863173 (+982033us) service_pool.cc:224] Handling call
0709 13:10:55.938187 (+1075014us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54003cd7d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:55.938316 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016255872}
I20260709 13:10:55.805009 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:55.937691 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 130) took 1772 ms. Trace:
I20260709 13:10:56.106348 29671 rpcz_store.cc:276] 0709 13:10:54.165781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.715216 (+1549435us) service_pool.cc:224] Handling call
0709 13:10:55.715527 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.754222 (+ 38695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.937441 (+183219us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b54002a99d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:55.937625 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79784192}
W20260709 13:10:56.079607 29821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 664) took 1546 ms (client timeout 1542 ms). Trace:
W20260709 13:10:56.108071 29821 rpcz_store.cc:269] 0709 13:10:54.533644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.801593 (+1267949us) service_pool.cc:224] Handling call
0709 13:10:56.079522 (+277929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.109160 29668 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.085978 29639 leader_election.cc:403] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:56.095003 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:56.084735 29819 rpcz_store.cc:276] 0709 13:10:54.897454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.857324 (+959870us) service_pool.cc:224] Handling call
0709 13:10:55.857633 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.082727 (+225094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.082936 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.082522 29823 rpcz_store.cc:276] 0709 13:10:54.994729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.905385 (+910656us) service_pool.cc:224] Handling call
0709 13:10:55.905651 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.079822 (+174171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.080058 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:56.124493 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 319596us
I20260709 13:10:56.125524 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:56.084216 29749 pending_rounds.cc:85] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 2
W20260709 13:10:56.138188 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 123180us
I20260709 13:10:56.138238 29749 pending_rounds.cc:107] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
W20260709 13:10:55.859973 31364 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.792s	user 0.001s	sys 0.003s
W20260709 13:10:55.909791 31354 consensus_meta.cc:287] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.002s
I20260709 13:10:55.802501 31306 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:55.851547 31357 consensus_meta.cc:287] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.514s	user 0.004s	sys 0.003s
I20260709 13:10:56.142946 29823 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:55.899902 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.842417 29741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1351) took 1123 ms. Trace:
I20260709 13:10:55.851441 31281 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:56.146477 29749 raft_consensus.cc:2917] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
W20260709 13:10:56.145732 29674 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.022s	sys 0.042s
I20260709 13:10:55.795404 31177 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:55.835813 31321 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.150389 29666 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:55.854406 31402 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:55.811404 31331 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.801543 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:56.153643 29638 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:55.835701 30350 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:56.129078 31052 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.009s	sys 0.024s
I20260709 13:10:56.044445 31137 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.196605 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 124) took 1925 ms. Trace:
I20260709 13:10:56.197079 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:55.862165 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:55.820060 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:56.143563 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.190982 31306 raft_consensus.cc:1064] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:55.837287 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:55.855389 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:55.907102 31163 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:55.942200 31392 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.149770 31183 consensus_queue.cc:1059] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:10:56.158367 31039 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:55.937064 31360 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.232434 31183 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:56.232796 31183 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:56.012517 31382 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:56.233601 31183 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.946033 31267 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.230723 31163 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.163108 31357 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:55.866431 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.236931 29742 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:56.226421 31415 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.064s	user 0.002s	sys 0.001s
I20260709 13:10:56.167810 29823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 679) took 1172 ms. Trace:
I20260709 13:10:56.239413 29823 rpcz_store.cc:276] 0709 13:10:54.995396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.142381 (+1146985us) service_pool.cc:224] Handling call
0709 13:10:56.142734 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.167546 (+ 24812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.167754 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.136880 31397 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.172724 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:56.187718 31196 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:56.175981 29749 raft_consensus.cc:2889] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.177175 29817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1222) took 1138 ms. Trace:
I20260709 13:10:56.192795 31331 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.166563 29741 rpcz_store.cc:276] 0709 13:10:54.719452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.123650 (+404198us) service_pool.cc:224] Handling call
0709 13:10:55.168848 (+ 45198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.619467 (+450619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.842116 (+222649us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540031b0d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:55.842339 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":821821312}
I20260709 13:10:55.898768 31358 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.265s
I20260709 13:10:56.183729 29671 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:56.184813 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1210) took 1769 ms. Trace:
I20260709 13:10:56.254797 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1211) took 1682 ms. Trace:
I20260709 13:10:55.936642 31129 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.026149 31235 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.186784 29668 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:55.905242 31398 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.261s
I20260709 13:10:56.157559 31323 consensus_queue.cc:1059] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:10:55.950214 31362 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:56.192046 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 330506us
I20260709 13:10:56.263586 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.198696 29748 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:56.197010 29822 rpcz_store.cc:276] 0709 13:10:54.270744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.706299 (+435555us) service_pool.cc:224] Handling call
0709 13:10:54.706654 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.706996 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:54.707022 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.707455 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:10:54.937702 (+230247us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:54.937745 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.937815 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:55.859379 (+921564us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:56.191206 (+331827us) raft_consensus.cc:1685] finished
0709 13:10:56.191227 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.196535 (+  5308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10311,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":18779904,"thread_start_us":229934,"threads_started":1,"wal-append.queue_time_us":311764}
I20260709 13:10:56.085507 29815 rpcz_store.cc:276] 0709 13:10:54.649200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.655347 (+  6147us) service_pool.cc:224] Handling call
0709 13:10:55.454184 (+798837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.454947 (+   763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.904227 (+449280us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b540019bed0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:55.904396 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836414208}
I20260709 13:10:56.204602 29672 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:55.845130 31082 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:55.940325 31279 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.187534 31161 consensus_queue.cc:1059] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:10:56.211169 29667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.007s
W20260709 13:10:56.282907 29667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.008s	sys 0.008s
I20260709 13:10:56.283869 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1227) took 2286 ms. Trace:
I20260709 13:10:56.214250 31413 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:56.164525 31354 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.290664 29819 raft_consensus.cc:606] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
W20260709 13:10:56.194564 31052 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.010s	sys 0.024s
I20260709 13:10:56.233506 31382 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:55.870064 31295 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.182142 31281 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.290187 29640 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:10:56.143519 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 237925us
I20260709 13:10:56.147565 31022 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:56.227057 31306 raft_consensus.cc:1068] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:10:56.173802 29674 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.022s	sys 0.042s
I20260709 13:10:56.283619 31293 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:56.251339 29823 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:56.302819 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 149268us
I20260709 13:10:56.303534 29823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 688) took 1105 ms. Trace:
I20260709 13:10:56.181447 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.303726 29638 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.251197 29740 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:56.304330 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1236) took 2302 ms. Trace:
I20260709 13:10:56.234807 31183 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.254598 29666 rpcz_store.cc:276] 0709 13:10:54.415120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.149264 (+1734144us) service_pool.cc:224] Handling call
0709 13:10:56.150198 (+   934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.184569 (+ 34371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.184762 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.255141 29742 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:56.306072 29823 rpcz_store.cc:276] 0709 13:10:55.198065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.250874 (+1052809us) service_pool.cc:224] Handling call
0709 13:10:56.251173 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.303277 (+ 52104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.303475 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.256644 29671 rpcz_store.cc:276] 0709 13:10:54.571989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.157250 (+1585261us) service_pool.cc:224] Handling call
0709 13:10:56.183452 (+ 26202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.254517 (+ 71065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.254744 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.190132 31321 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:56.241765 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.252786 31196 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:56.268743 29818 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:56.269037 29668 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:56.271039 29670 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:56.271512 31146 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.278121 31401 raft_consensus.cc:1064] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:10:56.326309 31401 raft_consensus.cc:1068] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:56.326671 31196 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:56.326855 29815 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:56.280028 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.327011 31146 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.328022 31146 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:56.286166 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.256352 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 677) took 1262 ms. Trace:
I20260709 13:10:56.327461 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1224) took 1025 ms. Trace:
I20260709 13:10:56.329692 29814 rpcz_store.cc:276] 0709 13:10:54.990142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.030060 (+ 39918us) service_pool.cc:224] Handling call
0709 13:10:55.855227 (+825167us) spinlock_profiling.cc:243] Waited 8.95 ms on lock 0x7b58001d0498. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:56.250140 (+394913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20577664}
I20260709 13:10:56.330399 29815 rpcz_store.cc:276] 0709 13:10:55.302311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.308840 (+1006529us) service_pool.cc:224] Handling call
0709 13:10:56.326669 (+ 17829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.327253 (+   584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.327414 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.331777 29815 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:56.284263 29667 rpcz_store.cc:276] 0709 13:10:53.997941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.332450 (+1334509us) service_pool.cc:224] Handling call
0709 13:10:55.341613 (+  9163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.345658 (+  4045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.345691 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.346235 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.518594 (+172359us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.283291 (+764697us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.283541 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.283618 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.283660 (+    42us) raft_consensus.cc:1685] finished
0709 13:10:56.283673 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.283814 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130497,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":1066,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":19116,"thread_start_us":844454,"threads_started":2,"wal-append.queue_time_us":288131}
I20260709 13:10:56.333348 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:56.192087 31201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.062s	sys 0.050s
I20260709 13:10:56.327430 29818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 687) took 1151 ms. Trace:
W20260709 13:10:56.334236 31201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.063s	sys 0.050s
I20260709 13:10:56.293310 29822 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:56.294381 29669 raft_consensus.cc:2368] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:10:56.202124 31253 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.334394 29818 rpcz_store.cc:276] 0709 13:10:55.176057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.249323 (+1073266us) service_pool.cc:224] Handling call
0709 13:10:56.262448 (+ 13125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.327151 (+ 64703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.327359 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.336009 29815 raft_consensus.cc:3055] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:56.336411 29815 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.243588 29817 rpcz_store.cc:276] 0709 13:10:55.038934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.146245 (+1107311us) service_pool.cc:224] Handling call
0709 13:10:56.176686 (+ 30441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.176868 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.176894 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.176933 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:56.176962 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.177016 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.177123 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.337188 29815 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.338438 29815 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.341251 29817 raft_consensus.cc:3055] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:56.302462 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.304697 29674 rpcz_store.cc:276] 0709 13:10:54.000004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.363773 (+1363769us) service_pool.cc:224] Handling call
0709 13:10:55.364106 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.364323 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.364346 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.364783 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.522230 (+157447us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.301367 (+779137us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.301588 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.301676 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.301720 (+    44us) raft_consensus.cc:1685] finished
0709 13:10:56.301733 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.301874 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62534,"prepare.queue_time_us":166600,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":847181,"threads_started":2,"wal-append.queue_time_us":269882}
I20260709 13:10:56.343775 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:56.304093 29744 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.285591 31255 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.288448 31171 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:56.322683 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 133) took 1740 ms. Trace:
I20260709 13:10:56.350314 29668 rpcz_store.cc:276] 0709 13:10:54.582058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.259617 (+1677559us) service_pool.cc:224] Handling call
0709 13:10:56.268714 (+  9097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.322379 (+ 53665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.322624 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.302245 31404 consensus_queue.cc:1059] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 13:10:56.354470 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 89671.2us
I20260709 13:10:56.355973 31082 raft_consensus.cc:3055] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:56.357461 31403 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
I20260709 13:10:56.358642 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 689) took 1077 ms. Trace:
I20260709 13:10:56.398726 29822 rpcz_store.cc:276] 0709 13:10:55.281075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.284759 (+1003684us) service_pool.cc:224] Handling call
0709 13:10:56.293135 (+  8376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.358288 (+ 65153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.358570 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.366432 31293 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.374269 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1221) took 1362 ms. Trace:
I20260709 13:10:56.379638 31235 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.383224 31360 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.333988 29667 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:56.395435 29639 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.323302 29665 raft_consensus.cc:2410] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:56.287361 31312 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:10:56.341672 29817 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.405794 29821 rpcz_store.cc:276] 0709 13:10:55.012361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.144922 (+1132561us) service_pool.cc:224] Handling call
0709 13:10:56.145248 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.351641 (+206393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.351674 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.351717 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.351746 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.373991 (+ 22245us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54000555d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:56.374048 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.374203 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474198400}
I20260709 13:10:56.302750 31227 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.302302 31323 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.408453 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1219) took 1640 ms. Trace:
I20260709 13:10:56.426607 29668 rpcz_store.cc:276] 0709 13:10:54.767807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.351184 (+1583377us) service_pool.cc:224] Handling call
0709 13:10:56.407951 (+ 56767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.408115 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.408139 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.408181 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.408232 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.408287 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.408396 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.411324 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.411446 29673 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:56.398319 31082 raft_consensus.cc:740] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:56.351068 31129 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.388581 31133 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.439548 31133 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:10:56.388233 31391 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:10:56.443706 29669 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:56.444456 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1224) took 1557 ms. Trace:
I20260709 13:10:56.444773 29669 rpcz_store.cc:276] 0709 13:10:54.886624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.442931 (+1556307us) service_pool.cc:224] Handling call
0709 13:10:56.443334 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.444209 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.444400 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.446839 31357 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.447902 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1225) took 1561 ms. Trace:
I20260709 13:10:56.448444 31196 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:56.448982 31196 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.414070 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.334585 31201 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.411854 29744 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:56.407825 31293 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:56.432900 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 129258us
I20260709 13:10:56.461001 29638 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.436774 31382 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:56.437314 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.399518 31171 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.293934 31413 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:56.456483 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:56.457757 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 155381us
I20260709 13:10:56.463811 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.418174 29817 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.467682 29817 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.450699 29787 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.448275 29670 rpcz_store.cc:276] 0709 13:10:54.886878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.447113 (+1560235us) service_pool.cc:224] Handling call
0709 13:10:56.447413 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.447597 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.447627 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.447668 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.447698 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.447749 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.447851 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.462397 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1218) took 1694 ms. Trace:
I20260709 13:10:56.469462 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1226) took 1567 ms. Trace:
I20260709 13:10:56.468031 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.471372 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.469696 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.471797 29670 rpcz_store.cc:276] 0709 13:10:54.902541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.468706 (+1566165us) service_pool.cc:224] Handling call
0709 13:10:56.468993 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.469168 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.469192 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.469231 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:56.469256 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.469308 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.469412 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.473338 31255 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.469899 31416 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.475219 29638 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:56.449059 31295 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.475011 31413 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:56.430701 31146 consensus_queue.cc:1059] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:10:56.551278 29715 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:10:56.514328 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.457551 31323 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.579128 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.479200 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:10:56.576053 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 224027us
I20260709 13:10:56.468667 29671 rpcz_store.cc:276] 0709 13:10:54.767563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.307142 (+1539579us) service_pool.cc:224] Handling call
0709 13:10:56.327808 (+ 20666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.327997 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:56.328269 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.462012 (+133743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.462070 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.462111 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.462185 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.462345 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":976,"prepare.queue_time_us":753,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":1139,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5071,"thread_start_us":132293,"threads_started":1,"wal-append.queue_time_us":240081}
I20260709 13:10:56.555163 31279 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:56.481362 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.463984 31137 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.638188 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1220) took 1870 ms. Trace:
I20260709 13:10:56.518432 29638 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:56.530735 31301 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:56.475068 31278 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.576524 31425 raft_consensus.cc:476] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:56.644845 31398 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:56.506817 31419 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.645602 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:56.584126 31382 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:56.646409 31382 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.647974 31211 raft_consensus.cc:3055] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:56.522679 31421 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:56.649175 29815 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:56.649777 31194 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:10:56.649966 31022 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:10:56.639998 31253 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.654507 31331 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.649115 31421 raft_consensus.cc:697] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:56.639679 29820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:56.639637 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:56.645414 31398 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.658766 31398 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.660794 31362 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.661852 31129 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:56.662312 31129 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:56.663074 31129 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.449862 31196 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.664289 31129 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.600288 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.462981 31235 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.147s
I20260709 13:10:56.672405 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:56.629571 31386 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.594084 31295 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:56.610602 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 131) took 2436 ms. Trace:
I20260709 13:10:56.518086 31161 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.127s
I20260709 13:10:56.645325 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:56.684646 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 217825us
I20260709 13:10:56.671329 31392 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.671877 29820 raft_consensus.cc:606] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
W20260709 13:10:56.644119 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 125786us
I20260709 13:10:56.521952 31394 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:56.577363 31354 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:56.622036 31397 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:56.648367 31211 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:56.683589 29673 rpcz_store.cc:276] 0709 13:10:54.174750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.139854 (+1965104us) service_pool.cc:224] Handling call
0709 13:10:56.140224 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.428152 (+287928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.610317 (+182165us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54002a94d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:56.610541 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620035968}
W20260709 13:10:56.641629 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 162524us
I20260709 13:10:56.583547 31281 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:56.688939 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.535234 31082 consensus_queue.cc:260] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.511570 31360 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.163s
I20260709 13:10:56.511339 31357 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.163s
I20260709 13:10:56.694633 29638 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.715394 29638 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.715848 31419 raft_consensus.cc:1064] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:10:56.716320 31419 raft_consensus.cc:1068] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:56.716604 29638 leader_election.cc:400] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5.
I20260709 13:10:56.699142 31397 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:56.716938 29638 leader_election.cc:403] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:56.717510 31416 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.698184 31161 consensus_queue.cc:1243] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:56.686805 31295 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:56.700809 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.701062 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:10:56.705225 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.718530 31358 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:56.699471 31312 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.726648 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:56.568589 31171 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.709290 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.684881 31382 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.712988 31360 raft_consensus.cc:3055] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:56.673693 31146 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:56.697837 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:56.673391 31183 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.724761 29815 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:56.738024 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 158976us
I20260709 13:10:56.734946 31146 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.742311 31146 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.743233 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.743975 29746 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:56.745878 31432 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:56.746070 31211 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.746628 31293 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:56.747417 31211 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.747846 29715 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:56.748893 31293 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.749882 31382 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:56.699260 31422 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:10:56.730285 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.718175 31331 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:56.722684 31362 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5.
I20260709 13:10:56.568415 31201 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.727726 29789 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:56.733896 29671 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:56.750811 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.657115 31421 consensus_queue.cc:237] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.753872 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:56.768110 29744 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:56.754477 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:56.756353 29749 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.769596 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1221) took 2001 ms. Trace:
I20260709 13:10:56.730741 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.730289 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.768447 29743 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:56.774428 29748 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:56.770852 29668 rpcz_store.cc:276] 0709 13:10:54.768255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.427788 (+1659533us) service_pool.cc:224] Handling call
0709 13:10:56.463383 (+ 35595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.463580 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:56.505035 (+ 41455us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.609375 (+104340us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b18002e99c0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d23a 00007fd9e9ac7a2a
0709 13:10:56.769233 (+159858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.769289 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.769333 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.769415 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.769530 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":41254,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":962,"spinlock_wait_cycles":14579584,"thread_start_us":157911,"threads_started":1}
I20260709 13:10:56.705039 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.717466 31397 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.728534 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.783174 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.711360 31163 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:56.789964 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 61507.3us
I20260709 13:10:56.786149 29749 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
W20260709 13:10:56.786265 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 59933.6us
I20260709 13:10:56.787714 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:56.736358 31360 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:56.737026 31082 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.786870 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:56.755546 31382 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:56.741663 31183 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.816804 31183 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.817154 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.820073 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1217) took 2150 ms. Trace:
I20260709 13:10:56.820636 29715 leader_election.cc:400] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:10:56.821501 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.822630 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.823822 31357 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:56.824234 31357 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.824584 31357 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.824900 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.825762 29671 raft_consensus.cc:2410] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:56.705307 31394 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.795902 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:56.757529 31295 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:56.801908 31438 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:10:56.802830 29665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1267) took 1059 ms. Trace:
I20260709 13:10:56.804347 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.805081 31401 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:56.806025 31281 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:56.806356 29672 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:56.912835 29672 pending_rounds.cc:85] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:10:56.807236 31354 raft_consensus.cc:993] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:56.640956 29667 rpcz_store.cc:276] 0709 13:10:54.768026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.408325 (+1640299us) service_pool.cc:224] Handling call
0709 13:10:56.440793 (+ 32468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.440978 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:56.441267 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.637820 (+196553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.637873 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.637936 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.638006 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.638133 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21595,"prepare.queue_time_us":572,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":51760,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3808,"thread_start_us":143737,"threads_started":1,"wal-append.queue_time_us":144032}
I20260709 13:10:56.911985 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.811297 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1228) took 1895 ms. Trace:
I20260709 13:10:56.913762 29670 rpcz_store.cc:276] 0709 13:10:54.916298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.472950 (+1556652us) service_pool.cc:224] Handling call
0709 13:10:56.473241 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.474349 (+  1108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.474377 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.474418 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:56.474451 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.811055 (+336604us) spinlock_profiling.cc:243] Waited 935 us on lock 0x7b54001450d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:56.811101 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.811238 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151168}
I20260709 13:10:56.915123 29670 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:56.915511 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1230) took 1934 ms. Trace:
I20260709 13:10:56.915772 29670 rpcz_store.cc:276] 0709 13:10:54.981336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.914736 (+1933400us) service_pool.cc:224] Handling call
0709 13:10:56.915008 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.915358 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.915474 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.916345 29670 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45236
I20260709 13:10:56.916667 29670 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:56.916869 29670 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:56.814441 31382 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.826438 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:56.827071 29674 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:56.919135 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:56.827481 31392 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:56.828300 31436 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.821450 31267 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.796511 29787 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.829602 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:56.922474 29669 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:56.820478 29666 rpcz_store.cc:276] 0709 13:10:54.669668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.305221 (+1635553us) service_pool.cc:224] Handling call
0709 13:10:56.309123 (+  3902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.342124 (+ 33001us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:56.342391 (+   267us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.695313 (+352922us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.695374 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:56.695416 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.819846 (+124430us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b5400269154. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:56.819890 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.820014 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3699,"prepare.queue_time_us":8256,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":3870,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4222,"spinlock_wait_cycles":75416832,"thread_start_us":344435,"threads_started":1,"wal-append.queue_time_us":240162}
I20260709 13:10:56.832016 31433 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:56.924474 29666 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:56.925173 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1241) took 1868 ms. Trace:
I20260709 13:10:56.925484 29666 rpcz_store.cc:276] 0709 13:10:55.056696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.924022 (+1867326us) service_pool.cc:224] Handling call
0709 13:10:56.924304 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.924915 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.925114 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.836156 29823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1226) took 1456 ms. Trace:
I20260709 13:10:56.735515 31312 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.799624 31397 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.799870 31052 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:56.800038 31293 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.799932 31413 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:56.865733 31177 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:56.827015 31235 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.899152 29715 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:56.963946 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 265571us
I20260709 13:10:56.899719 29743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43661428e7964263870fe7a8e07bf265"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45612
W20260709 13:10:56.964397 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 65363.2us
I20260709 13:10:56.965355 29715 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.785692 31331 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:56.907907 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:56.810585 31306 raft_consensus.cc:993] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:56.913110 29672 pending_rounds.cc:107] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:56.906340 31146 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:56.940734 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.975016 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:56.949183 29673 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:56.899679 31404 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:56.958796 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 162359us
I20260709 13:10:56.907666 31412 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:56.957823 31196 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:56.963524 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:56.900291 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 197291us
I20260709 13:10:56.969085 29672 raft_consensus.cc:2889] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:56.926766 29823 rpcz_store.cc:276] 0709 13:10:55.379466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.306970 (+927504us) service_pool.cc:224] Handling call
0709 13:10:56.307312 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.307719 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:56.575907 (+268188us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.710496 (+134589us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.711389 (+   893us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.711552 (+   163us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:56.711585 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.711654 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.835957 (+124303us) raft_consensus.cc:1685] finished
0709 13:10:56.835978 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.836099 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36724,"prepare.queue_time_us":298974,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2346,"raft.queue_time_us":7770,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":80205,"thread_start_us":314422,"threads_started":2,"wal-append.queue_time_us":157653}
I20260709 13:10:56.950820 31267 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.957906 31194 raft_consensus.cc:1081] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:56.975943 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1256) took 1793 ms. Trace:
I20260709 13:10:56.987561 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:56.988031 29715 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.986249 29673 rpcz_store.cc:276] 0709 13:10:55.182137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.948618 (+1766481us) service_pool.cc:224] Handling call
0709 13:10:56.948985 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.975707 (+ 26722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.975894 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:56.990172 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:56.990804 29740 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:56.968218 31331 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:56.971863 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:56.963948 31177 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:56.909040 29665 rpcz_store.cc:276] 0709 13:10:55.743792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.790783 (+ 46991us) service_pool.cc:224] Handling call
0709 13:10:56.802597 (+1011814us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54001446d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:56.802770 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130218240}
I20260709 13:10:56.913789 29668 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:56.963488 31401 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:56.999095 29819 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:56.969422 31161 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:56.989282 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:57.001458 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:56.999847 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.970353 31022 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:56.964892 31052 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.967412 31323 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:56.966691 31422 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.008723 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:57.047616 29638 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.994406 29823 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:10:56.998400 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 285691us
I20260709 13:10:56.969328 31413 raft_consensus.cc:697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:57.005617 29670 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.054292 29668 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:57.055307 29666 raft_consensus.cc:1240] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:57.056376 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:57.055382 29669 raft_consensus.cc:1240] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 3. Ops: []
I20260709 13:10:57.056941 29668 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.985900 31419 raft_consensus.cc:1081] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:10:57.030557 31455 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:57.032006 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:56.991792 31196 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:56.976964 31293 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:56.998967 31082 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.042907 29672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1212) took 2431 ms. Trace:
I20260709 13:10:57.048766 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:57.090619 29672 rpcz_store.cc:276] 0709 13:10:54.611104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.267934 (+1656830us) service_pool.cc:224] Handling call
0709 13:10:56.806009 (+538075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.986866 (+180857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.042638 (+ 55772us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54001446d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:57.042822 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191160704}
I20260709 13:10:57.007799 31392 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:57.010025 29673 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:57.052583 31227 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:57.058964 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:56.974581 31235 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:57.098214 31235 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.974566 31321 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:57.098609 31394 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.099056 29667 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.099747 31357 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.073323 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:57.079154 31177 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.059520 31360 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:57.103407 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 44538.1us
I20260709 13:10:57.104182 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.104357 31360 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.105300 29638 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:57.106143 31321 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:57.026276 31358 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:57.000684 31267 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.032617 31163 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:56.991900 31404 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:57.057709 29742 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:57.091598 29639 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:57.093073 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:57.093801 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 107558us
I20260709 13:10:57.101797 31357 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.081166 31183 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:10:57.107273 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:57.082513 29670 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.109333 29671 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:57.051188 31382 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:57.055357 31386 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:57.111308 29667 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:57.037657 31022 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.077013 31421 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.113826 29638 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.061604 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:57.079802 31455 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:57.106756 31321 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:57.052199 31323 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:56.999675 31412 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:57.094240 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 86455us
I20260709 13:10:57.128928 29668 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
W20260709 13:10:57.192097 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 100590us
I20260709 13:10:57.120559 31177 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.111883 31137 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:57.102679 29665 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:10:57.193025 31196 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:57.340780 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.090139 31439 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:57.122004 31082 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.198494 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1259) took 2015 ms. Trace:
I20260709 13:10:57.346796 29671 rpcz_store.cc:276] 0709 13:10:55.191413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.094533 (+1903120us) service_pool.cc:224] Handling call
0709 13:10:57.094826 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.198243 (+103417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.198442 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.306197 31455 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:57.198879 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 71153.8us
I20260709 13:10:57.195345 31227 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:57.193454 31364 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:10:57.200920 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45236 (request call id 1232) took 2210 ms. Trace:
I20260709 13:10:57.203820 31382 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.278851 29672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 134) took 2063 ms. Trace:
I20260709 13:10:57.277396 29673 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:10:57.274936 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:57.334095 31211 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:57.098112 31052 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:57.301430 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 269499us
I20260709 13:10:57.334403 31171 consensus_queue.cc:1059] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 13:10:57.308609 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 194837us
I20260709 13:10:57.322032 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:57.396761 29823 raft_consensus.cc:3055] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:57.322705 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:57.207706 31441 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.309615 31235 raft_consensus.cc:2764] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 13:10:57.326956 31445 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:10:57.327885 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:57.406170 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:57.406780 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:57.329953 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1240) took 2312 ms. Trace:
I20260709 13:10:57.335752 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 135) took 2114 ms. Trace:
I20260709 13:10:57.271394 31331 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:57.207628 31312 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:10:57.420075 31437 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.339s	user 0.000s	sys 0.007s
I20260709 13:10:57.095559 29818 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:57.391566 31430 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.585s	user 0.006s	sys 0.002s
I20260709 13:10:57.308120 31321 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.422271 31321 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:57.423033 31447 log.cc:927] Time spent T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:10:57.093396 31293 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.427587 31293 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.428124 31293 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.428565 31293 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:57.431079 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1227) took 1902 ms. Trace:
I20260709 13:10:57.431528 29814 rpcz_store.cc:276] 0709 13:10:55.528452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.330924 (+802472us) service_pool.cc:224] Handling call
0709 13:10:56.359049 (+ 28125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.418711 (+ 59662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.425749 (+  7038us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.438528 (+ 12779us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.448151 (+  9623us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b4800220158. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ee9e6aa1 00007fd9ee9ddb37 00007fd9ee9dd9ca 00007fd9eead526f 00007fd9eead4f37 00007fd9eeae955c 00007fd9eeae9508 00007fd9eeae9488 00007fd9eeae9443 00007fd9eeae86ec 00007fd9eda12a96
0709 13:10:56.689947 (+241796us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:56.691593 (+  1646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.699948 (+  8355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.390814 (+690866us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:57.429996 (+ 39182us) raft_consensus.cc:1685] finished
0709 13:10:57.430024 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.430871 (+   847us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b5400055ad0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:57.431009 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45977,"raft.queue_time_us":58149,"raft.run_cpu_time_us":1780,"raft.run_wall_time_us":22950,"spinlock_wait_cycles":143766272,"thread_start_us":235827,"threads_started":1,"wal-append.queue_time_us":367353}
I20260709 13:10:57.193886 31413 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.361943 29670 rpcz_store.cc:276] 0709 13:10:54.987570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.916261 (+1928691us) service_pool.cc:224] Handling call
0709 13:10:57.198174 (+281913us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.195464 31163 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:57.323582 31436 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:57.364574 29672 rpcz_store.cc:276] 0709 13:10:55.215088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.201333 (+1986245us) service_pool.cc:224] Handling call
0709 13:10:57.278355 (+ 77022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.278529 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.278564 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.278603 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:57.278629 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.278684 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.278794 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.270129 31358 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:57.348023 31146 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.358453 31227 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.060732 31422 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.391515 31022 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.392002 31211 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:57.370627 31449 log.cc:927] Time spent T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:10:57.396978 29823 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:57.412119 31357 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:57.369329 31183 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.400679 29743 raft_consensus.cc:606] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:10:57.486691 29743 raft_consensus.cc:614] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:57.407760 29669 rpcz_store.cc:276] 0709 13:10:55.017365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.923260 (+1905895us) service_pool.cc:224] Handling call
0709 13:10:56.923580 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.058296 (+134716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.329632 (+271336us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400182c54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:10:57.329862 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302763392}
I20260709 13:10:57.408711 29668 rpcz_store.cc:276] 0709 13:10:55.221051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.335181 (+2114130us) service_pool.cc:224] Handling call
0709 13:10:57.335415 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.335544 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.335560 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.335587 (+    27us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:57.335604 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.335635 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.335710 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.488009 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:57.488621 29669 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.414646 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:57.416203 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.394682 31444 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.436718 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:57.347393 31419 consensus_queue.cc:1059] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:10:57.370230 31363 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:57.443207 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:57.413187 29815 raft_consensus.cc:2410] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:10:57.522837 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.443066 29640 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.412590 31082 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.408275 31161 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:57.396912 29638 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:57.463956 29823 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:57.476162 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 120567us
I20260709 13:10:57.448400 31227 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.361019 31439 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:57.532020 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 135204us
I20260709 13:10:57.490778 29674 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.521715 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:57.520264 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1245) took 2392 ms. Trace:
I20260709 13:10:57.533253 29666 rpcz_store.cc:276] 0709 13:10:55.127530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.926247 (+1798717us) service_pool.cc:224] Handling call
0709 13:10:57.055141 (+128894us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.072137 (+ 16996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.520059 (+447922us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001464d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:57.520204 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295745920}
W20260709 13:10:57.524781 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 81814.4us
I20260709 13:10:57.540593 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:57.540906 29668 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:10:57.541275 29744 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.541576 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1273) took 1210 ms. Trace:
I20260709 13:10:57.541968 29668 rpcz_store.cc:276] 0709 13:10:56.331030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.540377 (+1209347us) service_pool.cc:224] Handling call
0709 13:10:57.540693 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.541314 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.541525 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.442813 31279 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:10:57.547825 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:57.548139 29669 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:57.548454 29745 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.545853 29670 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:57.550254 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1276) took 1218 ms. Trace:
I20260709 13:10:57.550309 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1277) took 1218 ms. Trace:
I20260709 13:10:57.550654 29670 rpcz_store.cc:276] 0709 13:10:56.331769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.545334 (+1213565us) service_pool.cc:224] Handling call
0709 13:10:57.545632 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.550027 (+  4395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.550206 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.550843 29669 rpcz_store.cc:276] 0709 13:10:56.332019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.549456 (+1217437us) service_pool.cc:224] Handling call
0709 13:10:57.549854 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.550044 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.550070 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.550109 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:57.550134 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.550180 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.550265 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.552183 29670 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:57.553448 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.553588 29670 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:57.522449 29667 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.555044 29670 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:57.560189 29667 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:57.560752 29670 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:57.561388 29669 raft_consensus.cc:1240] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:10:57.487516 31022 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.567530 29744 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:57.547529 29665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 136) took 2250 ms. Trace:
I20260709 13:10:57.442654 31436 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.464339 31267 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.576397 29667 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:57.492110 31357 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.449151 31358 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:57.445813 31163 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:57.540117 31253 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:57.531080 31146 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.451296 31295 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.592180 29745 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:57.413473 31441 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:57.599108 31211 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.599275 31439 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.578514 29818 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:57.600667 31463 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:57.585045 31137 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.588610 31293 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:57.521466 31183 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.586324 31022 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.603101 31412 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:57.603804 31382 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.597515 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.668031 29744 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:57.669224 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.669888 29744 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:57.671157 29744 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:57.605719 29674 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
W20260709 13:10:57.596601 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 178925us
I20260709 13:10:57.673399 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:57.674628 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.676841 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:57.678158 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:57.678893 29817 raft_consensus.cc:2393] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:57.681263 29715 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.643229 31331 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.648123 31471 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:57.646616 31456 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.491067 31235 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.525753 31404 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:57.577440 31394 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:57.632679 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:10:57.547708 31161 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.662112 31137 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.597043 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.634410 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.724399 29748 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:57.604362 31323 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.639356 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.729440 29745 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:57.539765 31363 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:57.641288 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 118404us
I20260709 13:10:57.686702 31471 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.594518 31426 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:10:57.660737 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 169970us
I20260709 13:10:57.699110 29715 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:57.683333 31382 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.688691 31293 raft_consensus.cc:2764] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:57.548449 31082 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.692689 31454 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:57.727123 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 94527us
I20260709 13:10:57.562404 31444 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:57.765131 31462 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:10:57.763810 29787 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:57.734632 29816 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51156 (request call id 1230) took 2058 ms (client timeout 1802 ms). Trace:
W20260709 13:10:57.766252 29816 rpcz_store.cc:269] 0709 13:10:55.676443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.710357 (+ 33914us) service_pool.cc:224] Handling call
0709 13:10:57.734392 (+2024035us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b5400325854. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:57.734554 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4156246912}
I20260709 13:10:57.735908 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.767485 29748 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:10:57.713936 31321 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.714134 31394 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:57.714520 31433 consensus_meta.cc:287] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.000s
W20260709 13:10:57.737596 31461 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:10:57.737720 31183 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.738276 31422 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.738451 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:57.741220 31464 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:57.713757 31404 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.689348 31331 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.734434 31194 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.769281 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:57.778293 31467 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:10:57.712014 31235 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:57.763398 31382 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.777796 31293 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:57.784718 31467 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:57.787813 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 244008us
I20260709 13:10:57.788754 31429 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:57.789131 31429 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:57.789469 31429 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.790175 31440 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:57.693372 31456 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.805276 31444 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:57.802757 31441 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:57.805684 31321 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.809649 31357 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.809864 31137 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.810664 31161 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.810847 31468 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.788322 31467 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:57.797076 31194 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:57.816573 31331 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.817632 31227 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.818245 31429 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:57.822178 31360 consensus_meta.cc:287] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.717s	user 0.003s	sys 0.008s
I20260709 13:10:57.822584 31436 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.787322 31404 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.823032 31455 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:57.841310 31472 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:10:57.842092 31475 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:10:57.845413 31467 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.850685 31467 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.736708 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:57.655408 29638 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:57.878659 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 223151us
I20260709 13:10:57.879855 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:57.606936 29665 rpcz_store.cc:276] 0709 13:10:55.289513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.365978 (+2076465us) service_pool.cc:224] Handling call
0709 13:10:57.439231 (+ 73253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.450814 (+ 11583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.454475 (+  3661us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.464290 (+  9815us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:57.470113 (+  5823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.492329 (+ 22216us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.539488 (+ 47159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.880357 29638 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.884061 29665 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45236
I20260709 13:10:57.884994 29665 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.886657 29638 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.767562 29741 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:57.891003 29638 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.881551 29672 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
W20260709 13:10:57.888636 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 189489us
I20260709 13:10:57.896436 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.898729 29672 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:57.906486 29672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45236
I20260709 13:10:57.911525 29672 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:57.912138 29672 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.912717 31082 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.913781 31137 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.914759 31137 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.900887 29638 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:57.916759 29638 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:57.915243 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:57.918118 31137 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.918671 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:57.919113 31183 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:57.920388 31163 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:57.921329 31194 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:57.923863 31235 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.925515 31331 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:57.925341 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.806398 31295 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.927101 31321 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:57.885682 29665 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:57.842896 31397 consensus_meta.cc:287] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.885s	user 0.012s	sys 0.000s
I20260709 13:10:57.916661 31022 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.823073 31358 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:10:57.985646 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 67373.8us
I20260709 13:10:57.967303 30344 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:57.972008 31394 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.976812 29741 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:10:57.978286 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:57.978612 31456 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.969250 31321 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:57.990466 31436 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:57.990887 31321 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.991500 31440 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:57.980225 31183 raft_consensus.cc:697] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:57.980826 31331 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:57.981088 31455 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:57.987957 29667 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:57.995313 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 99091.5us
I20260709 13:10:57.979655 31137 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:57.971096 31382 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:57.995312 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 78836.3us
I20260709 13:10:57.928725 31323 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:10:57.978672 31444 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:58.016634 31444 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.017050 31444 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:58.020900 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.003111 31137 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.021104 31404 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:58.027994 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 241988us
I20260709 13:10:58.032637 31429 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.034616 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1251) took 1069 ms. Trace:
I20260709 13:10:58.035142 29669 rpcz_store.cc:276] 0709 13:10:56.965332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.552188 (+586856us) service_pool.cc:224] Handling call
0709 13:10:57.561165 (+  8977us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.561762 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.034126 (+472364us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b5400214650. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:58.034426 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19932544}
I20260709 13:10:58.036800 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.037387 31331 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.042125 30316 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:58.034832 31422 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.044409 31422 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.004354 31022 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.062323 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.013830 31436 raft_consensus.cc:697] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:58.055068 31487 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.024271 31137 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.061990 29787 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:58.070602 29672 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:58.075784 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46679.7us
I20260709 13:10:58.086025 31052 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:58.086522 29748 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.088107 31477 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.089042 31477 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.091320 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:58.093374 30348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49712 (request call id 197) took 1041 ms. Trace:
I20260709 13:10:58.095374 29640 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.095649 31436 consensus_queue.cc:237] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.096464 31404 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:58.096882 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.096908 31404 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.098002 31404 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.085981 31397 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:10:58.106797 31227 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.093626 31422 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.109205 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:58.084650 31022 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.098217 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:58.118117 31022 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.119177 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.119800 31363 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:58.123315 31177 consensus_meta.cc:287] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.785s	user 0.012s	sys 0.007s
I20260709 13:10:58.093734 30348 rpcz_store.cc:276] 0709 13:10:57.051510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.051736 (+   226us) service_pool.cc:224] Handling call
0709 13:10:58.089657 (+1037921us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:10:58.093291 (+  3634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8680320}
I20260709 13:10:58.042251 31183 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.138280 31477 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.141212 31397 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:58.139344 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.142771 29672 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.143451 31397 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:58.153102 31397 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.157627 31455 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:58.158437 31455 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:58.159791 31455 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:10:58.160175 31321 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.166154 31453 raft_consensus.cc:3055] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:58.166697 31453 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.167385 29715 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:10:58.173339 29744 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:58.171736 29747 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:58.175110 29742 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:58.179924 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.181401 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.175472 29638 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:58.170786 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.170260 31382 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:58.242090 31022 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.241887 31494 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:10:58.246417 31052 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:58.246766 31022 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.258672 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.259785 29672 raft_consensus.cc:2393] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 2: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:58.260653 31022 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.272779 31022 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.273743 31471 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:58.275107 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 129603us
I20260709 13:10:58.169503 31456 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
W20260709 13:10:58.279687 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.209514 31082 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:10:58.279580 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:58.251014 31052 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:10:58.280565 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 102022us
I20260709 13:10:58.265879 31382 raft_consensus.cc:697] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:58.277266 29665 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.168064 31453 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.291702 31052 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:58.292764 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:58.293339 29745 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:58.292783 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.299857 31463 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.301673 29665 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:58.302106 31493 log.cc:927] Time spent T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.141s	user 0.001s	sys 0.001s
I20260709 13:10:58.302997 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:58.304450 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.306510 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.311681 31321 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.312139 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.314600 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1272) took 1983 ms. Trace:
I20260709 13:10:58.286814 31177 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:58.277892 31401 raft_consensus.cc:1064] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:10:58.317756 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.324476 29744 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:58.324998 31177 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:58.325766 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.327333 31177 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:58.327579 29747 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:58.328083 29744 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:58.331313 31022 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.331789 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 1249) took 3049 ms. Trace:
I20260709 13:10:58.331992 31022 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.292549 31453 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.350591 29748 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:10:58.341177 31331 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.301589 31354 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:58.341566 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:58.365897 29747 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:58.366139 29672 raft_consensus.cc:2393] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:58.342257 31279 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:58.342846 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.332181 29671 rpcz_store.cc:276] 0709 13:10:55.282081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.347778 (+2065697us) service_pool.cc:224] Handling call
0709 13:10:57.348072 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.348262 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:57.577336 (+229074us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.330982 (+753646us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18000c6760. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e96654bc 00007fd9e69b348b 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d23a
0709 13:10:58.331244 (+   262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:58.331328 (+    84us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:58.331394 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.331491 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.331640 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":285781,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":4327680,"thread_start_us":266127,"threads_started":2,"wal-append.queue_time_us":131267}
I20260709 13:10:58.345324 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.353662 29746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 132) took 1301 ms. Trace:
I20260709 13:10:58.357384 31255 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.364526 29742 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:10:58.368309 31137 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:58.382422 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 207084us
W20260709 13:10:58.338213 31401 raft_consensus.cc:1068] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:10:58.388005 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 95027us
I20260709 13:10:58.315099 29666 rpcz_store.cc:276] 0709 13:10:56.330777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.534311 (+1203534us) service_pool.cc:224] Handling call
0709 13:10:57.534698 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.535061 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.535092 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.535611 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.075436 (+539825us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:58.075979 (+   543us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.076416 (+   437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.083500 (+  7084us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.314170 (+230670us) raft_consensus.cc:1685] finished
0709 13:10:58.314202 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.314376 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":644,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":3742,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":18021,"spinlock_wait_cycles":9910144,"thread_start_us":431129,"threads_started":1,"wal-append.queue_time_us":531342}
I20260709 13:10:58.365296 31354 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.403669 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.405793 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:58.406972 31363 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:58.407578 31363 raft_consensus.cc:697] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:58.408569 31363 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:10:58.410670 31498 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:10:58.412369 31354 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.413890 31331 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.416384 31331 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.413641 31354 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.391412 31382 consensus_queue.cc:237] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.399849 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.436487 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.438726 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:58.440019 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.440435 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.442255 29741 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:58.446560 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.446449 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.447022 31137 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.447958 31401 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:58.446798 31494 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:58.448999 31494 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:58.425623 31404 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:58.448333 29671 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:58.441900 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.453603 29672 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:58.455083 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.441843 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:58.424305 31177 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.432543 31022 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.466282 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.467149 29742 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:58.468636 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.473839 29748 raft_consensus.cc:2410] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:58.475730 31474 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.478255 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:58.480350 31196 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.477826 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.484845 29672 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:58.458027 31177 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.487870 29822 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:58.489894 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:58.495227 29787 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:58.498401 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.472888 31401 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.499429 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.500985 29740 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:58.501536 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.473112 31444 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:58.507642 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.515363 31201 raft_consensus.cc:3055] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:58.515844 31201 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.516924 31201 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.518548 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.496407 31052 consensus_queue.cc:1059] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:10:58.502354 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:58.513074 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.523387 31412 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:58.526379 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:58.510708 31474 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.529394 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.523391 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:58.536545 29669 raft_consensus.cc:1240] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:58.537779 29667 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:58.536161 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.543607 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.546761 29822 raft_consensus.cc:2410] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:10:58.538712 31194 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.549275 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:58.548264 29742 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:58.552228 29671 raft_consensus.cc:2410] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:58.553416 29672 raft_consensus.cc:2410] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:58.554279 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:58.548802 31412 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.544343 31494 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:58.548178 31201 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.558360 31456 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.560046 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.560046 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.560523 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.562968 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.559652 31386 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.562738 31255 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.567209 31456 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.571995 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.573580 29819 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:10:58.565331 31281 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:10:58.574204 29815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 703) took 1742 ms (client timeout 1733 ms). Trace:
I20260709 13:10:58.574900 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.567950 31255 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.576145 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.577090 29819 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:58.576202 31456 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.576987 31444 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:58.578013 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.565565 31386 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.579339 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.579352 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:10:58.574707 29815 rpcz_store.cc:269] 0709 13:10:56.831257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.918843 (+ 87586us) service_pool.cc:224] Handling call
0709 13:10:58.573756 (+1654913us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540019d2d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:58.574023 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998924672}
I20260709 13:10:58.579586 31279 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.580667 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.580958 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.581019 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.582093 29742 raft_consensus.cc:2410] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:58.562594 31404 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:58.589743 31401 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:58.590446 31412 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:58.590904 31306 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:58.591327 31306 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.593320 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45612 (request call id 2) took 1755 ms. Trace:
I20260709 13:10:58.593694 29743 rpcz_store.cc:276] 0709 13:10:56.838197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.899586 (+ 61389us) service_pool.cc:224] Handling call
0709 13:10:58.592914 (+1693328us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003ff554. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ab7853 00007fd9eea8560a 00007fd9e800b7d4 00007fd9e800b762 00007fd9e800b691 00007fd9e800b60c 00007fd9e800a8c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:58.593103 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001947520}
I20260709 13:10:58.597105 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:58.567121 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:10:58.598930 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.606660 29819 raft_consensus.cc:2410] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:10:58.580957 31386 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.587222 31279 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:58.592316 31306 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.611167 31487 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:58.616729 31487 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:58.620755 29822 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.622299 29714 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:58.622363 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.622468 31487 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.623690 29714 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:58.624303 29819 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:58.624651 29819 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.622735 29638 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.609398 30343 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.625681 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.618315 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.629510 31456 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:58.627084 31082 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.610714 31453 consensus_queue.cc:1059] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:10:58.654193 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:58.660048 31482 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.882s	user 0.004s	sys 0.002s
I20260709 13:10:58.661978 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 138) took 1670 ms. Trace:
W20260709 13:10:58.663412 29674 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 1255) took 1695 ms (client timeout 1704 ms). Trace:
W20260709 13:10:58.663818 29674 rpcz_store.cc:269] 0709 13:10:56.967577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.974779 (+  7202us) service_pool.cc:224] Handling call
0709 13:10:58.663084 (+1688305us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54001455d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:58.663246 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1183871360}
I20260709 13:10:58.664484 29668 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:10:58.665156 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:58.665421 31507 log.cc:927] Time spent T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:10:58.666764 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1275) took 2335 ms. Trace:
I20260709 13:10:58.667164 29668 rpcz_store.cc:276] 0709 13:10:56.331510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.542744 (+1211234us) service_pool.cc:224] Handling call
0709 13:10:58.664084 (+1121340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.664937 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.666568 (+  1631us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54001455d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:10:58.666708 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577931136}
I20260709 13:10:58.668473 31082 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.662365 29670 rpcz_store.cc:276] 0709 13:10:56.991424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.561472 (+570048us) service_pool.cc:224] Handling call
0709 13:10:57.561805 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.641704 (+ 79899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.641735 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.642823 (+  1088us) log.cc:844] Serialized 26 byte log entry
0709 13:10:57.688237 (+ 45414us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:57.688536 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 13:10:57.688760 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.688829 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.181510 (+492681us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:58.659619 (+478109us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b2400129bd8. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68569c4 00007fd9e6854acb 00007fd9e6a0fdc9 00007fd9e6a0fa55 00007fd9e6a0f09d 00007fd9e964110e 00007fd9e965888c 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221
0709 13:10:58.661522 (+  1903us) raft_consensus.cc:1685] finished
0709 13:10:58.661542 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.661745 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11957,"prepare.queue_time_us":4840,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":36852,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":8950,"spinlock_wait_cycles":34269824,"thread_start_us":120898,"threads_started":2,"wal-append.queue_time_us":134224}
I20260709 13:10:58.642402 31306 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.640677 31386 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.654460 29714 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:58.680295 29822 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:10:58.655568 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.646193 29819 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.684957 29667 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:58.689796 29667 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:58.695698 31146 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:58.695592 31453 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:58.696254 31146 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.696698 29787 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:58.697016 31471 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:58.697450 31471 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.697834 31471 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.698237 31082 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:58.695598 31510 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:10:58.699971 31453 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:58.700390 31194 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:58.701053 31194 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.702196 31194 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.696501 31293 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:58.711844 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 57461.5us
W20260709 13:10:58.718113 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 69774.6us
I20260709 13:10:58.718628 29670 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:58.719962 29670 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:58.696653 31146 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:58.732939 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.734333 31386 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.734843 31386 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.735419 29749 raft_consensus.cc:1240] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:58.736967 31386 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:58.739198 31508 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
I20260709 13:10:58.741221 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 137) took 2506 ms. Trace:
I20260709 13:10:58.705447 30347 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:58.742684 29743 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:58.742820 31177 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.692698 31196 raft_consensus.cc:3055] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:58.743667 31196 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.744702 31196 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.745213 29749 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:58.748672 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.749697 29743 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:10:58.751194 31474 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:58.751535 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.751842 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:58.752645 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 45749.6us
I20260709 13:10:58.741608 29673 rpcz_store.cc:276] 0709 13:10:56.234388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.304949 (+2070561us) service_pool.cc:224] Handling call
0709 13:10:58.305583 (+   634us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:58.332830 (+ 27247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.332869 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:58.341325 (+  8456us) log.cc:844] Serialized 590 byte log entry
0709 13:10:58.392034 (+ 50709us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:58.392075 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.392142 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.738386 (+346244us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:58.740815 (+  2429us) raft_consensus.cc:1685] finished
0709 13:10:58.740835 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.741066 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26474,"raft.queue_time_us":28208,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":140,"spinlock_wait_cycles":23646976,"thread_start_us":50233,"threads_started":1,"wal-append.queue_time_us":112594}
I20260709 13:10:58.753571 29715 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.754372 31386 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:58.754801 31386 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.755256 31386 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.755609 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.755888 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.756585 31293 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:58.764828 31293 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.765300 31293 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.766384 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.767875 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.768568 29742 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.764848 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.756668 29714 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:58.745769 31196 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.759946 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:10:58.772954 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.778350 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.784263 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.793292 29669 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:58.803004 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:58.804653 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.813410 29667 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:58.813761 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.803542 29673 raft_consensus.cc:2376] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4. Re-sending same reply.
I20260709 13:10:58.817072 29740 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:58.751837 31146 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.822427 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.824379 29667 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:58.805147 31397 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:58.805125 31382 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.831466 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.817101 31456 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:58.836488 29669 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:58.838804 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.842945 29666 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:58.826470 29671 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:10:58.845206 29667 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:58.370319 29746 rpcz_store.cc:276] 0709 13:10:57.052521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.053618 (+  1097us) service_pool.cc:224] Handling call
0709 13:10:57.084266 (+ 30648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.084458 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:57.382692 (+298234us) log.cc:844] Serialized 14 byte log entry
0709 13:10:58.352763 (+970071us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b180038eae0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e96654bc 00007fd9e69b348b 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d23a
0709 13:10:58.353071 (+   308us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:58.353154 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:58.353238 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.353313 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:58.353470 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":366431,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":5770,"raft.queue_time_us":12279,"spinlock_wait_cycles":55276416,"thread_start_us":411922,"threads_started":2,"wal-append.queue_time_us":257921}
I20260709 13:10:58.847892 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:58.854195 31432 consensus_queue.cc:1059] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:10:58.855365 31432 raft_consensus.cc:3055] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:58.855751 31432 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:58.853488 29670 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:58.859839 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.856765 31432 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:58.866947 31432 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.871495 30343 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:10:58.872066 31440 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.872514 31440 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:58.874049 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 77042.4us
I20260709 13:10:58.874590 29742 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:10:58.823768 31471 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.879172 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.880509 29746 raft_consensus.cc:2393] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:58.881397 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.882550 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.883118 29746 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:58.883948 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.884613 29746 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:58.837586 31279 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.892818 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.846416 31382 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.900429 31382 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:58.900734 31504 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.555s	user 0.002s	sys 0.000s
I20260709 13:10:58.903581 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.904124 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.904940 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.905220 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:58.905529 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:58.909222 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:58.881685 31500 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.538s	user 0.000s	sys 0.004s
I20260709 13:10:58.892601 31467 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:58.931244 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.932052 29741 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:58.932837 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.933552 29746 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.932971 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:58.945470 29746 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:10:58.948230 29715 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.947605 31436 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:58.949805 31306 consensus_queue.cc:1059] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:58.950743 31306 consensus_queue.cc:1243] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:58.950982 31456 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:58.951360 31306 raft_consensus.cc:3055] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:58.952814 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:58.927126 31467 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:58.953606 29742 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.952507 29715 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.959121 29787 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:10:58.961737 29715 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.951725 31306 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:58.967746 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:58.971596 29745 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:10:58.950508 31436 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:58.975114 31456 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.975549 31456 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:58.975898 31456 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.976435 31436 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:58.977005 31436 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.977332 31436 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.977635 31436 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.980180 31323 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.980778 31323 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.981063 31407 consensus_queue.cc:1059] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:10:58.982213 31306 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:58.984043 31267 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:58.984539 31267 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.984865 31267 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.988456 31455 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:58.988935 31455 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.989269 31455 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.963997 31196 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:59.000890 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:59.060289 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 59439.9us
I20260709 13:10:59.071085 29638 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.055912 31306 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.055722 31196 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:59.076819 31323 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.077562 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:59.078711 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.082589 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.064714 31474 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:59.068497 31382 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.077768 31321 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:59.089943 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 123149us
I20260709 13:10:59.080011 31196 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.068279 31201 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:10:59.085785 31323 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:59.086522 31474 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.091773 31397 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.109787 31397 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.066521 31293 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.103330 31321 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:59.134907 29742 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:59.140954 29743 raft_consensus.cc:2393] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:59.102252 31471 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.142737 31321 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.148869 31255 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.130400 31474 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:59.117009 31323 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.157858 31323 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.141839 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:59.192922 31293 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.114375 31382 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.195698 31382 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.100332 31467 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.197314 31267 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:10:59.199046 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 47014.8us
I20260709 13:10:59.200261 29740 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:59.103178 31279 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:59.209772 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 130001us
I20260709 13:10:59.212266 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:59.188071 31436 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.212625 30314 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.221412 29715 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:59.206317 31397 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.218935 31432 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.223592 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:10:59.216324 31293 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.245040 31436 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.246063 31529 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:59.230594 31526 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:10:59.231961 29715 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.258131 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:59.228006 31474 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.235818 31398 raft_consensus.cc:3055] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:59.233248 31255 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:59.237095 31267 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.242409 29744 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:59.258996 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 181213us
I20260709 13:10:59.258859 29669 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.264036 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:59.266523 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:59.260141 29640 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.246465 31279 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.263142 31436 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:59.291390 31436 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.291826 31436 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.292202 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:59.293133 29665 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:10:59.246301 31456 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.295902 31456 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.296387 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 80) took 7915 ms. Trace:
I20260709 13:10:59.299314 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:59.300029 29670 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:59.303536 31397 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.304165 31397 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.305547 31146 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:10:59.281440 31515 log.cc:927] Time spent T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.485s	user 0.003s	sys 0.000s
W20260709 13:10:59.281596 31386 consensus_meta.cc:287] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260709 13:10:59.334648 31386 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.336208 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:10:59.337643 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.339847 31082 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.296741 29570 rpcz_store.cc:276] 0709 13:10:51.395837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:51.484771 (+ 88934us) service_pool.cc:224] Handling call
0709 13:10:59.296165 (+7811394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:55.821196 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:55.870991 (+ 49795us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:55.871034 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:10:55.871048 (+    14us) tablet.cc:662] Decoding operations
0709 13:10:55.871463 (+   415us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:55.871528 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:55.871557 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:55.871903 (+   346us) tablet.cc:701] Row locks acquired
0709 13:10:55.871924 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:10:55.872085 (+   161us) write_op.cc:270] Start()
0709 13:10:55.872204 (+   119us) write_op.cc:276] Timestamp: P: 1783602655872031 usec, L: 0
0709 13:10:55.872225 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:10:55.946416 (+ 74191us) log.cc:844] Serialized 918 byte log entry
0709 13:10:56.221565 (+275149us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:10:56.548309 (+326744us) op_driver.cc:464] REPLICATION: finished
0709 13:10:56.785692 (+237383us) write_op.cc:301] APPLY: starting
0709 13:10:56.797433 (+ 11741us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:56.827562 (+ 30129us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:56.827604 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:56.827949 (+   345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:56.828093 (+   144us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:10:56.828141 (+    48us) write_op.cc:312] APPLY: finished
0709 13:10:56.828325 (+   184us) log.cc:844] Serialized 28 byte log entry
0709 13:10:56.828482 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:56.828564 (+    82us) write_op.cc:454] Released schema lock
0709 13:10:56.828618 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:56.828939 (+   321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:56.828965 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128313,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":214820,"apply.run_cpu_time_us":1764,"apply.run_wall_time_us":55285,"num_ops":2,"prepare.queue_time_us":135499,"prepare.run_cpu_time_us":7706,"prepare.run_wall_time_us":228529,"raft.queue_time_us":215321,"raft.run_cpu_time_us":28403,"raft.run_wall_time_us":188612,"replication_time_us":663975,"spinlock_wait_cycles":20395264,"thread_start_us":468277,"threads_started":4,"wal-append.queue_time_us":199908,"wal-append.run_cpu_time_us":17883,"wal-append.run_wall_time_us":1680814}]]}
W20260709 13:10:59.284134 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.334712 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.342626 29821 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:59.283912 31440 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:59.286546 29819 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.346081 29669 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:59.289489 29744 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:59.262880 31398 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:59.290494 31279 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.306370 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:59.307166 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.311939 31196 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:59.371116 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.372296 29814 raft_consensus.cc:2393] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:10:59.312538 31530 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:59.313776 31201 consensus_queue.cc:1243] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:59.373175 31530 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.255811 31455 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.374060 31468 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:59.374478 31468 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:59.274814 31255 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.375681 29740 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:59.375386 31468 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.377159 31468 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.316983 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:59.377887 29666 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.347968 31404 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:59.318977 29816 raft_consensus.cc:3055] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:59.382122 29816 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:59.382936 29816 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:59.383858 29816 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.386317 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.387632 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.388104 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:10:59.388322 31201 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:59.388718 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.321760 31397 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.326376 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:59.389695 29667 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:10:59.390765 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:10:59.391258 29671 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:59.392176 31279 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.393240 31255 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.393724 29671 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:59.394529 29748 raft_consensus.cc:1240] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 3. Ops: []
I20260709 13:10:59.395732 29744 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:59.327611 29674 raft_consensus.cc:1275] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:59.329578 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.279443 31323 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.403524 31323 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.330382 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:59.333148 31502 log.cc:927] Time spent T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.879s	user 0.000s	sys 0.003s
I20260709 13:10:59.406206 31530 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:59.371075 31196 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:59.386358 31398 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.408831 31398 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:59.382138 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.417272 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.342928 29821 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:59.288287 31474 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.349630 29823 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.413661 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.353048 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.355840 29670 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:10:59.430751 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:10:59.431735 29669 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:59.362609 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.389104 31505 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:59.435591 31505 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:10:59.391345 29667 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:10:59.420887 29666 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:10:59.435783 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:10:59.344481 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 84427.4us
I20260709 13:10:59.437311 29671 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.437580 29640 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:10:59.363304 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 92461.5us
W20260709 13:10:59.432260 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 81310.3us
I20260709 13:10:59.439455 29715 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.440411 29638 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.445454 29819 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:59.447196 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1272) took 1137 ms. Trace:
I20260709 13:10:59.436038 31505 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.457348 31440 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:59.458752 31455 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.459594 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.460798 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.461163 31323 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.461351 29815 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:10:59.463132 31321 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.463120 29821 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.464085 29821 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.464315 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.464759 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:10:59.465758 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.466207 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.470373 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.448372 29819 rpcz_store.cc:276] 0709 13:10:58.315596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.623794 (+308198us) service_pool.cc:224] Handling call
0709 13:10:58.624075 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.898643 (+274568us) spinlock_profiling.cc:243] Waited 81.4 ms on lock 0x7b180008c460. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9af8646 00007fd9e9a3258e 00007fd9e9ab3f9e 00007fd9e9ab57de 00007fd9e9abfb49 00007fd9e9ac0416 00007fd9e9abcd8f 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4
0709 13:10:59.152261 (+253618us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b58003e3fd0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a190aa 00007fd9e9a9b447 00007fd9e9ab3fe7 00007fd9e9ab57de 00007fd9e9abfb49 00007fd9e9ac0416 00007fd9e9abcd8f 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4
0709 13:10:59.286317 (+134056us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b58003e42d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a190aa 00007fd9e9a9b447 00007fd9e9ab3fe7 00007fd9e9ab57de 00007fd9e9abfb49 00007fd9e9ac0416 00007fd9e9abcd8f 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4
0709 13:10:59.446874 (+160557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.447127 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1072445568}
I20260709 13:10:59.472268 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.473369 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.474193 29638 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.474941 29815 raft_consensus.cc:2410] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:59.478132 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.478374 29816 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:59.500875 29817 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:10:59.475322 29638 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.507692 29669 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
W20260709 13:10:59.510210 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 93027.6us
I20260709 13:10:59.512977 29671 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:10:59.465425 31529 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:59.501295 29817 pending_rounds.cc:85] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 1
I20260709 13:10:59.514304 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:59.519570 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.522754 29744 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.517498 29639 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.520498 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:10:59.510792 31267 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:10:59.524051 29639 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.508381 31443 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:59.525038 31211 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.525427 29639 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.525987 31201 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.526499 31201 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.528491 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:10:59.530107 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.530351 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.531654 30347 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Advancing to term 5
I20260709 13:10:59.535243 31436 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.536088 31267 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.536619 31267 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.518473 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.475863 31382 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:59.562389 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:59.511093 31279 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:59.502571 31404 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:59.565158 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:59.565749 29823 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:59.522253 29817 pending_rounds.cc:107] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:10:59.495569 31468 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:59.568588 29817 raft_consensus.cc:2889] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:59.569357 29816 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.584336 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:59.525789 31443 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:59.517936 31474 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:10:59.496670 31082 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:10:59.543028 31146 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:59.521266 31255 raft_consensus.cc:2764] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:10:59.590946 29749 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.622026 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.592308 29745 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:10:59.622861 29819 raft_consensus.cc:2410] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:10:59.593596 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.557132 31436 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.557299 31382 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.542138 31444 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.615869 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:10:59.515379 31528 consensus_queue.cc:1048] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
W20260709 13:10:59.616936 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 91604.8us
I20260709 13:10:59.593116 31386 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.614493 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:59.569721 31404 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.621614 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:59.631393 29748 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:59.571092 31529 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:10:59.584510 31487 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:10:59.588212 31211 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.624987 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:59.629814 29639 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.567699 31451 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:59.589397 31530 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:10:59.571671 31323 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.660035 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:10:59.632833 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:59.619807 31474 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.641686 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.588450 31279 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:59.621745 31194 consensus_queue.cc:1059] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:10:59.649302 31267 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.649524 31530 consensus_queue.cc:1243] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:59.682037 31413 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:59.653782 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:10:59.683226 29817 raft_consensus.cc:606] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
W20260709 13:10:59.684892 31538 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:10:59.649720 31201 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:59.628194 31382 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:59.650059 31312 consensus_queue.cc:1059] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:10:59.568424 31196 consensus_queue.cc:1059] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:10:59.631803 31146 raft_consensus.cc:697] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:10:59.698844 31146 consensus_queue.cc:237] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.661329 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:10:59.633128 31404 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:59.638999 29748 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:59.658871 31211 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:10:59.708021 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:59.708905 29745 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:10:59.709473 29746 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:59.703207 31477 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:59.706135 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:10:59.709894 29745 raft_consensus.cc:1240] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:59.710932 29746 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:59.666636 29821 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:10:59.625002 31468 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.639994 31451 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:59.672899 29740 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:59.650619 31444 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.681090 30347 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:10:59.711145 29748 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:59.640018 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:10:59.714841 31537 log.cc:927] Time spent T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:59.650911 31487 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:59.650398 31407 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:10:59.703028 29714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.667s (SENT) [suppressed 22 similar messages]
W20260709 13:10:59.593988 29823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 708) took 2255 ms (client timeout 1971 ms). Trace:
I20260709 13:10:59.760528 29744 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
W20260709 13:10:59.788149 29823 rpcz_store.cc:269] 0709 13:10:57.321642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.321763 (+   121us) service_pool.cc:224] Handling call
0709 13:10:58.449476 (+1127713us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b180013d6a0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9af8646 00007fd9e9a3258e 00007fd9e9ab3f9e 00007fd9e9ab57de 00007fd9e9ac127c 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c
0709 13:10:59.341599 (+892123us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b58002807d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a190aa 00007fd9e9a9b447 00007fd9e9ab3fe7 00007fd9e9ab57de 00007fd9e9ac127c 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c
0709 13:10:59.576563 (+234964us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1544905728}
W20260709 13:10:59.764439 31412 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:59.658533 31532 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
W20260709 13:10:59.792462 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 65348.2us
I20260709 13:10:59.765753 31451 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:59.766546 30347 pending_rounds.cc:85] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 2
W20260709 13:10:59.768154 31541 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:10:59.715050 31171 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
W20260709 13:10:59.810573 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 168940us
I20260709 13:10:59.833156 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.769800 31443 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:10:59.802922 30347 pending_rounds.cc:107] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:10:59.803941 31201 raft_consensus.cc:3055] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:59.839291 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 43673.8us
I20260709 13:10:59.716042 31279 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.708050 31529 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.796507 31413 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 13:10:59.861116 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 55628.6us
I20260709 13:10:59.862493 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.864459 31419 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.840317 31201 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:10:59.866405 31539 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:10:59.866919 31421 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:10:59.866957 31201 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.872042 31201 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.839155 29741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 803) took 1073 ms. Trace:
I20260709 13:10:59.874197 29741 rpcz_store.cc:276] 0709 13:10:58.763997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.062550 (+298553us) service_pool.cc:224] Handling call
0709 13:10:59.090060 (+ 27510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.137947 (+ 47887us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:59.445980 (+308033us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.786252 (+340272us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.794713 (+  8461us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.801795 (+  7082us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:59.806243 (+  4448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.814747 (+  8504us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.837082 (+ 22335us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":147823,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":12612,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":6822,"thread_start_us":333297,"threads_started":2}
I20260709 13:10:59.877089 29639 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:59.878732 31545 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:10:59.837486 30347 raft_consensus.cc:2889] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:59.888371 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 185370us
I20260709 13:10:59.859910 31321 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.888725 31323 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.895102 31419 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.890199 31421 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:59.899902 31293 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:10:59.913763 31540 log.cc:927] Time spent T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:10:59.915798 31312 consensus_queue.cc:1059] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:10:59.916625 31312 consensus_queue.cc:1243] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:59.918073 31474 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.913478 31413 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:59.920693 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:10:59.928337 31398 consensus_meta.cc:287] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.000s
I20260709 13:10:59.923062 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:10:59.890682 29569 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:59.908031 31521 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:10:59.899330 29820 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:10:59.943491 29822 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
W20260709 13:10:59.947432 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 101965us
I20260709 13:10:59.948089 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.901322 31505 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:59.944658 31201 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:59.945446 31487 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:59.961675 31397 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.961905 31560 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:59.963282 31528 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:59.989043 31382 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.991325 31560 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:10:59.966084 29820 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:59.966747 31312 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.967296 31562 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:10:59.967713 31404 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.968021 31558 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:59.993870 31397 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:10:59.997519 31312 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.999076 31397 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:10:59.999716 31312 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:00.000928 31301 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:00.001232 29569 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 3, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.002429 31562 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.003968 31404 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.003582 29569 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:59.969151 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:10:59.960909 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:10:59.974699 31547 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:59.975296 31451 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.921576 31419 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.007193 31419 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:59.979888 31475 raft_consensus.cc:3055] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:00.007737 31475 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:00.008611 31475 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:00.009711 31475 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.981752 31505 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:10:59.918929 31443 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:10:59.985342 31255 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.010670 31255 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:00.012832 31255 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:10:59.945669 31468 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:10:59.913480 31293 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:10:59.989429 29818 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:59.954568 31474 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.964509 31551 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:00.015400 31451 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:00.015056 31551 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:00.018332 31562 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:00.017761 31551 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:00.019632 31530 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:00.020093 31530 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:00.020954 31530 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.022009 31301 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:00.022394 31301 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:00.023313 31301 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:00.024533 31301 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.004516 31560 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:00.029516 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.033622 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 78081.7us
I20260709 13:11:00.034461 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.037004 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.042480 31146 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:00.043525 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 74454us
I20260709 13:11:00.046391 31560 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.037238 31382 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.048374 31201 consensus_queue.cc:1059] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:00.049206 31201 consensus_queue.cc:1243] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:00.049638 31194 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:00.049965 31419 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:00.050545 31419 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:00.051481 31419 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.053822 31397 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.054384 31397 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.054936 29569 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:00.056643 31397 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.056803 31404 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:00.056455 29569 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.046147 31530 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.050017 31194 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:00.063894 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:00.064640 29817 raft_consensus.cc:606] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.064947 29817 raft_consensus.cc:614] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:00.069638 29666 raft_consensus.cc:1240] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:00.069988 29668 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:00.066099 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:00.072286 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.075651 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.075529 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.071590 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.077316 29667 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:00.077054 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.072352 31194 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.081138 29665 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:00.081815 31194 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.084379 31146 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:00.087363 31463 raft_consensus.cc:3055] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:00.087810 31463 raft_consensus.cc:740] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:00.088760 31463 consensus_queue.cc:260] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:00.076148 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.091638 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.071990 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:00.091451 29714 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.073354 31474 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:00.092816 29639 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.094561 29671 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:00.100875 29673 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:00.101265 29569 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.104844 31255 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.105322 29665 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:00.106561 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:11:00.107164 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.108835 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:00.109583 31475 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:00.080192 31382 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.110176 31475 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:00.112037 31563 log.cc:927] Time spent T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.149s	user 0.000s	sys 0.004s
I20260709 13:11:00.112931 30343 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:11:00.113277 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:00.113907 29817 raft_consensus.cc:606] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.114179 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:00.112396 29569 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:00.115893 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.114333 29817 raft_consensus.cc:614] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:00.117640 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.118367 29671 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:00.120929 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.098637 31474 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.122658 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.121343 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:00.123960 29714 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.127892 29741 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:00.128360 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.128959 29744 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:00.130406 29741 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:00.132165 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.132948 29740 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:00.132328 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:00.115474 31463 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:00.134948 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.135571 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.137398 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.138367 29820 raft_consensus.cc:2410] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:00.139202 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.139921 29820 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:00.140452 29747 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:00.140769 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.118564 31382 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.143157 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.143060 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.158195 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.158823 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.147742 29569 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.159525 29819 raft_consensus.cc:2410] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:00.160251 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.160636 29665 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:00.160984 29820 raft_consensus.cc:2410] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:00.133849 31474 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.157829 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.162820 29816 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:00.163718 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.145485 31456 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.162009 31561 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:11:00.166338 31397 raft_consensus.cc:1064] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:11:00.167109 31397 raft_consensus.cc:1068] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:00.166431 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.167614 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.168437 29821 raft_consensus.cc:2410] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:00.168287 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.168741 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:00.168880 29822 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:00.170254 29822 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:00.170442 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.171052 29816 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:00.171495 29822 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:00.169229 31293 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.175109 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:00.177625 29816 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:11:00.178174 31561 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:00.182947 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.183470 31561 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:00.184311 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.185326 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.169256 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.180114 29822 raft_consensus.cc:1240] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:00.182272 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.161906 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.186910 29821 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.187286 29819 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:00.183012 29816 pending_rounds.cc:85] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 2
I20260709 13:11:00.192723 29816 pending_rounds.cc:107] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:00.193025 29816 raft_consensus.cc:2889] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:00.188901 29815 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:00.193078 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.198879 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:11:00.202525 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 78649.4us
I20260709 13:11:00.145903 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.122064 31475 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:00.204118 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.205969 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:00.207861 29815 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:00.209504 29815 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.213385 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:00.219234 29748 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:00.158330 31529 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:00.221069 29740 raft_consensus.cc:1240] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:00.221074 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.237404 29819 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.211427 31412 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:00.186318 31561 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:00.229184 29821 raft_consensus.cc:2410] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:00.229573 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.217981 31475 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:00.230558 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 126147us
I20260709 13:11:00.211831 31171 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:00.242223 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.247826 29740 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:00.236339 29714 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.253170 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.232990 31436 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:00.255342 29639 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.252496 31404 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:11:00.255901 31412 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:00.259085 31546 log.cc:927] Time spent T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.394s	user 0.004s	sys 0.000s
I20260709 13:11:00.259382 31412 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:00.255955 31293 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.263758 31255 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:00.260651 31474 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.268517 31474 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.252949 31475 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.271512 31475 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:00.277771 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.281980 29639 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.286725 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.254885 29569 catalog_manager.cc:5697] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.287443 29671 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:11:00.289837 29714 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.241454 31529 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:00.289505 29569 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.300400 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.301363 31404 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:00.301878 31404 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:11:00.303459 31542 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.532s	user 0.000s	sys 0.004s
I20260709 13:11:00.303167 31404 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.303128 29569 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.307505 31397 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:00.307931 31293 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.308575 31293 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.309100 29569 catalog_manager.cc:5697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.310235 29742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1399) took 1351 ms. Trace:
I20260709 13:11:00.302333 29639 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.312058 31474 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:00.312587 31474 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:00.313503 31474 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:00.314306 31570 log.cc:927] Time spent T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.233s	user 0.002s	sys 0.001s
I20260709 13:11:00.317617 29639 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.318534 31255 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:00.318951 31255 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:00.319311 31255 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.328058 31255 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.329140 31293 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.293689 31477 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.332036 31255 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.311375 29569 catalog_manager.cc:5697] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:00.333348 31533 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:00.337395 29715 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:00.310792 29742 rpcz_store.cc:276] 0709 13:10:58.958460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.211615 (+253155us) service_pool.cc:224] Handling call
0709 13:10:59.221210 (+  9595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:59.233430 (+ 12220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.233461 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:59.267177 (+ 33716us) log.cc:844] Serialized 26 byte log entry
0709 13:10:59.468220 (+201043us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:59.468262 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.468334 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:00.303140 (+834806us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b24002954a8. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68569c4 00007fd9e6854acb 00007fd9e6a0fdc9 00007fd9e6a0fa55 00007fd9e6a0f09d 00007fd9e964110e 00007fd9e965888c 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221
0709 13:11:00.309876 (+  6736us) raft_consensus.cc:1685] finished
0709 13:11:00.309900 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.310167 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":15771,"spinlock_wait_cycles":12881792,"thread_start_us":169785,"threads_started":1,"wal-append.queue_time_us":363494}
I20260709 13:11:00.342207 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:00.339823 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.347340 29819 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
W20260709 13:11:00.348193 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 86802us
I20260709 13:11:00.352170 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:00.355888 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:00.362095 29569 catalog_manager.cc:5697] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:00.363932 29818 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:00.364306 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.365196 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.297302 31529 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.364449 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:00.368750 29819 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.365715 29715 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:00.377573 29714 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.389995 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:00.353000 31397 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:00.392259 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:00.371428 31574 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:00.393888 29669 raft_consensus.cc:1240] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:00.363782 31436 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:00.361649 31255 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.397512 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.404345 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.404844 29748 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:00.374531 31382 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.401254 29569 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 2, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:00.384848 31456 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.363577 29814 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:00.413270 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:00.417449 29671 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.416101 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.418941 29669 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:00.418758 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.416648 29819 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:00.425273 29742 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:00.400136 31421 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.405857 31436 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.429159 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:00.427254 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.429816 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:00.436582 29665 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.436887 29668 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.437307 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.438174 29744 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:00.438082 29671 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:00.393312 31440 consensus_queue.cc:1059] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:11:00.448905 29669 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.415822 31211 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.452114 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:00.457898 29821 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:00.461123 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:00.463126 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.440829 31436 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.420287 31255 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.446556 31528 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.494987 31561 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.496165 31561 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:00.496624 31561 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:00.472425 31211 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.502009 31211 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.487703 31412 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:11:00.505270 31412 consensus_queue.cc:1243] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:00.505798 31412 raft_consensus.cc:3055] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:00.508342 29668 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:00.510401 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.507086 29787 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.513180 29665 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:00.512897 31419 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.515820 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.520311 29823 raft_consensus.cc:1275] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:00.472868 31487 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:00.512717 31354 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:00.521366 31354 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:00.522167 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.523507 31354 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:00.514339 31443 raft_consensus.cc:3055] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:00.525462 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:00.468380 31407 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:11:00.491354 31475 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.529748 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:00.440598 31421 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.528115 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.530045 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:00.536733 29668 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:00.537248 29639 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:00.537623 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.538204 31474 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.538594 31474 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:00.538800 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.539048 31474 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.539919 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:00.541270 29668 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: [4.2-5.3]
I20260709 13:11:00.548383 31474 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.549322 29668 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:00.550310 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:00.550565 29668 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:00.550935 29742 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.506171 31412 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:00.524258 31443 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:00.577732 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:00.578397 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:00.577992 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48014.4us
W20260709 13:11:00.574946 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 45638.1us
I20260709 13:11:00.524308 31529 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:00.580965 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.582501 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:00.585222 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 176031us
W20260709 13:11:00.585752 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 123342us
I20260709 13:11:00.583817 29665 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.584667 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:00.497545 31561 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.590306 29741 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:00.575049 31404 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:00.551179 31474 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.524989 31555 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:11:00.612149 29742 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:00.613853 29789 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.615355 29787 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:00.615824 29714 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.620242 29714 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.621732 29714 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.583084 31556 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:00.581629 31599 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:00.585104 31382 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:00.628850 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.629371 31463 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.529140 31419 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.614142 31211 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.606141 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:00.644436 29665 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:00.599815 31201 consensus_queue.cc:1059] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:11:00.585336 31354 consensus_queue.cc:1059] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:11:00.638716 31599 raft_consensus.cc:697] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:00.623631 31404 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:00.642148 31550 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:00.667590 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 130404us
I20260709 13:11:00.648068 31561 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.623306 31562 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:11:00.626845 31194 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:11:00.651597 31407 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.634127 31560 consensus_queue.cc:1059] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:11:00.781090 31581 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.816052 31595 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:00.781312 31579 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:11:00.797142 31583 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:00.800108 31382 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.741783 31407 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:00.686477 31201 consensus_queue.cc:1243] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:00.661072 31354 consensus_queue.cc:1243] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:00.662017 31443 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:00.656390 31505 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.815359 31436 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.795184 31599 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:00.818610 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 225775us
W20260709 13:11:00.823654 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 339616us
I20260709 13:11:00.859149 31421 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.860751 31255 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.849318 31583 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.864146 31583 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.822642 31082 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:11:00.875201 31443 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:00.876219 31419 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:00.852761 31586 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:00.882622 31586 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:00.884896 31586 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:00.780647 31404 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:00.780565 31194 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:00.816699 31475 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:00.851823 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 223041us
I20260709 13:11:00.917593 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.919013 29789 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.848889 31581 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.818365 31456 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:00.854458 31407 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.924732 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:00.901031 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:11:00.946483 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 45526.8us
I20260709 13:11:00.947594 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:00.920101 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.898985 31549 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.964552 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:00.971913 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51892.2us
W20260709 13:11:00.969003 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 353691us
I20260709 13:11:00.973001 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:00.971285 29715 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:11:00.993804 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 327142us
I20260709 13:11:00.933354 31201 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.937448 31475 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.932878 31581 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.912935 31194 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:11:01.006579 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.006225 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:00.970870 31146 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.952620 31601 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:01.013590 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.014079 29744 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.014947 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.063464 29741 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:01.015322 31560 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:01.016072 29743 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:00.940737 31505 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:11:01.022826 31561 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.952872 31529 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:01.009457 31549 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:01.025362 31436 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:00.948987 31255 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.996673 31171 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.030705 31528 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:00.956701 31588 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:01.040416 31592 log.cc:927] Time spent T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.504s	user 0.002s	sys 0.008s
I20260709 13:11:01.012372 31525 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:00.922751 31293 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:11:00.941176 31354 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:11:01.037696 31463 raft_consensus.cc:3055] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:11:01.010057 31397 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.004s	sys 0.014s
W20260709 13:11:01.079578 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 108369us
I20260709 13:11:01.135524 29715 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:01.136910 29715 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:01.110126 31589 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:01.111219 31590 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:01.112072 29638 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:01.113795 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 118314us
I20260709 13:11:01.117149 30348 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:01.068243 31279 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.076732 31560 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:01.117599 31556 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.129019 31588 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:01.068421 31601 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:01.130563 31293 consensus_queue.cc:1243] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:11:01.139508 31397 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.004s	sys 0.014s
I20260709 13:11:01.142916 31586 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.132826 31463 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:11:01.176227 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 211592us
W20260709 13:11:01.185364 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 210967us
I20260709 13:11:01.138967 29715 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:01.142637 31595 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:01.147361 31590 consensus_queue.cc:1243] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:01.148376 31555 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:01.173132 31196 raft_consensus.cc:3055] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.176939 31589 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:01.207770 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:01.189383 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 244235us
I20260709 13:11:01.120774 31456 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.179117 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:01.128734 31194 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.193620 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:01.195761 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 56872.5us
I20260709 13:11:01.197185 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.151764 31279 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.132436 31525 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.217422 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:11:01.189443 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 234364us
I20260709 13:11:01.180266 31397 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:01.172758 31146 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:11:01.186286 31604 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.184728 31586 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:01.195405 31555 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.178983 31581 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.222098 29740 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:01.193111 31583 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:01.213982 31585 log.cc:927] Time spent T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:11:01.151772 31255 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:11:01.205333 31436 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:11:01.225068 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 252109us
I20260709 13:11:01.203431 31595 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:01.203375 31196 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:01.232219 29743 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.209736 31463 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.177137 31556 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:01.290503 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 71942.3us
W20260709 13:11:01.298417 31592 log.cc:927] Time spent T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:01.203028 31613 consensus_queue.cc:1059] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:11:01.229831 31528 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:01.283434 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.234073 31586 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.227952 31604 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:01.236280 31529 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.297120 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:01.316754 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:01.236763 31588 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.305493 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:01.277084 31194 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:01.276922 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48212.1us
I20260709 13:11:01.327577 29742 raft_consensus.cc:2368] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6.
I20260709 13:11:01.277155 31590 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:11:01.334921 29820 raft_consensus.cc:2410] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:01.334149 31528 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:01.360553 31610 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:11:01.361339 31583 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.312455 31624 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:01.346796 31412 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.347543 31613 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.236496 31555 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.363842 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:01.364311 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 58914.6us
I20260709 13:11:01.364886 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.366102 29823 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:01.341521 31628 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.369817 29819 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:01.370919 29667 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:01.369007 31608 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.380175 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.381320 29671 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:01.381584 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:01.387748 29822 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:11:01.388806 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:01.348372 31529 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:01.367894 31528 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:01.387230 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 65406us
I20260709 13:11:01.367082 31560 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:01.373385 31607 raft_consensus.cc:3055] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.390765 30316 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:01.381647 29814 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.381799 31606 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:11:01.424441 31604 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:01.414440 31596 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.834s	user 0.007s	sys 0.006s
I20260709 13:11:01.354874 31397 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.331125 31589 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:01.418920 31619 log.cc:927] Time spent T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:11:01.419281 31626 raft_consensus.cc:2764] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:11:01.379747 31624 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:01.415149 31621 log.cc:927] Time spent T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:11:01.428581 31581 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.429093 31556 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.430202 31611 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:01.401621 31529 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.398078 31608 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.432729 29745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 827) took 1034 ms. Trace:
I20260709 13:11:01.432498 31475 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.384713 31196 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.387072 31595 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.425765 31604 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.396163 31487 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:11:01.385087 31614 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.386729 31412 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.451315 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.385283 31613 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.459779 29745 rpcz_store.cc:276] 0709 13:11:00.398095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.398254 (+   159us) service_pool.cc:224] Handling call
0709 13:11:00.398653 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.581501 (+182848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.581537 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.603145 (+ 21608us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.076330 (+473185us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:01.076374 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.076451 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.432515 (+356064us) raft_consensus.cc:1685] finished
0709 13:11:01.432536 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.432668 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118034,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":611238,"threads_started":2,"wal-append.queue_time_us":766603}
I20260709 13:11:01.430231 31171 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.408490 31607 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:01.442018 31146 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.459908 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 71163.2us
I20260709 13:11:01.448539 31436 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:11:01.465543 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 74874.9us
W20260709 13:11:01.466858 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 65313.6us
I20260709 13:11:01.458608 31611 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.481472 31614 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.485600 31211 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:01.466890 31602 log.cc:927] Time spent T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.281s	user 0.003s	sys 0.000s
I20260709 13:11:01.500305 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 829) took 1094 ms. Trace:
I20260709 13:11:01.502203 29789 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:11:01.489753 31407 consensus_meta.cc:287] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.004s
I20260709 13:11:01.504179 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:01.502661 29748 rpcz_store.cc:276] 0709 13:11:00.405827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.406746 (+   919us) service_pool.cc:224] Handling call
0709 13:11:00.423608 (+ 16862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.716528 (+292920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.716566 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.812816 (+ 96250us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.117952 (+305136us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:01.118175 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.118618 (+   443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.500098 (+381480us) raft_consensus.cc:1685] finished
0709 13:11:01.500117 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.500248 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29756,"raft.queue_time_us":149078,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"thread_start_us":494142,"threads_started":2,"wal-append.queue_time_us":382951}
I20260709 13:11:01.501555 31419 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.508690 31419 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.510929 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:01.403121 31628 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.490422 31146 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.502158 31611 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.505232 31196 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.503957 31556 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:01.490984 31623 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:11:01.505856 31301 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:01.512142 31194 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.520491 30344 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:01.509495 31211 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:01.506238 31635 consensus_queue.cc:1059] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:11:01.543903 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 765) took 1033 ms. Trace:
I20260709 13:11:01.544934 29821 rpcz_store.cc:276] 0709 13:11:00.510141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.510272 (+   131us) service_pool.cc:224] Handling call
0709 13:11:00.510685 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.511021 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.511049 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:00.525185 (+ 14136us) log.cc:844] Serialized 26 byte log entry
0709 13:11:00.910707 (+385522us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:11:00.910749 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.910815 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:01.438610 (+527795us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:01.540249 (+101639us) raft_consensus.cc:1685] finished
0709 13:11:01.540272 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.543840 (+  3568us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11820,"raft.queue_time_us":2180,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":84870,"spinlock_wait_cycles":13015296,"thread_start_us":320046,"threads_started":1,"wal-append.queue_time_us":552908}
I20260709 13:11:01.546283 31632 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:01.546859 31632 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.555444 31601 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.557744 31404 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.509848 31407 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.558386 31404 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.536288 31560 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.560488 31404 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.560891 31560 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.564261 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.564512 29816 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:01.537804 31556 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.571632 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.527814 31636 consensus_queue.cc:1059] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:11:01.534389 31301 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:01.588393 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:01.544524 31456 consensus_queue.cc:1048] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:11:01.574350 31194 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.579100 31404 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.599206 29639 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:01.601045 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:01.601528 29714 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:01.578822 31475 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.542599 31436 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.608991 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.610162 29671 raft_consensus.cc:2393] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:01.613175 29669 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:01.602859 31533 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.606055 31321 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:01.618108 31321 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:01.618508 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:01.619151 29674 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.618975 31321 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.622457 31529 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.614621 29673 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:01.604818 31635 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.616159 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:01.590462 31607 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.624516 31607 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.623612 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.604847 31194 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:01.604638 31633 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:01.605690 31404 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.632344 31404 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.622865 31301 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.609311 31419 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.647135 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.652953 31407 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:01.654512 31638 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:11:01.656591 31211 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:01.657781 31560 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.659631 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.659826 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.660269 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:01.633522 31528 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.660913 31586 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:01.661904 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.662518 29740 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:01.661258 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:01.660955 29745 raft_consensus.cc:2368] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:01.666267 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:11:01.667871 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.634357 31529 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.642957 31608 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.681584 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:01.682068 29745 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:11:01.682986 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.684294 29744 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.670949 31560 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.688843 29674 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:01.689810 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:01.690557 29674 raft_consensus.cc:2368] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:01.673349 31146 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.709822 29672 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:01.710418 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.711429 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:01.712308 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.680209 31456 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:11:01.713254 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.713661 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.714325 29674 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:01.715281 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.716262 29674 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.717073 29674 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:01.722296 29638 leader_election.cc:400] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6.
I20260709 13:11:01.693585 31404 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.723778 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.729074 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.729745 29672 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:01.675447 31633 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:11:01.708237 31614 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.735157 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:01.741827 31628 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.744372 29823 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.745672 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.706386 31560 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.767834 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.768466 29744 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:01.769744 29823 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:01.770807 29744 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:01.734375 31404 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.771271 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.772224 29744 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:01.772641 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:01.773689 29823 raft_consensus.cc:2393] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:01.777729 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.776139 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.778329 29816 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:01.782094 29668 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.783272 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:01.783797 29823 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.786167 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:01.786744 29816 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.775974 31586 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:01.791332 29746 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.806613 29816 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:01.810520 29744 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.813458 29823 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:01.815011 29816 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.803164 31589 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:01.818195 31589 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.819941 29823 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:01.820859 31589 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:01.821471 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.822506 29823 pending_rounds.cc:85] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 2
I20260709 13:11:01.822947 29823 pending_rounds.cc:107] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:01.823266 29823 raft_consensus.cc:2889] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:01.823449 31194 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.834369 31626 raft_consensus.cc:3055] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:01.815297 31555 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:01.858568 31655 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:01.868628 29665 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:01.874845 31404 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:01.854846 31626 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:01.875941 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.876387 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:01.876132 31626 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.877362 31626 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.879910 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:01.880582 29747 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:01.872828 31560 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.886087 31562 raft_consensus.cc:3055] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.881804 31412 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.881672 31549 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.890689 31562 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:01.896195 31562 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.900226 31255 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:01.900892 31255 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:01.892427 31412 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.903061 31255 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:01.903532 31412 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.903959 29818 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:01.905125 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:01.908037 31293 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:01.908527 31293 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:01.909047 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:01.882813 31611 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:01.910480 31293 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.912587 31611 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:01.913956 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.928606 29821 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.928946 29817 raft_consensus.cc:2410] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:01.933044 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:01.933656 29748 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.943800 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:01.905167 29818 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:01.955678 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:01.956461 29821 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:01.959722 29748 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:01.961021 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:01.966480 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:01.967185 29674 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.973263 31615 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:11:01.973577 31649 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:01.974293 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:01.977983 31649 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:01.981500 29674 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:01.984879 31587 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:01.962366 31533 consensus_queue.cc:1059] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:01.972083 31255 consensus_queue.cc:1059] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:11:01.972412 31598 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:11:01.990867 31587 raft_consensus.cc:697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:01.996450 30346 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:01.996973 31404 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:02.005815 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.007133 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.007301 31555 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.008150 31600 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:01.981716 31649 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.008713 31600 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.013410 31146 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.991890 31587 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.009786 29640 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:02.014329 31598 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:02.015515 31632 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.015893 31624 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.005678 31404 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:02.042476 31404 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:02.011654 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:02.044870 29639 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.053109 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.054065 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:02.039158 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.055673 30314 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:02.058202 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 48504.6us
I20260709 13:11:02.066813 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.070905 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.067727 29740 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:02.073242 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.033262 31146 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:02.078667 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.046124 31421 raft_consensus.cc:3055] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:02.032886 31600 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.063441 31632 raft_consensus.cc:2764] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:02.044310 31533 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:11:02.074831 31606 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:02.069804 31598 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:02.075567 31624 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:02.077313 31611 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:02.083189 31421 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:11:02.119163 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 74405.7us
I20260709 13:11:02.085319 31555 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:11:02.125032 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.107059 31598 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:02.129189 31603 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:02.133323 31463 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.113332 31606 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:02.126546 31211 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.135371 31599 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:02.127660 31598 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:02.183910 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 69417.1us
I20260709 13:11:02.139400 31474 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:11:02.164510 31599 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:02.127660 31146 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.195390 29742 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:02.165702 31211 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.187004 31675 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:02.180171 31533 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:02.163830 31555 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:11:02.217084 31598 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.219578 31211 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.224541 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.201349 31599 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:02.243268 31677 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:02.254904 31677 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:02.255259 31677 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:02.256093 31677 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.257246 31677 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:02.145267 31421 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.258270 31421 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:02.233685 31673 log.cc:927] Time spent T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:11:02.209695 31675 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:02.260150 31675 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.261126 31675 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.230297 31146 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:02.249963 29742 raft_consensus.cc:2410] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:11:02.250252 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.205960 31606 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.296118 29743 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:02.303504 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 178566us
I20260709 13:11:02.283689 31463 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:02.304603 29639 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.318116 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:02.320046 29639 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.320845 31474 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:02.321244 31474 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.321569 31474 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:02.328471 31474 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.332113 31613 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.334549 31645 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.335117 31645 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.337245 31645 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:02.338501 31279 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.338824 31528 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.351320 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:02.351859 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:02.352401 29819 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:02.353310 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.353811 29818 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:11:02.355197 29820 pending_rounds.cc:85] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 2
I20260709 13:11:02.355428 29818 pending_rounds.cc:85] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 2
I20260709 13:11:02.353962 29821 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:02.356256 29820 pending_rounds.cc:107] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:02.356554 29820 raft_consensus.cc:2889] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.355813 29818 pending_rounds.cc:107] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:02.357050 29818 raft_consensus.cc:2889] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:02.358466 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:02.310185 31533 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:02.362365 29815 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:02.364502 29815 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:02.365991 29819 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:02.345430 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.313758 31598 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:02.375995 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.309443 31463 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:02.415961 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:02.417835 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.428484 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.430157 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.433841 29741 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:02.430236 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.435762 29744 raft_consensus.cc:1240] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:11:02.362804 31533 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:02.316874 31600 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:11:02.454807 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.455042 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:02.455469 29746 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:11:02.479727 31613 raft_consensus.cc:1064] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:02.480266 31404 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.481359 29671 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:02.453442 31533 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:02.481865 31613 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.486945 31528 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:02.487512 31528 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.456710 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:02.449471 31682 log.cc:927] Time spent T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:02.498111 29671 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:02.502952 31549 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:02.507586 31528 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.527936 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:02.528676 29744 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:02.531528 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 186174us
I20260709 13:11:02.535358 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.536098 29818 raft_consensus.cc:2393] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:02.536720 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.537361 29787 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:02.540970 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:02.543062 29821 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:02.469467 31599 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.495805 31279 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.469726 30347 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:02.551455 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.551761 29787 leader_election.cc:400] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:02.554365 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.556116 29817 raft_consensus.cc:2410] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:02.556798 29787 leader_election.cc:403] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:02.560315 29744 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:02.561169 29746 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:02.535607 31477 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:02.540344 31556 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.561614 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:02.552167 31530 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:02.545246 31525 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.575044 30345 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:02.567551 31474 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.576153 31463 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:02.579371 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.608948 29640 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:02.581028 31354 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:02.582590 31626 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:02.586500 31404 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:02.592738 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:02.594358 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:02.594697 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:02.596637 29670 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:02.602255 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:02.616701 29674 raft_consensus.cc:2410] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:02.601816 31530 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.617695 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:02.613147 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:02.620741 29674 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:02.621336 29668 raft_consensus.cc:2393] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:02.606220 31146 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:02.562402 31279 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:02.626763 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.615211 31626 consensus_queue.cc:1243] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:02.622186 29670 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:02.620929 29673 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.630846 29668 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:02.634470 29670 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:02.615489 31474 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:02.643033 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:02.643338 29665 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:02.625255 29674 raft_consensus.cc:1240] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:02.598511 31556 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.643786 29668 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:02.621232 31600 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.621385 31530 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:02.612174 31533 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.626560 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:02.648278 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.659503 29673 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:02.668529 31562 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:02.669250 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.670048 31404 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:02.670866 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.671597 31404 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.671994 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:02.672699 31404 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:02.678042 31675 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:02.678979 29744 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:02.679968 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.680614 31556 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:02.681654 31599 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.678092 30350 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.686722 31279 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.687863 31549 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:02.639524 31146 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:02.691955 31146 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.692953 31528 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:02.693490 31528 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.650199 31474 raft_consensus.cc:697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:02.695062 31474 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.695606 31528 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.696550 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.697034 31533 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.697335 29817 raft_consensus.cc:2410] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:02.699347 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:02.700188 29817 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:02.725167 29673 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:02.727953 29817 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:02.729893 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:02.733830 29668 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:02.734360 29715 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:02.661455 31600 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.732729 29639 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:02.739877 29670 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:02.733511 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:02.743072 29817 raft_consensus.cc:2393] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 3: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:02.713830 31525 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:11:02.745365 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:02.713637 31549 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:11:02.716542 31293 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:11:02.747428 31672 log.cc:927] Time spent T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.613s	user 0.005s	sys 0.000s
I20260709 13:11:02.747768 31555 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:02.733690 31613 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:11:02.757335 31555 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:02.758677 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1358) took 1146 ms. Trace:
I20260709 13:11:02.760149 29666 rpcz_store.cc:276] 0709 13:11:01.611935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.612053 (+   118us) service_pool.cc:224] Handling call
0709 13:11:01.612332 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.616738 (+  4406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.616762 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.924815 (+308053us) spinlock_profiling.cc:243] Waited 920 us on lock 0x7b2c000014c8. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e83b6a11 00007fd9e83c6372 00007fd9e9af8a01 00007fd9e9abd43a 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2
0709 13:11:01.925214 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.075907 (+150693us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:02.075950 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.076016 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:02.746798 (+670782us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:02.758446 (+ 11648us) raft_consensus.cc:1685] finished
0709 13:11:02.758469 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:02.758614 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":5046400,"thread_start_us":150342,"threads_started":1,"wal-append.queue_time_us":209243}
I20260709 13:11:02.745182 31629 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:02.736105 31594 consensus_queue.cc:1059] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:11:02.773818 31555 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.775345 31629 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:11:02.779541 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.735198 31528 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:11:02.786203 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:11:02.820720 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 235955us
I20260709 13:11:02.827064 31550 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:02.828231 31550 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:02.829561 31550 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:02.831856 31550 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:02.839748 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:02.845309 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:02.846724 29817 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:02.845093 31626 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:02.851089 31626 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:02.851475 31626 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:02.844193 31690 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:02.868203 31600 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:02.840972 31561 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
W20260709 13:11:02.886181 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 152091us
W20260709 13:11:02.893059 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:02.895617 29673 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:02.889940 31533 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:02.902398 29673 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:02.910760 29673 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:02.926793 29818 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:02.879446 31629 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:02.906872 31594 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:11:02.947623 31695 log.cc:927] Time spent T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:02.913120 31530 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:02.952656 29821 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:02.908800 31533 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:02.960305 31703 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:11:02.954893 31530 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:02.965080 31562 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:02.977831 31562 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:02.992211 31603 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:02.993446 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.010206 31321 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.010895 31321 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.013294 31321 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.016781 31525 raft_consensus.cc:3055] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:03.017298 31525 raft_consensus.cc:740] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.018203 31525 consensus_queue.cc:260] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.018851 31533 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.019804 31562 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:03.020825 31562 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.021720 31525 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:03.026458 31689 log.cc:927] Time spent T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.355s	user 0.000s	sys 0.003s
I20260709 13:11:03.028597 31082 raft_consensus.cc:3055] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:03.029062 31082 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.037835 29639 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:11:03.048689 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.029844 31082 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.050768 31082 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:03.054530 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.055294 29817 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:03.056986 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.057834 29817 raft_consensus.cc:2410] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:03.058789 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.059691 29819 raft_consensus.cc:2410] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:03.061169 29639 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:03.088075 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.089427 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.093627 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.094511 29742 raft_consensus.cc:2410] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:03.095425 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.096485 31528 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:03.101045 29743 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:03.102109 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.104580 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.107630 29744 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:03.107664 29749 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:03.109169 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.074607 31421 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.073967 31679 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:03.110473 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.111907 29715 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:03.067315 31626 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.126148 29674 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:03.129565 31293 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:11:03.135437 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.115890 31627 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.119117 31679 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:03.144058 31671 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 1.004s	user 0.002s	sys 0.002s
I20260709 13:11:03.144994 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.146720 29823 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:03.149665 29819 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:03.157795 29819 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:03.158561 29819 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.159646 29819 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.151355 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.154251 31623 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:03.154867 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.126739 31550 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:03.123776 31583 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:03.120803 31421 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.114471 31581 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:11:03.161448 29820 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:03.110720 31705 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:11:03.156615 31679 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:03.165074 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.167721 29714 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.175060 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:03.177641 30345 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
W20260709 13:11:03.178498 31711 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.186s	user 0.003s	sys 0.000s
W20260709 13:11:03.170173 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.182663 31680 log.cc:927] Time spent T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.744s	user 0.002s	sys 0.000s
I20260709 13:11:03.184525 29819 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:03.186046 29819 pending_rounds.cc:85] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 3
I20260709 13:11:03.173643 29814 raft_consensus.cc:2368] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:11:03.173862 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.186950 31626 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.187378 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 867) took 1121 ms. Trace:
I20260709 13:11:03.188117 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.189000 29819 pending_rounds.cc:107] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:11:03.156457 31627 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.196120 29743 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.191206 29818 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:11:03.173267 29820 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:03.193084 29714 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.195811 29748 rpcz_store.cc:276] 0709 13:11:02.066084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.066573 (+   489us) service_pool.cc:224] Handling call
0709 13:11:02.066888 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.069887 (+  2999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.069937 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.075863 (+  5926us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.295811 (+219948us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:02.295864 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.295939 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.182170 (+886231us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:03.187069 (+  4899us) raft_consensus.cc:1685] finished
0709 13:11:03.187102 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.187323 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13021,"raft.queue_time_us":3244,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4186,"spinlock_wait_cycles":29734272,"thread_start_us":188494,"threads_started":1,"wal-append.queue_time_us":225541}
I20260709 13:11:03.189260 29789 leader_election.cc:400] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:03.201978 29714 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.202860 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.196430 29819 raft_consensus.cc:2889] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:03.205308 29823 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:03.207232 29789 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.205293 29819 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:03.174242 31583 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.199625 29818 pending_rounds.cc:85] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 2
I20260709 13:11:03.214114 29818 pending_rounds.cc:107] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:03.214428 29818 raft_consensus.cc:2889] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:03.209909 29820 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:03.210884 29789 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:03.211171 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 91876.7us
I20260709 13:11:03.211985 31397 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:03.216850 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.218598 29789 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.223414 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.224421 29817 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:03.194726 31528 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:03.213351 31677 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:03.209735 31194 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:03.213129 31525 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:03.233203 29743 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:03.163792 31623 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:03.224225 31562 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:03.225564 31530 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:03.226142 31463 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:03.196936 31591 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:11:03.233876 31626 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:03.230268 31556 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:03.247272 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 44239.1us
I20260709 13:11:03.267644 31623 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.269058 31679 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.269999 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.228405 31694 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:11:03.242162 31525 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.243829 31463 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.246524 31421 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:03.285526 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 70139.2us
I20260709 13:11:03.249094 31556 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.289760 30347 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:03.291472 29816 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1319) took 1716 ms. Trace:
I20260709 13:11:03.291764 29816 rpcz_store.cc:276] 0709 13:11:01.570573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.819154 (+248581us) service_pool.cc:224] Handling call
0709 13:11:01.819473 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.199687 (+380214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.199717 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.209077 (+  9360us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.310275 (+101198us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:02.310315 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.286912 (+976597us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400172fd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:03.286958 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.287003 (+    45us) raft_consensus.cc:1685] finished
0709 13:11:03.287016 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.287232 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2045,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":18593,"spinlock_wait_cycles":873709440,"thread_start_us":78059,"threads_started":1,"wal-append.queue_time_us":314074}
W20260709 13:11:03.294859 31721 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:03.295526 31679 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.280755 31562 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.298774 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.287597 31581 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:03.301450 31581 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:03.303596 31581 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:03.288498 31463 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.274742 31583 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.314281 31525 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.292467 31556 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.319233 31694 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.319828 31694 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:03.322188 31677 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.322685 31677 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:03.334385 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.319161 31562 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:03.345199 31691 log.cc:927] Time spent T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.666s	user 0.000s	sys 0.002s
W20260709 13:11:03.345451 31681 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 1.001s	user 0.000s	sys 0.003s
I20260709 13:11:03.325567 31697 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.346962 29671 raft_consensus.cc:1240] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:03.296555 31397 raft_consensus.cc:697] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.297210 31528 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:03.355477 29665 raft_consensus.cc:1240] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:03.354296 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 57275.9us
I20260709 13:11:03.356223 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1329) took 1005 ms. Trace:
I20260709 13:11:03.363154 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:03.363807 30347 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:03.349370 31686 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.362660 29822 rpcz_store.cc:276] 0709 13:11:02.351259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.352124 (+   865us) service_pool.cc:224] Handling call
0709 13:11:02.352405 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.352723 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.352751 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.368703 (+ 15952us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.630153 (+261450us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:02.857541 (+227388us) log.cc:844] Serialized 14 byte log entry
0709 13:11:02.860136 (+  2595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.860253 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.344612 (+484359us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:03.353622 (+  9010us) raft_consensus.cc:1685] finished
0709 13:11:03.356006 (+  2384us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.356165 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220865,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":6179,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":9994,"spinlock_wait_cycles":43444608,"thread_start_us":390149,"threads_started":2,"wal-append.queue_time_us":255899}
I20260709 13:11:03.367935 31397 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.356655 31697 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.368871 31528 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.371457 31528 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.368206 31594 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:03.342453 31194 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.381201 29673 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:03.383265 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:03.353811 31555 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:03.389788 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.391196 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.389863 31529 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:03.397941 31529 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:03.398334 31529 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.367846 31686 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.419691 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.420699 29816 raft_consensus.cc:2410] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:03.415333 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:03.422762 29818 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:03.427819 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.431367 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.390208 31194 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:03.436574 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 138163us
I20260709 13:11:03.437827 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.395233 31555 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.459192 31562 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:03.459815 31562 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.460367 31562 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.463291 31555 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:03.463886 31704 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.518s	user 0.002s	sys 0.000s
I20260709 13:11:03.465405 31194 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:03.465968 31194 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:03.466439 31194 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:03.469126 31194 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:03.469728 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:03.472045 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.477097 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.478452 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.479305 29741 raft_consensus.cc:2410] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:03.479782 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.480384 29816 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:03.497035 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.469656 31194 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.504598 31194 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.505088 29817 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:03.506807 31194 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.508152 31194 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:03.508611 31194 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:03.510730 31697 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.459839 31677 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.515925 31677 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.516686 31561 raft_consensus.cc:3055] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:03.499293 31623 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:03.521369 31561 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:03.525712 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:03.498625 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 71525.3us
I20260709 13:11:03.438248 31583 consensus_queue.cc:1059] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:11:03.546710 29747 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:03.526315 29741 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:03.548092 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.548702 29748 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
W20260709 13:11:03.521661 31505 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:11:03.546499 29818 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:03.521238 31626 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.554993 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.553791 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.555934 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.561987 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:03.562144 29665 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:03.444072 31556 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:03.566469 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.562569 29818 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:03.567885 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:03.522300 31561 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.563576 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.558341 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.511060 31562 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.565054 31626 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:03.574314 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 136561us
I20260709 13:11:03.588972 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:03.575160 31463 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.592100 31463 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.592651 31694 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:03.593382 29814 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:03.569880 31561 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:03.578554 31627 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.597651 31626 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.600070 31626 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.585314 29818 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:03.565595 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.566447 29816 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:03.559437 29671 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:03.568864 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:03.570322 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 43687.8us
I20260709 13:11:03.522315 31686 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:03.571036 31706 log.cc:927] Time spent T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.624s	user 0.003s	sys 0.000s
I20260709 13:11:03.571529 31583 raft_consensus.cc:3055] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:03.571794 31421 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.573402 31737 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.564896 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.565429 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.562987 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:03.509430 31194 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.529333 31736 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.625088 29665 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.574535 31528 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:11:03.626513 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 61698us
I20260709 13:11:03.640769 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.641909 29638 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:03.566807 31404 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.620431 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:03.625597 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:03.627983 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 157348us
I20260709 13:11:03.613528 31729 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:03.614738 31583 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.651672 29665 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:03.682937 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:03.630475 31615 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:03.684723 29639 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:03.688239 31675 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:03.688683 29789 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.688717 31627 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.689419 31627 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.690444 31679 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:03.691720 31627 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.613523 31725 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:11:03.689704 29639 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:03.689821 31694 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:03.694406 31678 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:03.694931 31678 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:03.695775 31678 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:03.696913 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.653610 31404 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.700459 31404 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.701252 31676 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:03.629978 31737 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.620833 31293 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:11:03.705945 31737 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.617548 31606 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:11:03.707357 31737 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:03.707746 31737 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.708511 31737 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.686311 31474 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:03.710600 31474 raft_consensus.cc:697] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:03.711781 31556 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:03.712895 31583 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.714128 31583 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.717016 31529 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:03.685580 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 801) took 1113 ms. Trace:
I20260709 13:11:03.711485 31474 consensus_queue.cc:237] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.709656 31737 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:03.663445 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.718518 29815 rpcz_store.cc:276] 0709 13:11:02.572544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.572704 (+   160us) service_pool.cc:224] Handling call
0709 13:11:02.574212 (+  1508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.712996 (+138784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.714340 (+  1344us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:02.718801 (+  4461us) log.cc:844] Serialized 26 byte log entry
0709 13:11:02.890137 (+171336us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:02.890171 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:02.890242 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.570515 (+680273us) spinlock_profiling.cc:243] Waited 8.74 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:03.685297 (+114782us) raft_consensus.cc:1685] finished
0709 13:11:03.685318 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.685517 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16325,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3383,"spinlock_wait_cycles":20096256,"thread_start_us":264025,"threads_started":2,"wal-append.queue_time_us":210358}
W20260709 13:11:03.737828 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 74471.6us
I20260709 13:11:03.625804 31421 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.639860 31528 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:03.739151 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.684031 31626 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.688181 31677 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:03.638126 31594 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.107s
W20260709 13:11:03.802795 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.724563 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:03.646637 31686 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:03.821177 31686 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.821657 31686 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.823686 31686 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:03.824265 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.734582 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.825407 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.826053 29745 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:03.826838 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.810194 31677 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.735641 31729 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:03.830047 31677 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:03.830538 31741 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.830838 31729 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.831019 31741 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.833261 31741 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.725219 31556 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:03.740409 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:03.645087 31736 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.817634 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.818447 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.856241 29747 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:03.819137 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.823900 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.780644 31678 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:03.834519 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:03.837147 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:03.839962 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:03.858151 29665 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:03.840006 29671 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:03.842751 29674 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:03.843433 29666 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:11:03.859670 29666 pending_rounds.cc:85] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 2
I20260709 13:11:03.859896 29666 pending_rounds.cc:107] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:03.860095 29666 raft_consensus.cc:2889] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:03.838104 29787 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:03.860675 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.808626 31528 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:03.863499 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 798) took 1316 ms. Trace:
I20260709 13:11:03.863924 29821 rpcz_store.cc:276] 0709 13:11:02.546727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.548699 (+  1972us) service_pool.cc:224] Handling call
0709 13:11:02.548991 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:02.953050 (+404059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.863273 (+910223us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b54001739d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:03.863450 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927846272}
I20260709 13:11:03.722532 31561 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:03.824229 31686 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:03.867460 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:03.880481 29715 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:03.884749 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:03.894181 30348 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:11:03.900550 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 264137us
I20260709 13:11:03.902475 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:03.812665 31626 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.848143 30350 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:11:03.883414 31694 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:11:03.911103 31629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.012s	sys 0.000s
I20260709 13:11:03.928658 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:03.934096 29815 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:03.891579 31679 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:03.855499 31556 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:03.915134 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 176051us
W20260709 13:11:03.935565 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 69064.3us
I20260709 13:11:03.885969 31739 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:03.939028 29814 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
W20260709 13:11:03.949579 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 92465.9us
W20260709 13:11:03.934676 31629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.012s	sys 0.000s
I20260709 13:11:03.885730 31561 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.909843 31741 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:03.935480 31627 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:03.944371 31529 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:03.925108 31686 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:11:03.951406 31739 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.954568 31741 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:03.940551 31694 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.997699 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 1392) took 1104 ms. Trace:
I20260709 13:11:03.998247 29669 rpcz_store.cc:276] 0709 13:11:02.892880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.893043 (+   163us) service_pool.cc:224] Handling call
0709 13:11:02.893396 (+   353us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:11:02.973046 (+ 79650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:02.973078 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:11:02.977165 (+  4087us) log.cc:844] Serialized 78 byte log entry
0709 13:11:03.068293 (+ 91128us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:03.111874 (+ 43581us) log.cc:844] Serialized 14 byte log entry
0709 13:11:03.283750 (+171876us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b18001c3180. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e694ac0a 00007fd9f008a219 00007fd9e69d2a40 00007fd9e69cd4e4 00007fd9e69cd455 00007fd9e9ab5060 00007fd9e9ac7716 00007fd9e9ad8287 00007fd9e9ad8208
0709 13:11:03.283999 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.997345 (+713346us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b5400213c54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:03.997400 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.997449 (+    49us) raft_consensus.cc:1685] finished
0709 13:11:03.997464 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.997634 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13007,"prepare.queue_time_us":41532,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":4867,"raft.queue_time_us":174490,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":4767,"spinlock_wait_cycles":191932160,"thread_start_us":81895,"threads_started":1,"wal-append.queue_time_us":127526}
I20260709 13:11:04.004590 31599 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:04.005043 31599 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:04.005939 31599 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.007296 31599 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.010314 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:04.011154 31740 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.011648 31740 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.013157 31421 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.014415 31556 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:03.982566 31627 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:04.015417 31627 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:03.986402 31739 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:04.006443 31745 log.cc:927] Time spent T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:11:04.031739 31561 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.034271 31679 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:03.992941 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:04.038350 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 45529.2us
I20260709 13:11:04.017621 31627 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:04.041685 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:04.042394 29821 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:04.096735 29639 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:04.098922 31717 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:04.099391 31717 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.099740 31717 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:03.987919 31741 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:04.086656 31555 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:04.106684 31555 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:04.088766 31146 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:04.108335 31146 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.108441 31421 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:04.109647 31146 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:04.116314 31752 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:11:04.011535 31279 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:04.117619 31279 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:04.121249 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:04.010197 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:04.055070 31677 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.125692 31677 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:04.086364 31738 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:11:04.136735 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:04.137341 29821 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:04.138065 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 155450us
I20260709 13:11:04.142987 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:04.120610 31623 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:04.167714 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:04.161473 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:04.139132 31697 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:04.185600 29821 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:04.143216 31626 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:04.184175 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 44552.5us
I20260709 13:11:04.186937 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:04.159472 31555 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:04.159139 31740 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.157805 31279 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:04.142140 31677 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:11:04.086361 31739 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.188361 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:04.202854 31421 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:04.203083 31528 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:04.213425 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.189445 31759 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.215045 31717 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.221134 31736 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.189194 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:04.234798 31759 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:04.313524 31766 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:04.317487 29572 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:04.320845 29640 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:04.240113 31421 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:04.323678 31421 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.332006 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.332284 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.307791 31762 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.332696 29672 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:04.310155 31759 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.326014 31676 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:04.342036 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.344616 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.350493 30350 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:04.338990 31762 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.354502 31762 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.356525 31146 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.344611 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.355041 31739 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.363368 31146 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:04.364033 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 482126us
I20260709 13:11:04.365209 31749 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.365608 31749 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.365944 31749 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.369871 29816 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:04.371958 31747 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:04.373024 31525 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:04.379124 31581 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:04.381680 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.383908 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.385040 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.385629 29749 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:11:04.386548 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.388034 29742 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:04.389125 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.336685 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.391337 29572 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:04.394449 31528 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.399641 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.400435 29748 raft_consensus.cc:2393] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 3: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:04.401225 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:04.401829 29742 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.383586 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.403519 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.403941 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:11:04.403756 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.405563 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:04.407230 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.408389 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.409175 29669 raft_consensus.cc:2410] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:11:04.411132 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:04.238996 31741 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.370302 31694 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.416730 29742 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:04.417836 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:04.427090 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.428133 31528 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:04.428668 31528 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.430797 31528 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.432878 29742 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:04.433326 29742 pending_rounds.cc:85] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 3
I20260709 13:11:04.433597 29742 pending_rounds.cc:107] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:04.433871 29742 raft_consensus.cc:2889] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:04.435197 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:04.435894 29671 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:04.439518 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 74803.4us
I20260709 13:11:04.440773 31717 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.392876 29572 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.441828 31741 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:04.439993 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 538524us
I20260709 13:11:04.446276 31739 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:04.442600 29572 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:04.447633 29572 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 4 to 5, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 5 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.444828 31736 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:04.449563 31736 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.449905 31736 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.449278 29572 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.457011 31697 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:04.457523 31697 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.458745 29569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50500 (request call id 197) took 11200 ms. Trace:
I20260709 13:11:04.459111 29569 rpcz_store.cc:276] 0709 13:10:53.258499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.258959 (+   460us) service_pool.cc:224] Handling call
0709 13:11:04.458663 (+11199704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:01.148838 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:01.302913 (+154075us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:01.302965 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:11:01.302985 (+    20us) tablet.cc:662] Decoding operations
0709 13:11:01.347180 (+ 44195us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:01.347290 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:01.347322 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:11:01.437027 (+ 89705us) tablet.cc:701] Row locks acquired
0709 13:11:01.437076 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:11:01.437255 (+   179us) write_op.cc:270] Start()
0709 13:11:01.437409 (+   154us) write_op.cc:276] Timestamp: P: 1783602661437194 usec, L: 0
0709 13:11:01.437455 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:11:01.501673 (+ 64218us) log.cc:844] Serialized 5964 byte log entry
0709 13:11:01.757115 (+255442us) op_driver.cc:464] REPLICATION: finished
0709 13:11:01.845628 (+ 88513us) write_op.cc:301] APPLY: starting
0709 13:11:01.848531 (+  2903us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:01.848859 (+   328us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:01.857492 (+  8633us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:01.893743 (+ 36251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:01.897536 (+  3793us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:11:01.897598 (+    62us) write_op.cc:312] APPLY: finished
0709 13:11:01.897960 (+   362us) log.cc:844] Serialized 106 byte log entry
0709 13:11:01.898667 (+   707us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:01.898833 (+   166us) write_op.cc:454] Released schema lock
0709 13:11:01.898897 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:01.899370 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:01.899403 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7349,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":79728,"apply.run_cpu_time_us":4966,"apply.run_wall_time_us":53780,"num_ops":15,"prepare.queue_time_us":443245,"prepare.run_cpu_time_us":26399,"prepare.run_wall_time_us":461866,"raft.queue_time_us":113567,"raft.run_cpu_time_us":14961,"raft.run_wall_time_us":103332,"replication_time_us":288900,"spinlock_wait_cycles":1711872,"thread_start_us":452636,"threads_started":4,"wal-append.queue_time_us":82665,"wal-append.run_cpu_time_us":9948,"wal-append.run_wall_time_us":1307338}]]}
I20260709 13:11:04.450838 29572 catalog_manager.cc:5697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.475613 29639 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:04.476186 29572 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.477569 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:04.478223 29821 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:04.478930 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:04.464535 31736 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.480713 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 879) took 1953 ms. Trace:
I20260709 13:11:04.481674 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:04.481283 29740 rpcz_store.cc:276] 0709 13:11:02.526969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.614012 (+1087043us) service_pool.cc:224] Handling call
0709 13:11:03.614297 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:03.614475 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:11:03.638797 (+ 24322us) log.cc:844] Serialized 14 byte log entry
0709 13:11:03.999361 (+360564us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:04.480406 (+481045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.480468 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:04.480505 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.480564 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.480666 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":484859,"prepare.queue_time_us":29878,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":485573,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4838,"spinlock_wait_cycles":34950400,"thread_start_us":358311,"threads_started":2,"wal-append.queue_time_us":307580}
I20260709 13:11:04.484230 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.485471 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.486270 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.465327 31697 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:04.467517 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:04.468736 31751 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:04.469455 29673 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:11:04.444001 29714 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:04.473522 29668 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:04.479709 29822 raft_consensus.cc:2410] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:11:04.510603 29673 pending_rounds.cc:85] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 2
I20260709 13:11:04.510903 29673 pending_rounds.cc:107] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:11:04.511193 29673 raft_consensus.cc:2889] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:04.513878 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:04.514689 29674 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:04.514523 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:04.510157 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 66228.3us
I20260709 13:11:04.515241 29671 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:04.414117 31759 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.487557 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.519017 29740 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:11:04.519879 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:04.520380 29740 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.488162 29749 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:04.486613 29821 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:04.488605 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:04.477941 29572 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:04.443862 31623 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50490 (request call id 10) took 3489 ms. Trace:
I20260709 13:11:04.499056 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:04.499634 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.527240 29814 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:04.516005 31776 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:04.436506 31731 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.530848 29787 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:04.530999 31731 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:04.533075 29638 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:04.515962 29714 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:04.534101 31740 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:04.497287 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:04.534628 31740 raft_consensus.cc:697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:04.535468 31740 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.536645 31776 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:04.537040 31776 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:04.534379 29714 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:04.538358 31726 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:04.538622 31686 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:04.524386 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.524187 29816 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:04.487114 31778 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:11:04.541828 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:04.552699 29747 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:04.544377 29638 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:04.523574 29749 raft_consensus.cc:2955] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:04.554415 29714 leader_election.cc:400] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:11:04.554827 29714 leader_election.cc:403] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:04.557525 31626 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.558159 31626 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.560398 31626 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.561550 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.568737 29747 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:04.519742 31616 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:04.579409 29714 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:04.583240 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:04.533387 31731 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:04.602221 29672 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:04.606665 29740 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:04.552232 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:04.541445 31776 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.537209 31321 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:11:04.584200 31626 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.585999 31778 consensus_queue.cc:1243] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:04.584031 31763 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:04.604868 31561 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:04.575450 31729 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:11:04.618922 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:04.604569 31279 consensus_queue.cc:1059] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:11:04.609174 31719 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:11:04.628147 31529 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:04.612831 31583 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:11:04.612550 31737 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:04.628347 31726 raft_consensus.cc:2764] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:04.612708 31728 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:11:04.649945 31561 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:04.649390 31082 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:11:04.674255 31731 consensus_queue.cc:1059] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:11:04.633217 31626 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.711755 29743 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:04.712250 29743 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:04.694864 31606 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.713073 29743 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.718909 29743 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.544950 31623 rpcz_store.cc:276] 0709 13:11:00.947100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.948952 (+  1852us) service_pool.cc:224] Handling call
0709 13:11:02.013688 (+1064736us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998eee 0000000000375939 00007fd9eea0c1e0 00007fd9eead50c4 00007fd9eead5131 00007fd9eea971c0 00007fd9eea839d9 00007fd9eea83442 00007fd9e7fffc54
0709 13:11:02.676992 (+663304us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b58001f3dd0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a190aa 00007fd9e9a9b447 00007fd9e9ab870a 00007fd9e9ab976a 00007fd9e9ab891b 00007fd9e9ac403c 00007fd9e9ac36b3 00007fd9e9abb9fa 00007fd9eea834c9 00007fd9e7fffc54
0709 13:11:02.688426 (+ 11434us) log.cc:844] Serialized 501 byte log entry
0709 13:11:03.463141 (+774715us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:04.436608 (+973467us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":296,"raft.run_cpu_time_us":1106,"raft.run_wall_time_us":1106,"spinlock_wait_cycles":144116864,"thread_start_us":167425,"threads_started":1,"wal-append.queue_time_us":221339}
I20260709 13:11:04.741132 31736 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.742265 31759 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.744326 31697 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:04.690274 31529 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.746781 31529 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.751367 31626 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:04.702682 31749 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.755215 31749 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:04.755770 30346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49706 (request call id 198) took 1079 ms. Trace:
I20260709 13:11:04.756211 30346 rpcz_store.cc:276] 0709 13:11:03.638640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:03.644682 (+  6042us) service_pool.cc:224] Handling call
0709 13:11:04.611888 (+967206us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:11:04.715867 (+103979us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75934080}
I20260709 13:11:04.708030 31731 consensus_queue.cc:1243] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:11:04.762873 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.764335 29744 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:04.764580 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:04.764914 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:04.765439 29740 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:04.765542 29747 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:04.765746 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:04.767577 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:04.769163 29639 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:04.771721 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:04.775331 29743 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:04.787350 31474 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:04.807847 31626 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:04.856243 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:04.865083 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:04.918334 29820 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:04.897899 29819 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:04.851701 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:04.806808 31279 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:04.781389 31606 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.806510 31679 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:11:04.959975 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:04.960397 29820 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:04.962422 29819 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:04.902753 31697 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.902339 31736 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.984543 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:04.910140 31626 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.965739 29789 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:04.922634 31757 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:11:04.920589 31739 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.985384 29819 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:05.048792 29823 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:11:05.038335 31697 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:04.838434 31561 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.037863 31736 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.037447 31705 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:05.039180 31550 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:04.963819 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 13:11:05.080053 31591 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:05.082533 31777 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:05.084028 31594 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:05.088043 31775 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.386s	user 0.001s	sys 0.003s
I20260709 13:11:05.085675 31529 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:05.102995 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 137332us
W20260709 13:11:05.147140 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 50809.7us
I20260709 13:11:05.153852 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:05.148303 29821 raft_consensus.cc:2376] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6. Re-sending same reply.
I20260709 13:11:05.102309 31626 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:05.146699 31779 log.cc:927] Time spent T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:11:05.121336 31797 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:05.149574 31591 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:05.120810 31525 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:05.168823 31786 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:11:05.106261 31739 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.165143 31529 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.171372 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:11:05.171614 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 360491us
I20260709 13:11:05.177714 31797 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:05.193969 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:05.200235 29819 raft_consensus.cc:606] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:05.200649 29819 raft_consensus.cc:614] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:05.120827 31550 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:05.179152 31397 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:05.110401 31776 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.201969 31397 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.203588 31776 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.204411 31397 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.165836 31594 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.214924 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:05.215632 29819 raft_consensus.cc:606] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:05.215989 29819 raft_consensus.cc:614] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:05.182327 31606 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.187027 31679 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:05.148952 31777 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.192984 31279 raft_consensus.cc:697] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:05.217196 30346 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.166831 31705 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:05.262327 31787 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.308s	user 0.002s	sys 0.000s
I20260709 13:11:05.217810 31440 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:05.184382 31525 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:05.282490 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58722.8us
W20260709 13:11:05.283556 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.285531 29749 raft_consensus.cc:1275] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:05.288230 29747 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:05.293814 29747 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:05.289301 29740 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:11:05.295683 29740 pending_rounds.cc:85] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 2
I20260709 13:11:05.295933 29740 pending_rounds.cc:107] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:11:05.296165 29740 raft_consensus.cc:2889] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.215194 31594 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.225841 31795 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:11:05.269842 31763 consensus_meta.cc:287] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.000s
I20260709 13:11:05.304550 29816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:05.280747 31440 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:05.305591 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 147859us
I20260709 13:11:05.307231 29816 raft_consensus.cc:606] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:05.320612 29816 raft_consensus.cc:614] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:05.240502 31555 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:05.307379 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:05.280241 31719 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:05.304965 31796 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:11:05.323062 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:05.327569 29741 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:05.278607 31808 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:05.228502 31679 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.236349 31279 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.338922 31728 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:05.339236 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:05.339839 31594 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:05.329118 31555 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.294970 29747 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.305636 31797 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.322664 31812 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:05.323280 31763 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.320168 31795 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.342224 31529 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.327380 31821 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:05.327170 31474 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:05.387974 31474 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.389045 31440 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.343430 31777 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:05.346820 31799 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:11:05.321014 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:05.352761 31810 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.353516 31082 consensus_queue.cc:1059] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
W20260709 13:11:05.365130 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 109394us
I20260709 13:11:05.359275 31736 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:05.343708 31791 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:05.369225 29818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:05.388355 31555 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.352913 29747 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.407819 29818 raft_consensus.cc:606] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:05.408246 29818 raft_consensus.cc:614] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:05.356544 31790 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:11:05.354779 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 201016us
I20260709 13:11:05.361796 31697 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:05.336951 31719 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.396763 31550 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:05.397733 31825 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:05.399840 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.400205 31677 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:05.400722 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:05.361301 31728 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:05.388008 31814 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:05.420706 31817 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:05.347723 31808 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:05.634289 29817 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.007s	sys 0.017s
I20260709 13:11:05.470597 29818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc891e1e674747fda6007601f64c4341"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
W20260709 13:11:05.763872 29788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.021s
W20260709 13:11:05.995167 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.466662 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.002110 29818 raft_consensus.cc:606] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:05.452440 31082 raft_consensus.cc:3055] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:05.598145 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 313655us
I20260709 13:11:06.000870 29789 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:06.001322 29817 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.010s	sys 0.036s
I20260709 13:11:06.002831 29816 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:06.049305 29818 raft_consensus.cc:614] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:06.049083 31082 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:11:06.009984 29747 consensus_meta.cc:287] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.593s	user 0.029s	sys 0.018s
W20260709 13:11:06.051270 29788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.022s	sys 0.035s
I20260709 13:11:06.050947 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.012719 29819 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:06.052284 29747 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:06.052596 31082 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.053591 29740 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:06.052923 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.053603 31082 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.056891 31803 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:05.422184 31616 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:06.056514 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:05.973372 31561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.000s	sys 0.012s
W20260709 13:11:06.059219 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.020195 29742 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:06.056591 31740 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:11:06.061337 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 638056us
I20260709 13:11:06.061546 31794 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.062757 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.063446 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.064481 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.075169 29666 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.421689 31795 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.064968 31739 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.065902 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.084103 29673 raft_consensus.cc:2410] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:05.469512 30346 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
W20260709 13:11:05.674369 31798 log.cc:927] Time spent T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:11:06.066577 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.067211 29669 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:06.067754 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.068410 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.094936 29671 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:06.095162 29665 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:06.068678 29816 raft_consensus.cc:1275] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:06.068902 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.096096 29670 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:06.078359 31831 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:11:05.696135 31626 consensus_meta.cc:287] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.003s
I20260709 13:11:06.054232 29817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1353) took 1195 ms. Trace:
W20260709 13:11:06.072865 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.064751 31751 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:06.074633 29668 raft_consensus.cc:2410] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:06.071532 31616 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:05.465850 31813 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:05.641108 31591 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.007308 31728 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:05.616979 31525 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:06.066238 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:05.607241 31705 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:06.085031 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.086299 29666 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:06.119226 29672 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:06.078431 31827 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.086913 31678 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:06.060907 31778 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.020251 31697 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:06.076270 31561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.000s	sys 0.013s
I20260709 13:11:06.030625 31777 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.030390 31474 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.065559 29638 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:05.392370 31821 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.099804 31811 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.122552 30350 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:05.422961 31810 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:05.471280 31791 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.027494 31677 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.114413 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:06.104997 29817 rpcz_store.cc:276] 0709 13:11:04.858595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.859550 (+   955us) service_pool.cc:224] Handling call
0709 13:11:04.950104 (+ 90554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.053774 (+1103670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.053807 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.053953 (+   146us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:06.054001 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.054070 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.054182 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149878,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":3822,"thread_start_us":1103248,"threads_started":1}
I20260709 13:11:06.119186 29674 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:06.026561 31825 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.102800 31795 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.027006 31817 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.026767 31814 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.074577 31803 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.079044 31740 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:06.113412 31739 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.078326 31794 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.115031 31679 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.121219 31728 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:06.134876 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 69417.5us
I20260709 13:11:06.153721 31803 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.100857 29816 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:06.135697 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.140317 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:06.105644 31831 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.130671 31778 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.160126 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.133425 31697 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:06.150308 31835 log.cc:927] Time spent T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:11:06.147697 31795 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.137997 31811 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.170555 31811 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.139845 31616 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.120821 31813 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:05.655637 31726 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:06.144433 31615 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:06.116971 31751 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.122605 31678 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.188313 31678 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:06.104568 31626 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.191045 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:06.135512 31792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.015s	sys 0.068s
I20260709 13:11:06.161118 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.125104 31827 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.163365 31825 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.137681 31777 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.167472 31808 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.168736 31795 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.152837 31791 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:06.148432 31832 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.184156 31615 raft_consensus.cc:697] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:06.186434 31751 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:06.203570 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 189) took 1088 ms. Trace:
W20260709 13:11:06.203884 29714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.529s (SENT) [suppressed 3 similar messages]
I20260709 13:11:06.225382 31813 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.231710 31827 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.220594 29822 raft_consensus.cc:2368] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
W20260709 13:11:06.209316 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.218632 31783 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 1.543s	user 0.003s	sys 0.000s
I20260709 13:11:06.233886 29748 rpcz_store.cc:276] 0709 13:11:05.115544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.115749 (+   205us) service_pool.cc:224] Handling call
0709 13:11:05.116093 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:05.303731 (+187638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.303761 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:05.303806 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:05.303833 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.203253 (+899420us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54001676d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:06.203312 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.203492 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":431119616}
W20260709 13:11:06.200222 31792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.015s	sys 0.068s
I20260709 13:11:06.221457 31810 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.215852 31814 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.259325 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:06.262262 31808 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.262841 31811 consensus_queue.cc:1059] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:06.249775 31525 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.264393 31697 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.265154 31677 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.220232 31626 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.217634 31777 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.270982 31821 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.271247 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:06.279289 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:06.275250 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.283625 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.284804 31677 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.285372 31677 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.287392 31677 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.254128 31827 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.289330 31827 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.291389 31827 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:06.295697 31828 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:11:06.300845 31778 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:06.310297 31787 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:06.251295 31728 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.312721 31728 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.314675 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 914) took 1816 ms. Trace:
I20260709 13:11:06.314313 31525 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.275034 31615 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.315114 29743 rpcz_store.cc:276] 0709 13:11:04.498213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.498327 (+   114us) service_pool.cc:224] Handling call
0709 13:11:04.498626 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.775751 (+277125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.314403 (+1538652us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54003b9054. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:06.314609 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489823104}
I20260709 13:11:06.260426 31795 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.318593 31795 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.320647 31795 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.274891 31719 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.245256 31832 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.322487 29814 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:06.323506 31832 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.326210 31587 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.326771 31587 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.328884 31587 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.332911 31810 raft_consensus.cc:3055] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:06.333412 31810 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:11:06.333712 29821 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51156 (request call id 1350) took 1482 ms (client timeout 1630 ms). Trace:
W20260709 13:11:06.334194 29821 rpcz_store.cc:269] 0709 13:11:04.851277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.851420 (+   143us) service_pool.cc:224] Handling call
0709 13:11:06.333532 (+1482112us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540019bed4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:06.333649 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524810496}
I20260709 13:11:06.278450 31808 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.336254 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.336370 31813 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.336510 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.336925 29674 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:06.339362 31525 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.336994 31813 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.346856 31831 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:06.347110 31813 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.354878 31810 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.356202 31810 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.362500 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:06.369774 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 368980us
I20260709 13:11:06.370419 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:06.370716 29789 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:06.373049 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 169181us
W20260709 13:11:06.385118 29714 leader_election.cc:336] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.630s (SENT)
I20260709 13:11:06.422513 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.431661 29789 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.374205 31831 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:06.451673 29789 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.458235 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.459635 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.462066 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.423159 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:06.473578 29789 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.462787 29816 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:06.474325 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.487352 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.494112 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.507164 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.508462 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.509871 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:06.510474 29747 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.513823 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.519448 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.441355 31626 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.430874 31821 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.520489 29749 raft_consensus.cc:2410] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:06.526376 29747 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:06.530274 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.531230 29787 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:06.531471 29817 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:06.454593 31697 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:06.535085 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.536654 29741 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:06.539943 29817 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 1.
I20260709 13:11:06.537264 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.460335 31814 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.474381 31825 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.543282 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:06.562393 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.368510 30345 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:06.562606 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.588399 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.526467 31736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.004s	sys 0.015s
W20260709 13:11:06.605697 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.594416 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.606747 29816 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:06.520473 31694 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.529462 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.533365 31841 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:06.602406 31797 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.604315 30315 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.627031 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.543906 31821 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.475973 31561 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:06.610162 31736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.004s	sys 0.035s
I20260709 13:11:06.610606 31831 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.630690 31624 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:06.596103 31832 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:06.610211 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 136727us
I20260709 13:11:06.638600 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.621443 29821 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:06.628294 30315 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.604895 29742 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:06.597079 31840 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.637817 31624 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.640532 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.629232 31443 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:06.629866 31841 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.625773 31694 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:06.650182 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.650725 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.669198 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.650130 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.652266 29789 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.652765 31587 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:06.673075 31587 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.673539 31587 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:06.665093 31840 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.638098 31832 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.655395 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.656824 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.657866 31616 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.658650 31624 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.659008 31443 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.651795 29814 raft_consensus.cc:2393] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:06.679936 29789 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.695755 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.665875 31561 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.698206 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.699620 29789 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.702008 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.704352 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.704496 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.706812 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.707906 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.708679 29743 raft_consensus.cc:2410] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:11:06.681953 31832 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.681579 31831 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.712949 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.694897 31443 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.715086 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.711860 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.694842 31744 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:06.721776 29742 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:06.722628 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.724056 29789 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.703117 31815 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.728546 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.709493 31838 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.730130 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.703593 31814 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.734896 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:06.737179 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 657559us
I20260709 13:11:06.718604 31279 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.738284 31279 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.720818 31697 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:06.741405 31279 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.703442 31825 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:06.732848 31811 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.732631 31759 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.728253 31744 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.734875 31797 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:06.748826 31694 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.718832 31321 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.727835 31626 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.751466 31840 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.733141 31831 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:06.756099 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.775815 29744 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:06.757234 29743 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:06.732513 31826 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:06.747619 31841 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:06.772998 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.733362 31561 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:06.780882 31808 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.781270 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:06.783601 31826 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.784441 31443 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.777531 31797 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.734340 31839 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:11:06.776467 31810 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:11:06.774094 31759 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.789305 31587 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.778666 31321 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.821977 31321 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.802352 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.804067 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.825201 31794 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.833370 31817 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.792717 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.774096 31744 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.775378 31840 consensus_queue.cc:1048] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:11:06.815593 31832 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.762936 31811 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:06.819942 31587 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.791605 31561 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.834700 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.797909 31725 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.842979 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.834313 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.843233 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.843171 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.843802 29671 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:06.844126 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 120173us
I20260709 13:11:06.845101 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:06.845417 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.845700 29746 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
W20260709 13:11:06.847632 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 43649.5us
I20260709 13:11:06.850256 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.858768 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:11:06.860016 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.859952 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.810557 31839 consensus_queue.cc:1243] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:06.863161 29665 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:06.868650 29671 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:06.870360 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:06.871248 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:06.848312 31561 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.854218 31146 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.849359 31817 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.858196 30344 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:06.850069 31725 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.862735 31812 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:06.841668 31675 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:11:06.889252 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:06.843089 31751 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:11:06.849161 31791 consensus_queue.cc:1048] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:11:06.873401 31815 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.873593 31825 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:06.854357 31814 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:11:06.880465 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.902985 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.903352 29668 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:06.893009 29822 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51156 (request call id 1362) took 1933 ms (client timeout 1540 ms). Trace:
I20260709 13:11:06.893905 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.894404 29818 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:06.884063 31626 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:06.895706 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:06.897639 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.883832 31838 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:06.897689 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.901453 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:06.903981 29822 rpcz_store.cc:269] 0709 13:11:04.959508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.959660 (+   152us) service_pool.cc:224] Handling call
0709 13:11:06.892816 (+1933156us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400324e54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:06.892947 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897347456}
I20260709 13:11:06.895468 31817 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.914366 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.914937 29822 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:06.915724 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.909046 29671 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:06.928262 31818 log.cc:927] Time spent T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 1.317s	user 0.023s	sys 0.019s
I20260709 13:11:06.931152 31725 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.906513 31626 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:06.934247 31626 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:06.934664 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 86140.3us
I20260709 13:11:06.921778 31817 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.937714 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.917735 31825 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:06.901432 31686 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:11:06.943555 29820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1365) took 1978 ms. Trace:
I20260709 13:11:06.944298 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 1352) took 2088 ms. Trace:
I20260709 13:11:06.948841 31686 consensus_queue.cc:1243] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:06.945986 29820 rpcz_store.cc:276] 0709 13:11:04.964722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.045051 (+ 80329us) service_pool.cc:224] Handling call
0709 13:11:05.045420 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.103535 (+ 58115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.103569 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.104105 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:11:05.353118 (+249013us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:05.353162 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:05.353231 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.926129 (+1572898us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:06.935072 (+  8943us) raft_consensus.cc:1685] finished
0709 13:11:06.935094 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.943492 (+  8398us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57699,"raft.queue_time_us":71546,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":41713,"spinlock_wait_cycles":14343552,"thread_start_us":193984,"threads_started":1,"wal-append.queue_time_us":334703}
I20260709 13:11:06.950479 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.952601 31832 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.944535 31854 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:06.927318 31838 raft_consensus.cc:697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:06.946995 29815 rpcz_store.cc:276] 0709 13:11:04.856173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:04.857491 (+  1318us) service_pool.cc:224] Handling call
0709 13:11:04.857823 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.858071 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:05.175954 (+317883us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.877831 (+1701877us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b18002fa400. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e96654bc 00007fd9e69b348b 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d23a
0709 13:11:06.881189 (+  3358us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.943891 (+ 62702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.943938 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:06.943983 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.944119 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.944240 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51466,"prepare.queue_time_us":364647,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":7614,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":4406,"spinlock_wait_cycles":39013120,"thread_start_us":399559,"threads_started":3,"wal-append.queue_time_us":151077,"wal-append.run_cpu_time_us":987,"wal-append.run_wall_time_us":1014790}
I20260709 13:11:06.962093 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.962939 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:06.946394 31855 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:11:06.944061 31826 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.947074 31759 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.939805 31808 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:06.952956 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:06.966850 29815 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:06.945966 31741 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:06.967792 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.967384 31797 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:06.938696 31443 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.989420 31821 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:06.990553 31561 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:06.992604 29822 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:06.977025 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.967257 29668 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:06.977450 31811 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:06.978519 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:06.995270 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:06.995899 29668 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:06.983021 29820 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:06.992038 31838 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:06.965405 29638 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:06.999500 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.001039 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:06.996994 31825 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.001550 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.015553 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.016800 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.017684 29820 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:07.018671 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.019985 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.016652 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.031226 29638 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.031852 31616 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:07.032166 29638 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.032454 31751 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.032866 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.033517 29816 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:07.039718 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.040472 29820 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:07.041445 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.045125 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.046012 29820 raft_consensus.cc:2368] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:11:07.046893 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.050166 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:07.000066 31811 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.053685 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.054350 29821 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:07.030084 31624 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:07.056792 29638 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:07.058174 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.059100 29820 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:07.057512 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.015877 31146 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.062726 29816 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:07.064700 29816 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.065876 29823 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:11:07.065092 31744 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:07.067559 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.068228 29672 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:07.069957 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.071683 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.073035 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:07.075022 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 195238us
W20260709 13:11:07.077776 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.081339 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.082937 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.084599 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.085157 29668 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.085193 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.086192 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.087384 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.087572 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.088873 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.057703 31751 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.095927 29670 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:07.097674 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.090956 29749 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:11:07.098511 29749 pending_rounds.cc:85] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 2
I20260709 13:11:07.098794 29749 pending_rounds.cc:107] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:11:07.099054 29749 raft_consensus.cc:2889] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.100246 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.056311 31808 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.092481 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.093622 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.102375 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.082789 29746 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:07.094745 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.066128 31811 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.089656 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.103966 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.104617 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.113776 29672 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.105520 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.111757 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.117113 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.100912 29749 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:07.118363 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.119065 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.119635 29740 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.120144 29787 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:07.119554 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.123674 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.124579 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.126493 29673 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:07.135813 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.139950 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.134543 31854 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.141052 31814 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.141320 31854 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.141773 31854 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.095912 31751 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.146900 31751 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.148065 31740 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:07.150214 31854 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.152415 31854 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:07.103935 31797 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:11:07.122085 31821 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.155954 29669 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.066885 31626 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.111826 31737 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.112390 31811 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.105324 31725 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.129094 31838 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.157135 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.168270 29668 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:07.157796 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.179167 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.179744 29743 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.166441 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.150785 31561 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:07.134835 31832 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.181632 29673 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:07.156821 31624 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.183334 29740 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:07.186241 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.187161 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.153822 31817 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:07.112128 31794 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:11:07.176051 31811 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.182128 29818 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:07.188977 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.186609 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.138550 31697 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:11:07.190804 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.229296 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.203554 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.231446 29666 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:07.187186 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.182273 31725 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.232399 29668 raft_consensus.cc:2376] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5. Re-sending same reply.
I20260709 13:11:07.228921 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.233325 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.233814 29672 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:07.211313 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.234716 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.207495 29743 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:07.235404 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.236431 29672 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:07.237394 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.238250 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.239252 29672 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:11:07.244850 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 54097.3us
I20260709 13:11:07.197590 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.247450 29740 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:07.248906 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.176231 31737 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.253362 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.229738 31555 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:11:07.257727 31838 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:11:07.293349 31797 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.251070 31817 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:07.324265 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 218722us
I20260709 13:11:07.230757 31832 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:07.253814 31864 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.143s	user 0.000s	sys 0.003s
I20260709 13:11:07.249466 31694 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:07.313735 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.312840 31854 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:07.190412 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:07.238793 29814 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:07.232574 31697 consensus_queue.cc:1243] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:11:07.289959 31725 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.318578 31736 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:07.315703 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62431.5us
I20260709 13:11:07.229851 31279 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:11:07.336107 29789 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:07.337059 29789 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:11:07.333897 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 87449.4us
I20260709 13:11:07.340224 29714 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.339913 31832 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:07.334766 31744 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.342335 31694 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.342744 31694 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:07.343130 31694 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:07.349438 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.377280 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.378010 29821 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:07.377607 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.378978 29815 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.379123 29818 raft_consensus.cc:2393] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:07.379580 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.382066 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.380769 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.383417 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.383016 31876 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.334298 31854 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.385061 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.390520 31854 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:07.379972 31751 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.386720 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.392030 29821 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:07.347683 31832 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:07.393410 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.396231 29818 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 6: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:07.398034 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.399761 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.400413 29818 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:07.401635 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.402279 29818 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:07.403625 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.392074 31878 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.411504 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.348018 31869 consensus_queue.cc:1059] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 13:11:07.436936 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 52724us
I20260709 13:11:07.437286 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.396499 31832 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.438463 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:07.439486 31878 raft_consensus.cc:3055] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:07.439851 31878 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:07.440647 31878 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:07.443472 31871 log.cc:927] Time spent T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:11:07.445199 31873 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.445654 31873 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.446014 31873 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.457793 31626 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:07.458688 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 72180.6us
I20260709 13:11:07.460522 29714 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.461930 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.463037 29818 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:07.464887 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.465763 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.498056 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.499964 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.506713 29823 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.508096 29816 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:07.500546 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.511480 29822 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.480005 31878 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:07.496583 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 56028.3us
I20260709 13:11:07.479640 31876 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.468763 31791 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.497710 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.504267 31795 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.515697 31791 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:07.517123 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:07.468447 29818 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:07.518473 29715 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:07.520341 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.491432 31694 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:07.523988 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:07.530591 29715 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.531379 31794 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:07.531958 29819 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:07.532469 29640 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.534288 31877 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.534474 31868 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.535029 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.531925 31794 raft_consensus.cc:697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:07.522281 31795 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.540535 31795 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.522027 31876 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.537521 31794 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.541138 31876 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.541541 31876 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.174984 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:07.551147 29823 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:07.531463 31791 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:07.555709 31873 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.554214 31880 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.557044 31880 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:07.557832 31873 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.559165 31880 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:07.562815 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.563493 29821 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:07.562878 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.477432 31751 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:07.574666 31875 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:11:07.566915 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.573431 29823 raft_consensus.cc:2393] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 6: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
W20260709 13:11:07.582651 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 99756.2us
I20260709 13:11:07.583556 31603 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.578619 31880 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.584189 31603 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:07.585532 31737 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.496426 31811 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.586427 31603 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:07.586907 29667 raft_consensus.cc:2368] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:11:07.583942 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.588186 29814 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.588328 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.588979 29671 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:07.590272 29819 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:11:07.590871 30316 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:07.590811 29714 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.593047 29822 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:07.588902 31811 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.602353 30315 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.603560 29714 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.605571 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:07.607417 31744 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.599146 31873 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.608031 30344 raft_consensus.cc:1240] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:07.608518 30350 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:07.604641 31603 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.609970 31876 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.585532 31694 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:07.610569 31603 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.611043 31603 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.610869 30346 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:07.612042 29639 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.607863 31744 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:07.613643 31751 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.612881 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:07.614439 29822 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.615630 31876 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.615680 31751 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:07.616423 31751 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.613502 31744 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.619223 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.623798 29714 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.624115 29822 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:07.627878 29714 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.634661 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.636602 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.646580 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.604744 31737 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.649906 29787 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.663486 29787 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.650781 29715 leader_election.cc:400] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:11:07.664292 29715 leader_election.cc:403] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.625384 31872 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:07.669027 29787 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.631956 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:07.632691 31591 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.657007 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:11:07.694130 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 87373.4us
W20260709 13:11:07.705181 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 77473.9us
I20260709 13:11:07.640466 31883 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.658509 31791 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.672938 31825 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.706861 29714 leader_election.cc:400] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:11:07.709555 31759 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.709892 29714 leader_election.cc:403] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:07.709540 31791 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:07.710749 31791 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:07.714295 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 63633.8us
I20260709 13:11:07.715796 29714 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:11:07.702080 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.719166 31868 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.724189 31725 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5.
I20260709 13:11:07.725034 31725 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.725383 31725 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.725752 31725 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.612965 31882 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:11:07.708242 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 51353.4us
I20260709 13:11:07.628790 31811 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:11:07.674372 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:07.736131 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.738018 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.734629 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:07.740669 29747 raft_consensus.cc:1240] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:07.640631 31810 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.731473 29639 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.640540 31877 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:07.732692 30314 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.733872 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.742374 29746 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:07.744457 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.658852 31841 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.674690 31832 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:07.673251 31872 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.669816 31839 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.648306 31857 consensus_queue.cc:1059] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
W20260709 13:11:07.751040 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 76772.4us
I20260709 13:11:07.752017 30345 raft_consensus.cc:1240] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:07.757251 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.752224 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:07.668430 31694 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.763453 29671 pending_rounds.cc:85] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:11:07.752620 29639 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.763746 29665 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:07.764449 29666 pending_rounds.cc:85] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:11:07.763768 29671 pending_rounds.cc:107] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:07.764582 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:07.765071 29671 raft_consensus.cc:2889] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.708858 31883 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:07.709270 31797 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.758229 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:07.764739 29666 pending_rounds.cc:107] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:07.769320 29666 raft_consensus.cc:2889] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:07.765813 29673 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.770363 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.772854 29742 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:07.777693 29674 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:07.710147 31591 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:07.786991 29639 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:11:07.788357 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 70491.7us
W20260709 13:11:07.785677 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 80185.7us
I20260709 13:11:07.790714 30315 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.755717 31872 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:07.765264 31877 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.798544 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:07.762643 31795 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.805001 29747 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:07.801798 29639 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.762768 31832 raft_consensus.cc:697] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:07.772938 31883 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.770823 31817 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.778074 31854 consensus_queue.cc:1059] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:11:07.786042 31736 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:11:07.797778 31811 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.925115 31591 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:07.889669 31791 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.807024 31795 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:07.997646 31795 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.998768 31791 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:07.826327 31561 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.177s
I20260709 13:11:07.808930 31838 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.811069 29714 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:07.856410 30345 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:07.801582 31877 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.003823 31877 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:07.855294 31884 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:11:07.825578 31794 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
I20260709 13:11:07.856094 31832 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.823155 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 81) took 7406 ms. Trace:
I20260709 13:11:07.807864 31857 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.996398 31736 consensus_queue.cc:1243] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:11:07.854244 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 52524.7us
I20260709 13:11:08.020350 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.021174 29747 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:07.794627 31694 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:07.798012 29673 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
W20260709 13:11:08.068830 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 56651.5us
I20260709 13:11:08.007719 29572 rpcz_store.cc:276] 0709 13:11:00.449976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.498026 (+ 48050us) service_pool.cc:224] Handling call
0709 13:11:00.791819 (+293793us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b5400310010. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e69990b2 00007fd9ef912a89 00007fd9ef8aada6 00007fd9ef87c088 00007fd9ef97a37e 00007fd9ede3b2a4 00007fd9ede3b232 00007fd9ede3b161 00007fd9ede3b0dc
0709 13:11:07.822532 (+7030713us) spinlock_profiling.cc:243] Waited 941 us on lock 0x7b4c004a0340. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e7d89a20 00007fd9e7d9aa29 00007fd9e7d9b13f 00007fd9e7d5f2ab 00007fd9e7d8cf3c 00007fd9e7d8d3fe 00007fd9e801aa4b 00007fd9ef8709b2 00007fd9ef86cf50 00007fd9ef87302b 00007fd9ef97ac3e
0709 13:11:07.823089 (+   557us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:05.057742 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:05.058331 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:05.058370 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:11:05.058426 (+    56us) tablet.cc:662] Decoding operations
0709 13:11:05.172638 (+114212us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:05.176526 (+  3888us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:05.178909 (+  2383us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:05.347012 (+168103us) tablet.cc:701] Row locks acquired
0709 13:11:05.351094 (+  4082us) write_op.cc:260] PREPARE: finished
0709 13:11:05.364006 (+ 12912us) write_op.cc:270] Start()
0709 13:11:05.387163 (+ 23157us) write_op.cc:276] Timestamp: P: 1783602665361599 usec, L: 0
0709 13:11:05.391472 (+  4309us) op_driver.cc:348] REPLICATION: starting
0709 13:11:05.615513 (+224041us) log.cc:844] Serialized 3852 byte log entry
0709 13:11:06.306210 (+690697us) op_driver.cc:464] REPLICATION: finished
0709 13:11:06.614729 (+308519us) write_op.cc:301] APPLY: starting
0709 13:11:06.614813 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:06.615021 (+   208us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:06.615145 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:06.643717 (+ 28572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:06.643955 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:11:06.644005 (+    50us) write_op.cc:312] APPLY: finished
0709 13:11:06.644314 (+   309us) log.cc:844] Serialized 70 byte log entry
0709 13:11:06.644507 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:06.644648 (+   141us) write_op.cc:454] Released schema lock
0709 13:11:06.644701 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:06.645088 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:06.645115 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1430955,"reported_tablets":10,"spinlock_wait_cycles":21225600,"child_traces":[["op",{"apply.queue_time_us":301311,"apply.run_cpu_time_us":3271,"apply.run_wall_time_us":30344,"num_ops":9,"prepare.queue_time_us":433266,"prepare.run_cpu_time_us":105186,"prepare.run_wall_time_us":1219847,"raft.queue_time_us":137978,"raft.run_cpu_time_us":26759,"raft.run_wall_time_us":223635,"replication_time_us":914563,"thread_start_us":1233417,"threads_started":4,"wal-append.queue_time_us":545529,"wal-append.run_cpu_time_us":22754,"wal-append.run_wall_time_us":1484028}]]}
I20260709 13:11:07.874716 31599 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.855409 31894 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.943212 31893 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:08.080180 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 289487us
I20260709 13:11:08.075678 29747 pending_rounds.cc:85] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 2
I20260709 13:11:08.096791 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:08.097090 29747 pending_rounds.cc:107] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:11:08.097520 29747 raft_consensus.cc:2889] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.096242 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:11:08.077315 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 266312us
I20260709 13:11:08.100191 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:08.090683 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.068676 31857 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:11:08.105119 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.100257 29714 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:08.105901 29820 raft_consensus.cc:2393] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:08.086540 29639 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:08.076225 31868 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:11:08.112514 29639 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:08.081396 31878 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.121102 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.121883 29820 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:08.121716 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.112514 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:07.943447 31603 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.126885 29743 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:08.127400 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.127993 29823 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:08.114122 31873 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.139050 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:08.131783 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.135396 31877 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.113907 31893 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:08.114130 31759 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:08.101161 31817 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:11:08.140549 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.115813 31894 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:08.144862 29748 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:08.148980 31694 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.145318 31591 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.151327 31744 consensus_meta.cc:287] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
W20260709 13:11:08.154565 31891 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:11:08.156482 31841 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.158919 31808 raft_consensus.cc:3055] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:08.159749 31883 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.162025 31899 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.163458 31736 raft_consensus.cc:3055] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.126190 31686 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.163496 31893 raft_consensus.cc:697] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:08.130322 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:08.178218 31751 consensus_meta.cc:287] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.003s
I20260709 13:11:08.145395 31878 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:08.165284 31759 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.170910 31894 raft_consensus.cc:697] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:08.131431 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:08.167714 30344 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:08.140951 31791 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:11:08.181383 31736 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:08.178996 31808 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:08.178403 31591 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.193451 31759 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.179949 31744 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.191012 31725 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.404332 31725 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:08.273959 29559 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 7
I20260709 13:11:08.405011 31744 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:08.280970 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 141882us
W20260709 13:11:08.407712 29814 consensus_meta.cc:287] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.802s	user 0.014s	sys 0.005s
I20260709 13:11:08.408252 29814 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:08.410501 31868 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.411478 31868 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.411827 31857 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:08.290939 29749 raft_consensus.cc:1240] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:08.166649 29815 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:08.139850 29714 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:08.415638 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.187541 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.308694 29821 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:08.328227 29817 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:08.331512 29823 raft_consensus.cc:1240] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.338840 31591 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.341439 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:08.351272 31603 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.355095 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:08.430219 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 290302us
I20260709 13:11:08.357177 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:08.358101 31599 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:08.359777 31615 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.372761 31321 consensus_queue.cc:1059] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:08.375383 29789 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:08.192613 31751 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.467917 31599 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.472594 31615 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.473354 31599 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.242800 31795 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.474867 31751 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.475610 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:08.476163 31795 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.476508 29666 raft_consensus.cc:2410] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:08.243754 31808 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.476933 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:08.246954 31872 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.478189 31868 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.479079 31868 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:08.479460 31868 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:08.479719 31872 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.249644 31873 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.251250 31877 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.484720 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.195034 31878 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.487810 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:08.248462 31883 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.240767 31893 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.490491 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.491441 31615 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:08.492787 31878 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:08.235520 31894 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.494654 31797 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:08.496331 29670 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:08.245842 31899 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:08.498994 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 67560.4us
I20260709 13:11:08.399602 31736 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.400580 31686 raft_consensus.cc:3055] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:08.401767 31810 raft_consensus.cc:3055] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:08.406553 29740 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:08.416843 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 143259us
I20260709 13:11:08.401813 31697 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:08.507192 31697 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:08.434536 30314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.014s	sys 0.016s
I20260709 13:11:08.479393 29741 raft_consensus.cc:1240] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:08.493867 29743 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
W20260709 13:11:08.500373 31922 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:11:08.481361 31868 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.500830 31686 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:11:08.516539 30314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.016s	sys 0.016s
W20260709 13:11:08.508671 31923 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 13:11:08.525063 31854 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:11:08.525465 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.515116 31883 consensus_queue.cc:1059] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:11:08.527290 31883 raft_consensus.cc:3055] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.527632 31883 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:08.528658 31883 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.508760 31838 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:08.529451 31817 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:08.530285 31838 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:08.531592 31838 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:08.532371 31759 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.502305 31810 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:08.539965 31810 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.540783 31759 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:08.541186 31892 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.663s	user 0.008s	sys 0.004s
I20260709 13:11:08.541453 31810 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.509961 30346 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:08.515232 31886 consensus_queue.cc:1059] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:08.543932 31886 raft_consensus.cc:3055] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:08.544341 31886 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:08.549047 29742 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:11:08.501657 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 126894us
I20260709 13:11:08.480043 29639 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:08.513489 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:08.550983 29742 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:08.508198 31736 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.552874 31872 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.553875 31872 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:08.555315 31810 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:08.556284 31810 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:08.557392 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:08.557891 31889 log.cc:927] Time spent T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.701s	user 0.006s	sys 0.000s
I20260709 13:11:08.561057 29820 raft_consensus.cc:2410] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:11:08.565696 31808 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.565940 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.566793 29742 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
W20260709 13:11:08.567417 31900 log.cc:927] Time spent T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:11:08.520988 31686 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.521410 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:08.521894 31896 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:08.576504 31896 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:08.524184 31697 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:08.524578 31626 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.534041 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:08.538271 31854 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.550280 29814 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:08.567306 31729 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:08.508886 29638 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:08.518805 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 765146us
I20260709 13:11:08.574934 30346 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:08.551011 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 84973.5us
W20260709 13:11:08.589965 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 192212us
I20260709 13:11:08.596210 31737 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:08.597267 31737 raft_consensus.cc:3055] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:08.597508 31821 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:11:08.598747 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 64871.2us
I20260709 13:11:08.599119 31821 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:11:08.601120 31925 log.cc:927] Time spent T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:11:08.595847 31896 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.602216 31882 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.605206 31561 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.606195 31626 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:08.607257 31924 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:08.607847 30315 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:08.608574 31626 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.608376 31918 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:11:08.610102 31895 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.610510 31854 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.586581 31729 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.613173 31729 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:08.614455 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:08.616065 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:08.597710 31737 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:08.619410 31737 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.619614 31893 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:08.620868 31737 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.622898 29570 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 2 to 5, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.626191 29639 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:08.627285 31840 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.627895 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:08.586145 31883 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.630155 29670 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.626801 29570 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:08.642277 31886 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.643855 31886 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.644731 31854 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.645550 31854 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.648614 31854 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.614884 31561 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.650524 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.654593 29666 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:08.671418 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:08.672263 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.672753 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.675010 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:08.677218 29747 raft_consensus.cc:2410] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:08.614964 31686 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.679816 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:08.666586 31759 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:08.559403 31810 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.679715 29639 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:08.687795 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:08.686652 29638 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:08.690490 31877 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:08.691115 31877 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:08.693218 31832 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.693893 31832 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.694240 31146 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.688509 30314 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:08.696183 29744 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:08.692170 31877 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.698716 30316 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:08.705480 31321 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.713518 31821 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.687250 31697 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.723433 31759 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.724020 31759 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.724304 29714 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:08.724648 31697 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.725239 31599 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.727003 31872 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:08.727514 31872 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:08.728017 31872 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:08.729512 31697 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.730944 31896 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:08.727816 31821 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.727566 31599 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:08.738090 29670 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:08.682868 31857 consensus_queue.cc:1059] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:11:08.709079 29570 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:08.742725 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 60421us
W20260709 13:11:08.747258 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58817.9us
I20260709 13:11:08.748049 31821 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.713138 31906 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:08.747794 29816 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:08.760640 31899 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:08.766362 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.773222 29822 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:08.773581 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.776297 31561 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:08.780545 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.794862 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.796844 29814 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:08.775074 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.801283 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.762552 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.771445 29570 catalog_manager.cc:5697] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.777786 29818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 902) took 1204 ms. Trace:
W20260709 13:11:08.780532 31928 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:08.777421 29670 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:08.807210 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 47526.5us
I20260709 13:11:08.806910 29818 rpcz_store.cc:276] 0709 13:11:07.573057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.573555 (+   498us) service_pool.cc:224] Handling call
0709 13:11:07.573856 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.574238 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:07.574273 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.574730 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.638316 (+ 63586us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:07.638361 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.638434 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.557017 (+918583us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:08.761682 (+204665us) raft_consensus.cc:1685] finished
0709 13:11:08.761703 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.777587 (+ 15884us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1009,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":69562112,"thread_start_us":63279,"threads_started":1,"wal-append.queue_time_us":221857}
I20260709 13:11:08.761490 31895 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:11:08.813505 31931 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:11:08.814006 29821 raft_consensus.cc:2393] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:08.815327 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.871219 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.762818 31857 raft_consensus.cc:3055] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:08.873226 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.872061 29821 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:11:08.877413 29819 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:11:08.888916 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.902333 31832 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.785065 31726 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:11:08.903925 31726 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:08.904302 31726 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:11:08.907325 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.911942 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.910959 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:08.874289 31895 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:08.921489 29819 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:08.875473 31808 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.925712 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:08.876792 31857 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:08.931727 31561 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.938687 31561 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.940857 31561 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:08.913008 31795 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:08.948624 31840 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:08.949271 31840 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:08.949484 29570 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 1 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.950244 31840 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.951969 29570 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:08.942624 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:08.962966 31893 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:08.966091 31795 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:08.968325 31795 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:08.979676 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.980896 31759 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:08.982568 31726 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:08.983911 31726 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.997411 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:08.994578 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:11:09.006505 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.006836 29746 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:09.015103 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.943914 31808 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.029748 31857 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:09.031333 31906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50490 (request call id 11) took 1420 ms. Trace:
I20260709 13:11:09.031939 31906 rpcz_store.cc:276] 0709 13:11:07.608291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.608495 (+   204us) service_pool.cc:224] Handling call
0709 13:11:07.720641 (+112146us) log.cc:844] Serialized 501 byte log entry
0709 13:11:08.353091 (+632450us) spinlock_profiling.cc:243] Waited 40.3 ms on lock 0x7b54004d0e20. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a36142 00007fd9e9a16eaa 00007fd9e9a1dd53 00007fd9e9a1dcd9 00007fd9e9a1dc69 00007fd9e9a1dc31 00007fd9e9a1cdfd 000000000038f354 000000000038f199 00007fd9e69d0475
0709 13:11:08.367894 (+ 14803us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b18001916e0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69d03f3 00007fd9e69d27c1 00007fd9e69d2779 00007fd9e69d2709 00007fd9e69d26d1 00007fd9e69d19cd 000000000038f354 000000000038f199 00007fd9e69b383a
0709 13:11:09.028953 (+661059us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97573,"raft.queue_time_us":216917,"raft.run_cpu_time_us":4539,"raft.run_wall_time_us":387162,"spinlock_wait_cycles":160320896,"thread_start_us":225017,"threads_started":2,"wal-append.queue_time_us":203941}
I20260709 13:11:09.033318 31868 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.034219 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.035507 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.035717 31832 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.036338 31832 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.037222 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:09.038849 31759 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:09.041015 29714 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:09.042225 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:09.042811 31832 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.043068 31880 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.032081 31895 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:09.044375 31880 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.045463 31886 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:09.035691 31868 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.031422 31857 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:09.047639 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.056505 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:09.060971 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.063716 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.020599 31737 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.024700 31896 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:08.989511 31877 consensus_queue.cc:1059] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 13:11:09.079969 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 174694us
I20260709 13:11:09.107738 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.096796 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:09.080444 30344 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:09.037824 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dff620b2062c4139940ec520664442a1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:09.119627 29744 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:09.072259 31896 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.122216 31896 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.072642 31737 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.130784 29670 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:09.118815 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 80679.9us
I20260709 13:11:09.126047 31697 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.088459 31872 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:09.146234 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 107215us
I20260709 13:11:09.127314 31832 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.157114 29818 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.135082 31759 consensus_queue.cc:1059] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:11:09.152746 31795 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:11:09.162238 31808 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.196902 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:11:09.197847 31935 log.cc:927] Time spent T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:09.200588 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.202673 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.206768 29665 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:09.212160 31939 log.cc:927] Time spent T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:09.214195 29673 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:09.216089 31737 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.218782 29667 pending_rounds.cc:85] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 1
I20260709 13:11:09.219192 29667 pending_rounds.cc:107] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:11:09.219508 29667 raft_consensus.cc:2889] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.165333 31832 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.222395 31694 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.223083 31694 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.223855 31832 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.228390 29673 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:09.158766 31697 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:09.230296 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.230767 29740 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:11:09.230927 31697 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:09.233315 29745 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:09.235078 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:09.236006 30344 raft_consensus.cc:2393] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 2: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:09.236948 29740 pending_rounds.cc:85] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 3
I20260709 13:11:09.237237 29740 pending_rounds.cc:107] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:09.237509 29740 raft_consensus.cc:2889] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:09.237816 31795 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:09.238231 31795 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:09.238550 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.239120 31795 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.239894 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.240417 31795 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.241106 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.242229 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.165728 31736 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.243314 31736 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.244215 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.244755 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.245522 31736 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.156940 31561 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.246273 31561 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.247005 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.247838 29669 raft_consensus.cc:2410] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:11:09.248333 31561 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.242781 29672 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:09.250824 29670 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:09.253399 31872 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.255371 31694 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.256199 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:11:09.258028 31932 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.353s	user 0.002s	sys 0.002s
I20260709 13:11:09.258960 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.260277 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.261432 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.261579 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.262374 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.263120 29669 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:09.242805 29674 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:09.247781 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.264017 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.264554 29671 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:09.263132 31943 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:09.262370 29668 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:09.265861 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.267016 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:09.262919 31759 raft_consensus.cc:3055] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:09.267722 31759 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:09.268669 31726 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.269227 31726 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.269722 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:09.270881 29815 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:09.258966 31880 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:09.271344 31942 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:11:09.269122 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:09.265538 29669 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:11:09.274693 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 109589us
I20260709 13:11:09.266150 29672 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:11:09.276109 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:09.276983 29814 raft_consensus.cc:2955] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:09.276105 31906 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:11:09.283679 31877 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:09.284379 31877 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.285130 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.265414 31896 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.279209 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:09.290292 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 273011us
I20260709 13:11:09.300400 29820 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:09.304250 29671 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:09.307170 29668 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:11:09.309016 31877 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.313216 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:09.313951 29744 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:09.315857 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.317286 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.317945 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:09.318543 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.319464 29744 raft_consensus.cc:2410] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:11:09.318506 29748 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.304318 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:09.305810 29669 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:09.322207 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:09.323549 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:09.272668 31726 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.340438 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.346767 29747 raft_consensus.cc:2393] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:09.347723 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:09.326237 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.303038 31882 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:09.367224 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.368033 29744 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:09.341022 31797 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:09.373503 29669 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:09.374233 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.375404 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.376240 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.356724 31726 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:09.395553 29746 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:09.393559 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.272305 31759 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:09.406327 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 182957us
I20260709 13:11:09.377627 31797 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.410207 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.403380 31694 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.359414 31697 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:11:09.413579 29671 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:09.387074 31736 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.416860 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.428234 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.430629 29789 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.431949 29789 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.367102 31880 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.437122 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.408095 31726 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:09.391901 31872 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.414640 31797 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.438714 29671 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:09.445561 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:09.447244 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:09.404785 31882 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.435185 31838 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.435005 31854 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.434710 31832 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.441133 31759 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.461720 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:09.464809 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.466111 31729 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:09.467146 31729 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.467816 31729 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:09.468137 31729 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:09.459556 31841 consensus_queue.cc:1059] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.124s
I20260709 13:11:09.469412 31841 raft_consensus.cc:3055] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:09.469806 31841 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:09.470726 31841 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.472025 31841 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.470634 29787 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:09.474733 31686 raft_consensus.cc:3055] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:09.475145 31686 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:09.475329 31954 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:09.475737 31954 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:09.476086 31954 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:09.476725 31951 log.cc:927] Time spent T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.248s	user 0.004s	sys 0.000s
I20260709 13:11:09.453728 31626 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:09.478229 31626 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:09.478595 31626 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.480162 31561 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:09.448292 31694 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:09.483007 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 111064us
I20260709 13:11:09.494278 29787 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.495541 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:09.497365 29823 raft_consensus.cc:2410] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:11:09.498215 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.509137 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:09.493434 31838 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.459578 31736 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.462152 31872 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.545372 29823 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:09.550288 31964 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.552641 31686 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.469044 31729 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:09.558496 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 60359.5us
W20260709 13:11:09.563372 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 54331us
W20260709 13:11:09.567153 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 62186.3us
I20260709 13:11:09.567574 29748 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:09.554081 31686 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:09.571077 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.549269 31857 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.580600 29639 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:09.565347 31854 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.586869 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.592470 29638 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:09.599020 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:09.609293 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.609546 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.610176 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.610808 29740 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:09.592214 31729 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.551196 31726 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.619956 29639 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:09.603713 31808 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.616578 30314 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:09.611341 31800 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:09.684594 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 69523.2us
W20260709 13:11:09.689416 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 64246us
I20260709 13:11:09.690330 29639 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:09.604592 31899 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:09.691409 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.623440 31886 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.653492 31599 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.654052 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:09.615912 31964 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:11:09.653861 31880 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.681097 31832 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:11:09.717703 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 269097us
I20260709 13:11:09.691381 31821 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:09.726322 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 117927us
I20260709 13:11:09.727298 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.710569 31795 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.728530 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:11:09.730605 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.735000 31959 log.cc:927] Time spent T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:11:09.738080 31941 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:09.739168 31957 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:11:09.740327 31962 log.cc:927] Time spent T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:11:09.743258 31872 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.747292 31974 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:09.747534 31626 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.754648 31626 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.755574 29670 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:09.758309 31736 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.761682 31894 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:09.718333 31882 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.762401 31894 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:09.763655 29715 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:09.747628 31971 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:11:09.767122 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 60717.8us
I20260709 13:11:09.769462 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:09.771981 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 138408us
I20260709 13:11:09.778257 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.779814 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.783654 29740 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:09.763599 31894 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:09.782542 31759 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.785636 31759 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.787254 31954 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.792706 29666 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:09.775532 31808 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.715842 31886 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:09.776512 31883 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.819494 29787 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:11:09.814276 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:09.815658 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 93495.2us
I20260709 13:11:09.776141 31800 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:09.778143 31878 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.820401 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.822062 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:09.824273 31697 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.824856 31697 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:09.826926 31697 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.830559 31800 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:09.839911 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.817565 31854 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:09.841202 31736 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:09.842590 31944 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.843134 31944 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:09.829638 31838 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.809887 31759 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:09.841643 31736 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.852770 29789 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:09.788112 31872 consensus_queue.cc:1059] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:11:09.868572 29789 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:09.869963 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 253474us
I20260709 13:11:09.857672 31736 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.858028 31694 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:09.883040 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.883237 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:09.885377 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.887924 29673 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:09.876197 31697 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.850508 31944 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:09.898627 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:09.879004 31821 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.882823 31694 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:09.899442 29740 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:09.911561 31965 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.912277 31965 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:09.914044 31978 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:09.917080 31984 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:11:09.906447 29742 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:09.923262 31954 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:09.925642 31886 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:09.926653 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.928115 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.927031 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:09.930385 29672 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
W20260709 13:11:09.932338 31933 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.730s	user 0.000s	sys 0.005s
I20260709 13:11:09.933039 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:09.933609 29741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 1547) took 1284 ms. Trace:
I20260709 13:11:09.934100 29741 rpcz_store.cc:276] 0709 13:11:08.649628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.650030 (+   402us) service_pool.cc:224] Handling call
0709 13:11:08.650399 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.650788 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.650817 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.667222 (+ 16405us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.880043 (+212821us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:11:08.880100 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.880171 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:09.931790 (+1051619us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:11:09.933331 (+  1541us) raft_consensus.cc:1685] finished
0709 13:11:09.933352 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:09.933536 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15492,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6820,"spinlock_wait_cycles":100608512,"thread_start_us":181462,"threads_started":1,"wal-append.queue_time_us":451282}
I20260709 13:11:09.936220 29741 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:09.937256 29741 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:09.943682 31893 consensus_queue.cc:1059] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:09.944460 31893 consensus_queue.cc:1243] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:09.944954 31893 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:09.945252 31893 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:09.909458 31694 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:10.043237 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 94189.3us
W20260709 13:11:10.039232 31797 consensus_meta.cc:287] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
I20260709 13:11:10.050882 29787 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.056923 29787 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.058099 31954 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:10.060238 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 296680us
W20260709 13:11:10.061298 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 114003us
I20260709 13:11:10.064889 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.045238 31984 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.051617 31893 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.077351 29787 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.085520 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.080199 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:10.116299 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.117123 29672 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:10.091847 31954 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.107375 31886 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:10.132992 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 47580us
I20260709 13:11:10.113080 31994 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:10.109455 31697 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.142117 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:10.125519 31975 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.061265 31797 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.164429 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.165122 29743 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:10.166268 31964 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:10.173273 30314 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:10.182319 31966 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:10.182756 31966 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.183068 31966 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.145222 31886 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.186699 31886 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:10.137072 31868 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.145529 31994 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.199216 29818 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.192761 31896 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.209133 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.120733 31984 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.208679 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:10.208355 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.213727 29715 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.214205 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.201632 31994 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.225621 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.225831 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.226230 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.229157 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.233621 29672 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.229712 29671 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:10.235699 29820 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:10.237558 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.240412 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.240505 29674 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:10.221733 31868 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.208531 31878 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:11:10.216730 31737 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:11:10.246834 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.223001 31965 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:10.110060 31894 consensus_queue.cc:1175] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "42c443079435463daa8845e244cec9d3" responder_term: 6 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:10.259670 29814 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.259681 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.250494 31729 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.251796 31995 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.253871 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:10.271680 31868 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:11:10.286552 31984 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.274104 31736 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.276166 31995 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.293053 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.295179 29669 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:10.279297 31832 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.274441 31729 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:10.302441 31998 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:10.288439 31990 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.316453 31990 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.318622 31990 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:10.319389 31999 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:11:10.325393 29817 raft_consensus.cc:2393] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:10.326474 31736 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.308465 29715 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.333068 31990 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:10.334545 31990 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:10.335682 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 1496) took 1077 ms. Trace:
I20260709 13:11:10.336061 29670 rpcz_store.cc:276] 0709 13:11:09.266752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.300596 (+ 33844us) service_pool.cc:224] Handling call
0709 13:11:10.335497 (+1034901us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400182c54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:10.335605 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994728704}
I20260709 13:11:10.287741 31838 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.339027 31838 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.341183 31838 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.341711 31984 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.342379 31984 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.297780 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.312110 31868 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.342286 31832 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.347872 31984 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.315088 31965 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:10.348217 31944 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:10.348407 31832 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.348811 31944 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.296377 31797 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.351615 31944 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:10.331387 31995 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.353457 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.354236 29667 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:11:10.355558 30316 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:10.314219 31729 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.359282 31968 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:10.359689 31968 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.360020 31968 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.365682 31838 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.366312 31838 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.368412 31838 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:10.369295 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.381536 29743 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:10.381896 29787 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.384895 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.384788 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:10.385612 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.386410 29668 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:10.370056 31821 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.386898 31821 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.385296 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.389143 31821 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.386466 31561 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.389947 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:10.392127 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.393173 31989 consensus_queue.cc:1059] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:10.391201 29715 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:10.385417 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.393745 29747 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:10.343801 29665 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:10.402549 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 123347us
I20260709 13:11:10.404162 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.414988 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.415719 29748 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:10.369746 31838 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.410679 29670 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 5.4: config changed from index 2 to 4, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:10.416863 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.420212 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.421581 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.423293 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.420748 29749 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:10.423339 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.425244 29815 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:10.301790 31694 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.416785 31737 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:10.444855 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:10.441860 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.434839 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.417217 31838 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.358855 31966 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.439483 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:10.457947 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.458736 29814 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:10.460598 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.461270 29814 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:10.417258 31968 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.465765 29818 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:10.449981 31797 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:10.469569 29823 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:10.469569 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.469909 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.435138 31982 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:11:10.471607 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:10.472240 29815 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.472892 32008 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:10.477128 31994 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.482260 30350 raft_consensus.cc:2368] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:11:10.483253 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:10.483855 31797 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.484827 31797 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.486007 31899 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.485267 29815 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:10.486757 31899 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.486425 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.490120 29666 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.451928 31737 raft_consensus.cc:697] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.439415 31877 consensus_queue.cc:1059] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:11:10.455994 32015 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.510924 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.510370 29666 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:10.463532 31729 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:11:10.514356 31737 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.467480 32012 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:10.511658 29672 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:10.516898 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:10.514410 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.494510 31994 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.522246 29787 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.494172 31966 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.521514 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.519974 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.525174 29666 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.523758 31321 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:10.526280 31321 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:10.515717 32015 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.523880 31854 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:10.526909 31854 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.527552 31854 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:10.527117 31321 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.526003 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.529065 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:10.529646 29747 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.528357 32015 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.537110 29666 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:10.543299 31968 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.543696 31726 raft_consensus.cc:3055] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:10.544103 31726 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.544322 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.545069 29672 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.544932 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:10.518700 32012 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.552207 32012 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.556984 29665 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:10.562139 31987 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:10.562626 29715 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:10.563627 31995 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:10.564333 31995 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.565536 31838 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:10.563624 31899 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.569159 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:10.569653 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 47506.1us
I20260709 13:11:10.565244 31995 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.551868 29666 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.550493 31694 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:10.538132 29714 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.572731 29672 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
W20260709 13:11:10.573877 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46445.7us
I20260709 13:11:10.576511 29747 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
W20260709 13:11:10.579221 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.583451 30316 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:10.528345 31321 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:10.585016 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 46983.2us
I20260709 13:11:10.585845 29714 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.589517 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.589807 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:10.590791 29819 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.596379 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.596873 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.597514 29672 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:10.597718 29666 raft_consensus.cc:2368] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:10.599268 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.600000 29666 raft_consensus.cc:2368] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:11:10.601738 29665 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:10.602483 29815 raft_consensus.cc:1240] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:10.603539 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.612044 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:10.614105 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.586714 31561 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:10.628067 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.625939 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.630683 29819 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:10.582219 32008 raft_consensus.cc:697] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.636500 29789 leader_election.cc:400] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:10.636945 29789 leader_election.cc:403] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.602919 31964 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:10.609858 31899 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:10.642266 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:10.642493 29789 leader_election.cc:400] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
I20260709 13:11:10.581808 31877 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:11:10.644718 29789 leader_election.cc:403] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.586978 31868 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:11:10.639019 31987 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:10.544991 31726 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.615911 31729 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:11:10.627465 31561 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.646729 31697 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.644083 31964 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.651577 31994 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:10.645514 32022 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:10.665616 32022 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.666092 31869 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.662035 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:10.668094 32021 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:10.650349 31899 raft_consensus.cc:697] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:10.662751 31726 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.669370 31899 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.664173 31964 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.652500 31694 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.676047 32008 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.639259 32020 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:11:10.668726 32021 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.660398 31561 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.660502 31987 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:10.683478 31964 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.701556 29820 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:10.648183 31854 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.717024 31854 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.722018 29823 raft_consensus.cc:2368] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8.
I20260709 13:11:10.706488 31978 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.724319 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.725876 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.726505 29670 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:10.737898 29819 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.738323 31987 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.706073 32012 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:10.747450 32026 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:11:10.731328 31978 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.747501 32008 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:10.730930 32010 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:10.758006 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.759122 29814 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:10.757997 31964 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.762799 32021 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:10.763268 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:10.766103 31697 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
W20260709 13:11:10.768326 31958 log.cc:927] Time spent T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 1.308s	user 0.005s	sys 0.002s
I20260709 13:11:10.768795 31759 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:10.769348 31759 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.770558 31994 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 2. Current term is 3.
W20260709 13:11:10.771252 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.771782 31759 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.773154 32012 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.780968 31978 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.782053 32010 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.784541 32010 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.784818 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:10.785380 29819 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.783844 31980 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:10.786232 31980 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.787120 31980 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.788345 31980 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.792830 31561 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.799014 29670 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:10.800381 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:10.804139 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:10.809456 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:10.811075 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:10.812073 31880 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:10.812479 31880 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.813144 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:10.813732 29749 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.815918 31978 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:10.793686 31893 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.817076 29715 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:10.817781 31878 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:10.818699 31878 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.819134 31878 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:10.821147 29820 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.822058 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.822232 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.822664 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.825476 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:10.813298 31880 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.826555 31880 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:10.827095 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.823916 29744 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:10.832085 29640 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:10.833824 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.827234 29740 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:10.836820 29740 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:10.842253 29715 leader_election.cc:400] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:11:10.842649 29715 leader_election.cc:403] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:10.844910 29714 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.845361 29819 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:10.846164 29714 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:10.853035 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.863090 29749 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:10.863771 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.864578 29744 raft_consensus.cc:2368] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:10.866986 29674 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:10.868114 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:10.871834 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.871834 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:10.870750 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.875159 29817 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:10.816414 31978 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:10.822072 31878 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:10.876644 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:10.896144 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 51728.5us
I20260709 13:11:10.881616 30314 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.896745 29787 leader_election.cc:400] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:10.908456 29639 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:11:10.895037 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.910531 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.907349 29744 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:10.912123 30314 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:10.881772 32008 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.873306 32029 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.895592 31990 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:10.887425 31561 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:10.874670 31995 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6.
I20260709 13:11:10.917685 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:10.919034 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.881649 31869 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:10.867229 31841 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.886282 31808 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:10.930114 31821 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.930469 31808 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.930807 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:10.932606 31808 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.905475 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:10.934780 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.941594 29822 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:10.941576 29787 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.911469 31964 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:10.944609 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:10.945385 29745 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:10.916702 31599 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.882414 32009 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:11:10.922348 31895 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:10.951274 29639 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:10.952759 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:10.921478 31990 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:10.959975 29639 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:10.916355 31918 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:11:10.952220 31811 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.948065 31561 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.965945 29787 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:10.939046 32008 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.962150 31840 raft_consensus.cc:2764] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:10.955654 31987 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:10.960268 31321 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.961066 31978 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:10.972785 32001 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.012s	sys 0.036s
W20260709 13:11:10.978243 32001 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.012s	sys 0.036s
I20260709 13:11:10.950249 31759 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:10.976126 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:10.947927 31964 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.963351 31895 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:10.985499 29744 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:10.976887 31991 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:10.992285 32019 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.993979 30350 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:11:10.994422 30350 pending_rounds.cc:85] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 6
I20260709 13:11:10.994665 30350 pending_rounds.cc:107] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:11:10.994905 30350 raft_consensus.cc:2889] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.980407 31987 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:10.969085 31986 consensus_queue.cc:1059] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
W20260709 13:11:11.004509 32032 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:11:10.975260 31561 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:11.003244 31991 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:11.003684 31963 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:10.976734 31967 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:11.016619 31991 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:11.020346 31872 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:11.020781 31872 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:11.021735 31872 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:11.011933 32034 log.cc:927] Time spent T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:11:11.013437 31986 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:10.974154 31811 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.005990 31990 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:11.029778 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 68215us
I20260709 13:11:11.034963 31759 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:11.037212 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:11.034686 31895 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:11.038033 31759 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:11.038923 29639 leader_election.cc:400] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8.
I20260709 13:11:11.042100 29639 leader_election.cc:403] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:11.042735 31759 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8.
I20260709 13:11:11.027151 31986 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:11.045209 31759 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:11.048545 31811 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.042236 32008 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:10.998689 32010 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.064632 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.031066 31872 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.069314 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.070767 31896 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:11.071254 31896 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:11.072105 31896 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.072515 32022 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:11.073130 31896 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.073817 29673 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:11.076285 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:11.077049 29816 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:11.083231 29639 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:11.083357 31944 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:11.084481 31944 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:11.084860 31944 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.085098 31808 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:11.085554 31808 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:11.086640 29665 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:11.086406 31808 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.087570 31808 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.085206 31944 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.088387 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:11.089133 29823 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 6: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:11.097078 29740 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:11.096230 31983 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:11.045723 31986 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.068866 32029 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:11.095705 31990 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.166618 31974 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:11.167251 31974 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:11.168696 31821 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.169399 31974 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:11.169524 31821 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:11.174687 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:11.110682 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:11.102890 31983 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.196692 32010 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.108560 32022 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:11:11.162027 32041 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.205966 32041 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.208282 32041 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.164374 31987 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:11.177479 31986 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.234941 29715 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:11.170296 31821 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:11.241629 29667 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:11.256243 31821 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:11.250926 31896 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:11.262835 29823 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:11.266923 31983 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:11.277575 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:11.261648 31949 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:11:11.311355 31944 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.314159 32050 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:11.313735 31944 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:11.330154 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.352628 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:11.354740 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:11.356787 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:11.357312 29821 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:11.360483 29814 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.364964 29815 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:11.371476 31964 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.386781 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:11.388720 29814 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:11.393996 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.394191 29669 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:11.394485 29714 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.395414 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.392846 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.397639 29665 raft_consensus.cc:2368] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
W20260709 13:11:11.399448 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.404106 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.418922 29714 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.422461 31954 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:11.423960 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.424817 31954 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:11.425987 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.427054 31838 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:11.401258 32021 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:11.428428 29789 leader_election.cc:400] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:11.428799 29789 leader_election.cc:403] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:11.429523 31964 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:11.432034 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:11.432672 29749 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:11.433249 31838 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.435669 29741 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:11.437722 29821 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:11.438392 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:11.439038 29749 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.439370 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:11.440049 29748 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:11.446942 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:11.445755 29749 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:11.452081 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:11.453544 29748 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:11.455889 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:11.466467 31882 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:11.467192 31991 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:11:11.474848 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:11.483182 29665 pending_rounds.cc:85] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 3
I20260709 13:11:11.483590 29665 pending_rounds.cc:107] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:11:11.483844 29665 raft_consensus.cc:2889] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.490118 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:11.484251 31982 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.472059 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.478794 31954 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:11.475329 29714 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.553512 29639 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:11.514494 29674 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:11.562201 29744 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:11.512663 29671 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:11.546893 29787 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.506253 31954 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.503520 31982 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.488911 29816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:11.579530 29816 raft_consensus.cc:606] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
W20260709 13:11:11.572228 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 62078.1us
I20260709 13:11:11.572629 31882 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:11.550882 31821 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:11:11.558851 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:11.505550 31974 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:11.572013 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 96750.5us
I20260709 13:11:11.573531 31810 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:11.609009 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 50242.8us
I20260709 13:11:11.656566 31808 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:11.657498 31808 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:11.657814 31808 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:11.658413 29817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:11.659075 29817 raft_consensus.cc:606] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.658674 31808 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.659395 29817 raft_consensus.cc:614] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:11.660005 31808 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:11.609896 31944 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:11.603469 32021 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:11:11.611968 32055 log.cc:927] Time spent T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:11:11.618487 32054 log.cc:927] Time spent T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:11:11.623432 31982 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.591187 31963 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:11.579056 31854 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:11.654500 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:11.664494 29740 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.668146 29817 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:11.677984 31697 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:11.692775 31697 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.654379 31868 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:11:11.672655 32021 consensus_queue.cc:1243] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:11.700325 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:11.700780 29744 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:11:11.701159 29819 raft_consensus.cc:606] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:11.701524 29819 raft_consensus.cc:614] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:11.669029 31944 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.710202 29740 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:11.680485 31840 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.721678 31854 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:11.718825 31840 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.722311 31854 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.723927 31840 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.724818 31974 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:11.728160 29818 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:11:11.713234 32059 log.cc:927] Time spent T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:11:11.704687 31982 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:11.711231 31944 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.736045 29817 pending_rounds.cc:85] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 2
I20260709 13:11:11.741055 29817 pending_rounds.cc:107] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:11:11.741326 29817 raft_consensus.cc:2889] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:11.720211 31967 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:11:11.720402 31737 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:11:11.746933 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 162389us
I20260709 13:11:11.730607 31838 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:11.754386 31882 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:11:11.750537 31982 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:11.734174 31797 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.763868 29818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:11.764605 29818 raft_consensus.cc:606] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.764976 29818 raft_consensus.cc:614] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:11.736613 31810 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:11.769447 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:11.781445 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:11.786489 29815 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:11.790441 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:11.791186 29818 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:11.775631 31868 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:11.798034 32064 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:11:11.773805 31797 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.776046 31982 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.780501 31729 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:11:11.785759 31964 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:11:11.845412 32027 log.cc:927] Time spent T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 1.093s	user 0.008s	sys 0.011s
I20260709 13:11:11.878482 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:11.881686 29743 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:11.884753 29673 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:11:11.887297 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.887696 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.888083 29671 raft_consensus.cc:2393] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:11.888616 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:11.903545 29673 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:11.911348 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:11.912103 29747 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:11.913975 29815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc891e1e674747fda6007601f64c4341"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:11.914613 29815 raft_consensus.cc:606] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:11.914976 29815 raft_consensus.cc:614] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:11.897857 31810 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.902891 32041 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.916886 31899 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:11:11.944922 31882 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.933967 31810 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.937788 32041 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:11.967162 32067 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:11.977720 32041 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.968152 31810 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:11.971521 31944 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.952093 31808 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.962190 31882 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:11.993574 29665 raft_consensus.cc:2368] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:11.993829 29639 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:11.996138 32084 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:11.996624 32084 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.997017 32084 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:11.989710 31810 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.990556 31811 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.982257 31808 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.020457 31808 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:12.008984 32079 log.cc:927] Time spent T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:12.022693 31944 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.029220 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:12.033828 32060 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.173s	user 0.002s	sys 0.000s
I20260709 13:11:12.007658 31811 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.034694 31882 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.036653 31811 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.009982 31797 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.006803 31810 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.047590 29670 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:12.049127 32084 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.052081 31810 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.064296 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.064783 29672 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:12.065121 29671 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:12.067149 32084 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.069383 29715 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.077126 32073 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:12.081744 31854 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.082012 32073 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.082765 32073 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.092046 31697 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.092301 32073 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.094578 32073 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.095265 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:12.095942 29666 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.102398 29666 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:12.103667 29715 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.105144 32073 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:12.105949 32073 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:12.106843 32073 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.115732 31821 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.116333 31821 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:12.118070 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 225041us
I20260709 13:11:12.122498 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.123183 29746 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:12.124037 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.124689 29744 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:12.135991 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.139528 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.144135 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.144747 29740 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:12.144927 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.145516 29741 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.146994 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.156392 29743 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:12.149571 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.164448 29819 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.150914 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.147718 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.171080 29815 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:12.173804 31599 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:12.174425 31599 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.174938 31821 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.175522 29572 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 2 to 4, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:12.157716 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.159900 31987 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:12.177858 31987 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.179090 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.179929 31987 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.160420 31954 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.163089 31697 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:12.180778 31697 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.181540 31599 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.182847 31697 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.177026 29572 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 4 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 4 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.185904 29572 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 7 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.190059 31599 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.190650 31599 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.193800 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.194483 29747 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.194937 31599 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.189356 29572 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 3 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.200291 29817 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:12.202081 31737 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:12.205861 29572 catalog_manager.cc:5697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 3 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.208369 29572 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 6, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.211892 31978 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:12.214887 29747 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:12.218267 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.221783 31965 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:12.221072 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.222797 29744 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:12.221813 29740 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:12.222314 29572 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 7, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:12.228103 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 222c2ac209fd4c24a1f636fff5c13739 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9d8198d0b954886af452e89a8029614 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:12.234406 29789 leader_election.cc:400] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:12.235049 29789 leader_election.cc:403] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.235620 31697 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:11:12.237708 29570 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50490 (request call id 187) took 12579 ms (client timeout 15000 ms). Trace:
I20260709 13:11:12.234805 29572 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 2 to 4, term changed from 5 to 6, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.248567 29572 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 4 to 5, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 5 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.250631 29638 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:12.256740 29787 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:12.259058 29787 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:12.245162 29570 rpcz_store.cc:269] 0709 13:10:59.685048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.685291 (+   243us) service_pool.cc:224] Handling call
0709 13:11:12.237613 (+12552322us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:09.470893 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:09.471586 (+   693us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:09.471644 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:11:09.471680 (+    36us) tablet.cc:662] Decoding operations
0709 13:11:09.472533 (+   853us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:09.472625 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:09.472651 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:09.473286 (+   635us) tablet.cc:701] Row locks acquired
0709 13:11:09.473333 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:11:09.473532 (+   199us) write_op.cc:270] Start()
0709 13:11:09.473674 (+   142us) write_op.cc:276] Timestamp: P: 1783602669473458 usec, L: 0
0709 13:11:09.473714 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:11:09.553037 (+ 79323us) log.cc:844] Serialized 2481 byte log entry
0709 13:11:10.255142 (+702105us) op_driver.cc:464] REPLICATION: finished
0709 13:11:10.802630 (+547488us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e69b30ac 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9ed4f3ef0
0709 13:11:11.030256 (+227626us) write_op.cc:301] APPLY: starting
0709 13:11:11.050874 (+ 20618us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:11.163034 (+112160us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:11.166374 (+  3340us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:11.167342 (+   968us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:11.167595 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:11:11.167654 (+    59us) write_op.cc:312] APPLY: finished
0709 13:11:11.167973 (+   319us) log.cc:844] Serialized 52 byte log entry
0709 13:11:11.280818 (+112845us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:11.280937 (+   119us) write_op.cc:454] Released schema lock
0709 13:11:11.281008 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:11.283271 (+  2263us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:11.283302 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3022,"reported_tablets":44,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":734514,"apply.run_cpu_time_us":15700,"apply.run_wall_time_us":257998,"mutex_wait_us":10322,"num_ops":6,"prepare.queue_time_us":344938,"prepare.run_cpu_time_us":10221,"prepare.run_wall_time_us":184614,"raft.queue_time_us":159545,"raft.run_cpu_time_us":51331,"raft.run_wall_time_us":755698,"replication_time_us":758793,"spinlock_wait_cycles":28596992,"thread_start_us":1124474,"threads_started":5,"wal-append.queue_time_us":436461,"wal-append.run_cpu_time_us":28012,"wal-append.run_wall_time_us":1269239}]]}
I20260709 13:11:12.262609 29638 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.263972 29819 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:12.260845 31599 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:12.265149 31599 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.265493 31599 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.270603 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.271442 29740 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:12.271406 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.274513 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.276656 31810 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.276847 31944 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:12.277340 31944 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.277712 31944 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.280251 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.261219 32065 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:12.285439 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51204.2us
I20260709 13:11:12.291760 29638 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.292318 29714 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:12.294121 29638 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.296352 31821 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.296972 31821 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.281363 31810 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.298542 31810 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.299099 31821 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.302429 31990 raft_consensus.cc:2764] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:12.304505 29638 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.321930 29741 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:12.305639 31941 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.313318 32083 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.325109 32019 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:12.325749 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.325979 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.326570 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.329160 31599 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.286024 32065 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:12.305027 31978 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:12.357877 29787 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:12.359686 29638 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.365971 29741 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:11:12.360631 31941 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.361822 32083 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:12.372040 31840 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:12.400765 31561 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:12.375108 31941 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.405802 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.420156 29666 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:12.408306 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.413151 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:12.371800 32065 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.423789 29741 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:12.414050 31561 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.375702 32019 raft_consensus.cc:697] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:12.378167 31987 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:12.423075 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:12.433117 31561 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.432981 32019 consensus_queue.cc:237] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.436252 31987 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.436755 31987 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.440160 31599 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.372474 31810 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.426329 31840 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:12.394306 32083 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.375026 31759 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:11:12.453841 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.455407 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.456568 29820 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:12.458886 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.459574 29819 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:12.425119 29787 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:12.461166 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.462209 29740 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.467314 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.468103 29741 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:12.468278 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.469719 32066 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.470265 32066 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.470656 32066 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.470708 31810 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.486145 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:12.490172 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.493631 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.495416 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:12.446750 31840 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.498551 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.499168 29749 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.457621 31954 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.505622 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.506299 29820 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.509057 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.516420 32083 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.518311 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:12.518960 29818 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:12.520151 29818 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:11:12.522224 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.504473 31838 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.524933 31561 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:12.525656 32083 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.527415 29639 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:12.528126 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.529428 32019 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:12.532532 32066 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.525228 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.535180 29747 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:12.538460 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:12.540187 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.536288 29638 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.546577 29820 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:12.496227 31697 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:12.552549 29639 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:12.556823 32084 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:12.559588 32084 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:12.560539 32084 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:12.566994 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 82577.5us
I20260709 13:11:12.571815 29749 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:12.568703 29787 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:12.536661 31954 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.573014 29638 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.578110 29740 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:12.557755 32041 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:12.583485 29638 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:12.593087 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.610446 29740 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.613818 29817 raft_consensus.cc:2393] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 6: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:12.584823 29819 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:12.577549 31697 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:12.574566 32088 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:12.617792 31944 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.580312 31978 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:12.593063 32066 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.611310 31811 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:12.642030 29740 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:12.585013 31986 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:12.636970 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 141638us
I20260709 13:11:12.576865 32083 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 13:11:12.638469 32103 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:12.627378 31697 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:12.664915 31697 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.665838 31986 raft_consensus.cc:697] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:12.666836 31986 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.668494 31838 raft_consensus.cc:993] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:12.668980 31838 raft_consensus.cc:1081] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:12.647997 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.671164 29669 raft_consensus.cc:2368] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:12.642488 31978 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.673393 31978 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.674229 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.654542 31811 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:12.675530 31811 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.677027 31697 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.659195 31944 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.662076 29666 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:12.662248 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:12.663568 32065 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.679008 29672 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.680486 32065 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.681625 29815 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:12.682358 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.684448 29789 leader_election.cc:400] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:12.684988 29666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45236
I20260709 13:11:12.685600 29666 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.685957 29666 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.663702 31987 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.686105 32073 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:12.687155 31697 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.687750 31987 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.688148 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:12.689931 29665 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:12.691694 29789 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.692533 31983 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:12.692883 31983 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:12.693248 31983 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.695251 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.695835 29740 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.696583 29820 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.699091 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.699904 29741 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:12.700845 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.701122 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.701558 29749 raft_consensus.cc:2368] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:12.701803 29747 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:12.703090 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.689371 29787 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:12.708065 29672 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:12.708954 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:12.715088 29820 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:12.715518 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.716135 29747 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.718957 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:12.722328 29672 raft_consensus.cc:2368] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:12.725790 31954 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.719334 32108 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:12.729751 32108 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:12.726926 29740 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:12.735612 29787 leader_election.cc:400] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:12.735965 29787 leader_election.cc:403] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.737576 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:12.744282 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:12.744930 29667 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.746433 29817 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:12.748021 29747 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:12.730716 32108 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.759497 29789 leader_election.cc:400] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:12.761063 29789 leader_election.cc:403] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.733741 31941 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.764557 31941 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.764695 32065 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:12.764173 31983 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.767143 31983 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.767307 32015 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:12.771059 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.772039 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.783385 29747 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.771706 29787 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:12.790774 29747 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:12.780098 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.757990 31987 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.793403 29741 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:12.788268 29666 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.798290 29669 raft_consensus.cc:1240] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:12.798834 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:12.789323 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.803328 29817 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.791656 32015 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.810492 32015 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:12.813158 29666 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:12.795536 32066 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:12.802088 32083 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:12.816061 29638 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.818184 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:12.823918 29820 raft_consensus.cc:3055] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:12.824295 29820 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:12.825026 29820 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:12.869215 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53234.6us
I20260709 13:11:12.875746 29665 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:12.877535 29820 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.871701 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:12.884032 29741 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:12.814491 31729 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:11:12.965306 29820 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:11:12.966027 29741 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:11:12.961413 31697 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:12.970053 31697 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:12.972154 31697 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:12.877331 32084 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:12.977615 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:12.877627 32083 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:12.878768 32066 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:12.981827 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:12.984859 29741 raft_consensus.cc:2368] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:11:12.986406 29787 leader_election.cc:400] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:11:12.986791 29787 leader_election.cc:403] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.002847 31944 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:13.003486 31944 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:13.004387 31944 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:13.008762 32110 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 13:11:12.991561 32065 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.015793 32083 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:13.023434 32066 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:13.028519 29817 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:13.050619 29667 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:13.053037 29789 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:13.061462 29820 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:11:13.088094 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:13.095523 29747 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:11:13.099754 29744 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:13.094880 31561 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:13.081954 32088 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:11:13.116448 31561 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:11:13.140300 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 103477us
I20260709 13:11:13.153564 31561 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:13.133509 32084 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:13.148255 31987 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:13.196979 32084 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:13.215104 32116 log.cc:927] Time spent T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 13:11:13.224543 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 189926us
I20260709 13:11:13.200804 32015 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:13.243592 29747 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:13.244849 29741 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:13.241580 31759 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:11:13.237766 32121 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:11:13.289887 32015 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:13.297055 32065 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:11:13.304390 29815 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:13.306901 31983 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:13.308650 31983 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:13.357544 29818 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:13.358875 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 222c2ac209fd4c24a1f636fff5c13739 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9d8198d0b954886af452e89a8029614 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:13.360009 29822 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:13.421198 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:13.358162 29823 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:11:13.360960 32134 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:11:13.362301 31983 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:13.419027 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 48706.5us
I20260709 13:11:13.421815 29741 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.423296 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:13.423939 29744 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:13.430042 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:11:13.433284 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 49105.6us
I20260709 13:11:13.434048 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:13.426227 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 67422us
I20260709 13:11:13.436369 32041 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.437778 32041 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.438403 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:13.433832 31944 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:11:13.444286 31944 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:13.444665 31944 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:13.453362 29741 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:13.465941 29740 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:11:13.474905 32083 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.478469 29822 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:13.475613 32121 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.485846 29748 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:13.496806 29674 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:13.501938 29789 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:13.482528 29749 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:13.445439 31944 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:13.501588 31759 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:13.518791 29822 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:13.521301 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53655.2us
I20260709 13:11:13.522110 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:13.522636 31561 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:13.533851 32084 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:13.534605 31954 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:13.524204 32136 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:11:13.531180 31944 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.524356 31941 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:11:13.524845 32065 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:11:13.709028 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 130164us
I20260709 13:11:13.564334 31954 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:13.573262 31982 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.180s
I20260709 13:11:13.706666 31821 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.178s
I20260709 13:11:13.774772 29667 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:13.829674 29749 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:13.833127 29747 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:13.804402 31954 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:13.909315 32143 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:11:13.913369 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.862552 31561 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:11:13.878786 32015 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:11:13.944517 32144 log.cc:927] Time spent T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.101s	user 0.009s	sys 0.004s
I20260709 13:11:13.963198 31729 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:13.963958 31729 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:14.008786 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 138307us
I20260709 13:11:14.016294 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:14.016141 31729 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:14.021975 31737 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:14.030910 31737 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:13.999841 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:14.060662 29673 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:14.065135 31838 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:14.065824 31838 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.067147 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 82) took 3277 ms. Trace:
I20260709 13:11:14.068421 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet dff620b2062c4139940ec520664442a1 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:14.069289 31838 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:14.071468 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:14.087136 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:14.090648 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:14.090648 31882 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:14.143512 31882 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.082116 29572 rpcz_store.cc:276] 0709 13:11:10.789705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.789984 (+   279us) service_pool.cc:224] Handling call
0709 13:11:11.004987 (+215003us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54001bec54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a27090 00007fd9e9ac5f3a 00007fd9ef87c1cc 00007fd9ef97a37e 00007fd9ede3b2a4 00007fd9ede3b232 00007fd9ede3b161 00007fd9ede3b0dc 00007fd9ede3a392 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:14.067059 (+3062072us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:12.492584 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:12.531047 (+ 38463us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:12.531083 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:11:12.531101 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:12.532042 (+   941us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:12.532128 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:12.532175 (+    47us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:11:12.532915 (+   740us) tablet.cc:701] Row locks acquired
0709 13:11:12.532931 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:11:12.533073 (+   142us) write_op.cc:270] Start()
0709 13:11:12.533189 (+   116us) write_op.cc:276] Timestamp: P: 1783602672533027 usec, L: 0
0709 13:11:12.533208 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:12.533765 (+   557us) log.cc:844] Serialized 3663 byte log entry
0709 13:11:13.122668 (+588903us) op_driver.cc:464] REPLICATION: finished
0709 13:11:13.182708 (+ 60040us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e69b30ac 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9ed4f3ef0
0709 13:11:13.463623 (+280915us) write_op.cc:301] APPLY: starting
0709 13:11:13.467296 (+  3673us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:13.490251 (+ 22955us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:13.490274 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:13.491463 (+  1189us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:13.491687 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:11:13.491736 (+    49us) write_op.cc:312] APPLY: finished
0709 13:11:13.492035 (+   299us) log.cc:844] Serialized 70 byte log entry
0709 13:11:13.492217 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:13.492364 (+   147us) write_op.cc:454] Released schema lock
0709 13:11:13.492415 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:13.492823 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:13.492852 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":774276,"reported_tablets":11,"spinlock_wait_cycles":433728384,"child_traces":[["op",{"apply.queue_time_us":312207,"apply.run_cpu_time_us":2964,"apply.run_wall_time_us":34202,"num_ops":9,"prepare.queue_time_us":172684,"prepare.run_cpu_time_us":21308,"prepare.run_wall_time_us":309962,"raft.queue_time_us":132702,"raft.run_cpu_time_us":41883,"raft.run_wall_time_us":160650,"replication_time_us":589311,"spinlock_wait_cycles":4314496,"thread_start_us":730371,"threads_started":4,"wal-append.queue_time_us":287123}]]}
I20260709 13:11:14.154492 31737 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:14.155771 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:14.158092 29745 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:14.145787 31882 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:14.171295 29748 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:14.169971 29714 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:14.174525 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:14.179430 29817 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:14.181900 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:14.184280 31896 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:14.184808 31896 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.158571 32066 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:11:14.186333 29789 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:14.186856 31896 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:14.188339 32148 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:14.191187 32109 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:14.191093 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:14.176519 31729 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.191334 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:14.195561 29714 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:14.197126 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:14.198099 32173 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:14.216612 32171 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:11:14.222195 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:14.224246 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:14.233731 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet 81b2426a3eab4a3993fe9c9a5eb04e3d with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:14.270215 29816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:14.270910 29816 raft_consensus.cc:606] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:14.271255 29816 raft_consensus.cc:614] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.284487 29715 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:14.301157 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:14.296931 32019 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:14.294176 32174 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:11:14.297286 32175 tablet_replica.cc:333] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:11:14.319818 32175 raft_consensus.cc:2243] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.319473 29571 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.321894 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:14.322500 29819 raft_consensus.cc:606] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:14.322794 29819 raft_consensus.cc:614] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.292927 31808 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:11:14.326154 31759 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:14.330449 32178 tablet_replica.cc:333] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:11:14.331638 32178 raft_consensus.cc:2243] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:14.307130 31737 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:14.339754 32164 log.cc:927] Time spent T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:11:14.316612 31797 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:14.347787 29571 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 4 to 5, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.349804 29571 catalog_manager.cc:5697] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 5, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.351670 29571 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 3, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:14.358840 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 52646.3us
I20260709 13:11:14.353120 29571 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 3, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:14.369489 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 52522us
I20260709 13:11:14.377008 29571 catalog_manager.cc:5697] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:14.380661 32178 raft_consensus.cc:2272] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.384231 32178 ts_tablet_manager.cc:1916] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:14.385284 29814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:14.385890 29814 raft_consensus.cc:606] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:14.401394 29814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:14.402034 29814 raft_consensus.cc:606] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:14.402359 29814 raft_consensus.cc:614] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:14.424293 29748 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:14.425351 29816 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc891e1e674747fda6007601f64c4341"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:14.402304 32175 raft_consensus.cc:2272] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:14.436914 29571 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 3 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:14.438616 29571 catalog_manager.cc:5697] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 4 to 5, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.440145 29571 catalog_manager.cc:5697] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:14.437811 32175 ts_tablet_manager.cc:1916] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:14.483284 32065 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:11:14.497066 32015 raft_consensus.cc:993] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:14.497555 32015 raft_consensus.cc:1081] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:14.503860 29571 catalog_manager.cc:5697] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:14.505668 29571 catalog_manager.cc:5697] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } }
I20260709 13:11:14.509608 29571 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 3, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:14.519501 29816 raft_consensus.cc:606] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:14.542423 29744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:14.543056 29744 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.543412 29744 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.559427 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:11:14.561076 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 133353us
I20260709 13:11:14.561280 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:14.563444 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 133064us
W20260709 13:11:14.564312 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 130106us
I20260709 13:11:14.572093 29671 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:11:14.572504 29671 pending_rounds.cc:85] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 4
I20260709 13:11:14.572726 29671 pending_rounds.cc:107] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:11:14.572955 29671 raft_consensus.cc:2889] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:14.592352 29744 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.615660 29744 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:14.629441 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:14.630259 29672 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.639918 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:14.664109 29672 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:14.688817 29819 raft_consensus.cc:3055] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.689299 29819 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:14.691591 32178 ts_tablet_manager.cc:1929] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:11:14.692167 32178 log.cc:1199] T 81b2426a3eab4a3993fe9c9a5eb04e3d P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/81b2426a3eab4a3993fe9c9a5eb04e3d
I20260709 13:11:14.693673 29819 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.702026 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:14.704818 31729 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:14.705358 31729 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:14.693213 32155 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:14.712687 31729 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.710387 29819 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.725528 29819 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
W20260709 13:11:14.741001 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 61935.4us
W20260709 13:11:14.742656 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 59534.2us
I20260709 13:11:14.764485 32155 raft_consensus.cc:993] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:14.765022 31838 raft_consensus.cc:1081] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:14.767949 29749 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc891e1e674747fda6007601f64c4341"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:14.768585 29749 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:14.768914 29749 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.779789 29749 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.782256 29671 raft_consensus.cc:1240] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.785691 29749 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:14.789361 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:14.793838 29671 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.795876 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:14.796489 29820 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:14.796770 29820 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:14.797483 29820 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:14.798913 29820 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.820638 29820 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:14.821816 29714 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:14.834555 32169 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:14.835216 32169 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:14.836112 32169 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:15.039029 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 190732us
I20260709 13:11:14.821877 31882 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:15.040046 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 187771us
W20260709 13:11:15.046303 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 191949us
W20260709 13:11:15.047781 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 196010us
I20260709 13:11:15.054256 29671 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
W20260709 13:11:15.046509 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 193070us
I20260709 13:11:15.047648 31882 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:15.094082 32175 ts_tablet_manager.cc:1929] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:11:15.094600 32175 log.cc:1199] T dff620b2062c4139940ec520664442a1 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/dff620b2062c4139940ec520664442a1
W20260709 13:11:15.106645 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50339.4us
I20260709 13:11:15.129388 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet 81b2426a3eab4a3993fe9c9a5eb04e3d (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:15.127038 32175 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48012 (request call id 69) took 1045 ms. Trace:
I20260709 13:11:15.187451 31882 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:15.214956 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 70539.8us
W20260709 13:11:15.218479 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 53583.3us
I20260709 13:11:15.224123 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:15.227057 29672 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:15.225490 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:15.250902 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:15.248051 31729 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:11:15.261642 31964 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:15.164048 32175 rpcz_store.cc:276] 0709 13:11:14.067941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.068153 (+   212us) service_pool.cc:224] Handling call
0709 13:11:14.296834 (+228681us) ts_tablet_manager.cc:1151] Deleting tablet dff620b2062c4139940ec520664442a1
0709 13:11:14.296946 (+   112us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:11:14.696610 (+399664us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:15.086360 (+389750us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:15.112684 (+ 26324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78622,"tablet-delete.queue_time_us":190395,"thread_start_us":100335,"threads_started":1}
W20260709 13:11:15.283054 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 179505us
I20260709 13:11:15.288231 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet dff620b2062c4139940ec520664442a1 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:15.304836 29816 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:15.307633 32119 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:11:15.321508 29559 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 222c2ac209fd4c24a1f636fff5c13739 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a9d8198d0b954886af452e89a8029614 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:15.327104 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 248842us
I20260709 13:11:15.419373 29674 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:15.430099 32119 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:11:15.455467 29816 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:15.462853 32146 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:15.556242 29571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 204) took 13515 ms (client timeout 15000 ms). Trace:
I20260709 13:11:15.556421 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet dff620b2062c4139940ec520664442a1 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:15.557495 29569 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.562351 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:15.563711 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet dff620b2062c4139940ec520664442a1 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:15.572003 29569 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.573746 29569 catalog_manager.cc:5697] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.575310 29569 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.584573 29569 catalog_manager.cc:5697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
W20260709 13:11:15.576282 29571 rpcz_store.cc:269] 0709 13:11:02.040578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:02.043391 (+  2813us) service_pool.cc:224] Handling call
0709 13:11:15.556182 (+13512791us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:15.171111 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:15.248269 (+ 77158us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:15.248985 (+   716us) write_op.cc:435] Acquired schema lock
0709 13:11:15.250582 (+  1597us) tablet.cc:662] Decoding operations
0709 13:11:15.275943 (+ 25361us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:15.275998 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:15.276023 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:11:15.277292 (+  1269us) tablet.cc:701] Row locks acquired
0709 13:11:15.277311 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:15.277457 (+   146us) write_op.cc:270] Start()
0709 13:11:15.277577 (+   120us) write_op.cc:276] Timestamp: P: 1783602675277419 usec, L: 0
0709 13:11:15.277599 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:15.278262 (+   663us) log.cc:844] Serialized 4805 byte log entry
0709 13:11:15.431832 (+153570us) op_driver.cc:464] REPLICATION: finished
0709 13:11:15.474265 (+ 42433us) write_op.cc:301] APPLY: starting
0709 13:11:15.474355 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:15.474590 (+   235us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:15.474779 (+   189us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:15.476134 (+  1355us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:15.476350 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:11:15.476404 (+    54us) write_op.cc:312] APPLY: finished
0709 13:11:15.482556 (+  6152us) log.cc:844] Serialized 88 byte log entry
0709 13:11:15.483374 (+   818us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.483514 (+   140us) write_op.cc:454] Released schema lock
0709 13:11:15.483565 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:15.483937 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.483967 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":130222,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":42162,"apply.run_cpu_time_us":3179,"apply.run_wall_time_us":9648,"num_ops":12,"prepare.queue_time_us":428686,"prepare.run_cpu_time_us":9418,"prepare.run_wall_time_us":174987,"raft.queue_time_us":103316,"raft.run_cpu_time_us":7601,"raft.run_wall_time_us":9687,"replication_time_us":154067,"thread_start_us":546518,"threads_started":4,"wal-append.queue_time_us":47880}]]}
I20260709 13:11:15.594251 29569 catalog_manager.cc:5697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:15.596777 29569 catalog_manager.cc:5697] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 3, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.598328 29569 catalog_manager.cc:5697] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.599766 29569 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 5 to 6, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.604159 29569 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.609129 29569 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.610714 29569 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 3, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.612337 29569 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.625123 29569 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.626708 29569 catalog_manager.cc:5697] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 3, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.636660 29569 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.638150 29569 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 7, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.639488 29569 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.640980 29569 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 1 to 5, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.642426 29569 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.645449 29569 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 5, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.653748 29569 catalog_manager.cc:5697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 4, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.655167 29569 catalog_manager.cc:5697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 5, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.818428 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:15.866669 29572 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.869059 29572 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 6, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:15.871649 29572 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 4 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.891378 29572 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 1 to 3, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 3 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.928629 30348 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:15.932313 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 83) took 1607 ms. Trace:
I20260709 13:11:15.932839 29572 rpcz_store.cc:276] 0709 13:11:14.325314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.325458 (+   144us) service_pool.cc:224] Handling call
0709 13:11:15.932220 (+1606762us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:15.895935 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:15.896473 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:15.896509 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:11:15.896525 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:15.897074 (+   549us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:15.897127 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:15.897153 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:11:15.897537 (+   384us) tablet.cc:701] Row locks acquired
0709 13:11:15.897556 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:11:15.897699 (+   143us) write_op.cc:270] Start()
0709 13:11:15.897819 (+   120us) write_op.cc:276] Timestamp: P: 1783602675897650 usec, L: 0
0709 13:11:15.897844 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:11:15.898374 (+   530us) log.cc:844] Serialized 1748 byte log entry
0709 13:11:15.900231 (+  1857us) op_driver.cc:464] REPLICATION: finished
0709 13:11:15.900713 (+   482us) write_op.cc:301] APPLY: starting
0709 13:11:15.900789 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:15.900934 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:15.901023 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:15.901469 (+   446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:15.901631 (+   162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:11:15.901675 (+    44us) write_op.cc:312] APPLY: finished
0709 13:11:15.901901 (+   226us) log.cc:844] Serialized 40 byte log entry
0709 13:11:15.902099 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.902198 (+    99us) write_op.cc:454] Released schema lock
0709 13:11:15.902853 (+   655us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:15.903218 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.903246 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34855,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":1855,"apply.run_wall_time_us":2461,"num_ops":4,"prepare.queue_time_us":161,"prepare.run_cpu_time_us":2677,"prepare.run_wall_time_us":2712,"replication_time_us":2245}]]}
I20260709 13:11:15.955693 29744 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:15.957286 31895 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:15.960969 29674 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:15.961755 29569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50500 (request call id 198) took 4254 ms. Trace:
I20260709 13:11:15.962236 29569 rpcz_store.cc:276] 0709 13:11:11.707173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.707399 (+   226us) service_pool.cc:224] Handling call
0709 13:11:15.961676 (+4254277us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:15.745697 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:15.786371 (+ 40674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:15.787966 (+  1595us) write_op.cc:435] Acquired schema lock
0709 13:11:15.787985 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:15.832130 (+ 44145us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:15.832186 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:15.832214 (+    28us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:11:15.833868 (+  1654us) tablet.cc:701] Row locks acquired
0709 13:11:15.833884 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:11:15.834085 (+   201us) write_op.cc:270] Start()
0709 13:11:15.834196 (+   111us) write_op.cc:276] Timestamp: P: 1783602675834026 usec, L: 0
0709 13:11:15.834215 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:15.836426 (+  2211us) log.cc:844] Serialized 9073 byte log entry
0709 13:11:15.843070 (+  6644us) op_driver.cc:464] REPLICATION: finished
0709 13:11:15.843378 (+   308us) write_op.cc:301] APPLY: starting
0709 13:11:15.843462 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:15.843861 (+   399us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:15.843962 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:15.846138 (+  2176us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:15.846654 (+   516us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:11:15.846700 (+    46us) write_op.cc:312] APPLY: finished
0709 13:11:15.847113 (+   413us) log.cc:844] Serialized 157 byte log entry
0709 13:11:15.847961 (+   848us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.848154 (+   193us) write_op.cc:454] Released schema lock
0709 13:11:15.848210 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:15.851232 (+  3022us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:15.851262 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":346345,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":90,"apply.run_cpu_time_us":4525,"apply.run_wall_time_us":7799,"num_ops":23,"prepare.queue_time_us":3137,"prepare.run_cpu_time_us":6991,"prepare.run_wall_time_us":110468,"replication_time_us":8679,"spinlock_wait_cycles":4864}]]}
I20260709 13:11:15.966154 31895 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:15.971407 29570 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 5, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.977568 29570 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 4, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.981297 29570 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:15.985817 29570 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:15.995793 29570 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 2 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.003122 29570 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.004369 29671 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:16.013095 29743 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:16.004809 29570 catalog_manager.cc:5697] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.001024 32138 raft_consensus.cc:2955] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:16.046679 29570 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 5, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.048524 29570 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 6 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.051226 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1cc4f503726e4efd8620c27deea0b183 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:16.060313 29570 catalog_manager.cc:5697] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.066159 29570 catalog_manager.cc:5697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 6 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.070923 29570 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.072294 29570 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.077458 29570 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 2 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.079574 29570 catalog_manager.cc:5697] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.080909 29570 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.083986 29570 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 6, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.087898 29570 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 6 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.089293 29570 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 6 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.091980 29570 catalog_manager.cc:5697] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.093264 29570 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 1 to 2, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.165300 29572 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.209144 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cc4f503726e4efd8620c27deea0b183 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:16.220194 29674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:16.220906 29674 raft_consensus.cc:606] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:16.225303 29671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43661428e7964263870fe7a8e07bf265"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:16.226027 29671 raft_consensus.cc:606] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:16.226362 29671 raft_consensus.cc:614] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:16.237654 29674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:16.238289 29674 raft_consensus.cc:606] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:16.240098 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:16.240831 32208 tablet_replica.cc:333] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:16.241901 32208 raft_consensus.cc:2243] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:16.242799 32208 raft_consensus.cc:2272] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:16.256887 32208 ts_tablet_manager.cc:1916] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:16.257529 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:16.258540 29571 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.262859 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50490 (request call id 188) took 1213 ms. Trace:
I20260709 13:11:16.267855 29571 catalog_manager.cc:5697] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 5 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:11:16.273793 29571 catalog_manager.cc:5697] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.268512 29570 rpcz_store.cc:276] 0709 13:11:15.049485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.050779 (+  1294us) service_pool.cc:224] Handling call
0709 13:11:16.262789 (+1212010us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:16.143170 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:16.143690 (+   520us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:16.143726 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:11:16.143743 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:16.145260 (+  1517us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:16.145317 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:16.145344 (+    27us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:11:16.146747 (+  1403us) tablet.cc:701] Row locks acquired
0709 13:11:16.146764 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:11:16.146907 (+   143us) write_op.cc:270] Start()
0709 13:11:16.147024 (+   117us) write_op.cc:276] Timestamp: P: 1783602676146863 usec, L: 0
0709 13:11:16.147041 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:11:16.147741 (+   700us) log.cc:844] Serialized 8301 byte log entry
0709 13:11:16.150432 (+  2691us) op_driver.cc:464] REPLICATION: finished
0709 13:11:16.150862 (+   430us) write_op.cc:301] APPLY: starting
0709 13:11:16.150954 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:16.151321 (+   367us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:16.151412 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:16.153203 (+  1791us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:16.153473 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:11:16.153519 (+    46us) write_op.cc:312] APPLY: finished
0709 13:11:16.153891 (+   372us) log.cc:844] Serialized 144 byte log entry
0709 13:11:16.156128 (+  2237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.156311 (+   183us) write_op.cc:454] Released schema lock
0709 13:11:16.156368 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:16.156670 (+   302us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:16.156696 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3203,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":232,"apply.run_cpu_time_us":3799,"apply.run_wall_time_us":5773,"num_ops":21,"prepare.queue_time_us":122,"prepare.run_cpu_time_us":4902,"prepare.run_wall_time_us":12681,"replication_time_us":3279}]]}
I20260709 13:11:16.370366 32208 ts_tablet_manager.cc:1929] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:11:16.370998 32208 log.cc:1199] T 1cc4f503726e4efd8620c27deea0b183 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/1cc4f503726e4efd8620c27deea0b183
I20260709 13:11:16.381354 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet 1cc4f503726e4efd8620c27deea0b183 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:16.392640 32121 raft_consensus.cc:993] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:16.393116 32121 raft_consensus.cc:1081] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:16.397425 29820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51152
I20260709 13:11:16.398017 29820 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.398401 29820 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.398315 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cc4f503726e4efd8620c27deea0b183 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:16.412819 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet 1cc4f503726e4efd8620c27deea0b183 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:16.417609 29820 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:16.420367 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:16.420969 29674 raft_consensus.cc:3055] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:16.421270 29674 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:16.422431 29674 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:16.423563 29674 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.442830 31986 raft_consensus.cc:993] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:16.443427 32121 raft_consensus.cc:1081] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:16.444283 29820 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:16.446171 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:16.446797 29744 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.446722 29742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:11:16.446688 29674 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:16.447579 29742 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:16.447956 29742 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.448457 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:16.456166 29744 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:16.455564 31838 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:16.461264 31838 raft_consensus.cc:697] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:16.462162 31838 consensus_queue.cc:237] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:16.470455 29742 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:16.472378 29742 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:16.473335 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:16.473941 29671 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:16.474251 29671 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:16.476346 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:16.476900 29820 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.474948 29671 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:16.478744 29671 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.495855 29820 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:16.497550 29714 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:16.498467 32119 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:16.498974 32119 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:16.500574 29671 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:16.504222 32119 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:16.524297 29570 catalog_manager.cc:5697] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:16.570039 29570 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 7 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:16.875705 29671 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:16.878263 32015 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:16.916266 29816 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:16.917722 32119 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:16.965196 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 44762.4us
I20260709 13:11:16.990327 29672 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:16.997577 32119 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:17.028966 29743 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:17.051430 31838 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:17.275978 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:17.376027 30348 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:17.404556 29743 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:17.405627 29672 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:17.407876 31894 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:17.409725 31894 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:17.435976 32138 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:17.439121 29743 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:17.439882 29671 raft_consensus.cc:2955] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:17.504454 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 222c2ac209fd4c24a1f636fff5c13739 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:11:17.514257 29570 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 4 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.590271 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:17.605939 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet 222c2ac209fd4c24a1f636fff5c13739 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:17.634040 32229 tablet_replica.cc:333] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:17.635164 32229 raft_consensus.cc:2243] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:17.636018 32229 raft_consensus.cc:2272] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.646708 32229 ts_tablet_manager.cc:1916] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:17.720569 32229 ts_tablet_manager.cc:1929] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:11:17.725510 32229 log.cc:1199] T 222c2ac209fd4c24a1f636fff5c13739 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/222c2ac209fd4c24a1f636fff5c13739
I20260709 13:11:17.727787 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet 222c2ac209fd4c24a1f636fff5c13739 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:17.747028 29743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:11:17.747646 29743 raft_consensus.cc:606] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:17.764098 29672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:17.764732 29672 raft_consensus.cc:606] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:17.767549 29672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:17.768155 29672 raft_consensus.cc:606] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:17.770085 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:17.771765 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:17.883337 32222 raft_consensus.cc:993] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:17.883913 32222 raft_consensus.cc:1081] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:17.889598 29820 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51152
I20260709 13:11:17.890193 29820 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.890544 29820 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:17.902766 29820 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:17.905633 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:17.906265 29672 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:17.906554 29672 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:17.907267 29672 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:17.908291 29672 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:17.920778 29672 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:17.928697 29820 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:17.932492 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:17.933290 32215 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:17.933796 32215 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:17.934607 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:17.934973 32215 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:17.935259 29743 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:17.942548 29743 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:17.963804 29571 catalog_manager.cc:5697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 5 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 6 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:17.978801 31941 raft_consensus.cc:993] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:17.979272 31941 raft_consensus.cc:1081] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:17.980786 29743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:11:17.981315 29743 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:17.981648 29743 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:17.988145 29743 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:17.990989 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:17.991586 29671 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:17.991888 29671 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:17.992622 29671 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:17.993673 29671 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.010210 29671 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:18.011459 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:18.012609 32119 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:18.013085 32119 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:18.013218 29743 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:18.013893 32119 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:18.035104 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:18.035697 30348 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.076687 32233 raft_consensus.cc:993] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:18.077230 32233 raft_consensus.cc:1081] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:18.086671 30348 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:18.090731 29571 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 7 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:18.098431 29816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51156
I20260709 13:11:18.099027 29816 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:18.099377 29816 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:18.125988 29816 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:18.132225 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:18.132869 29673 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:18.139889 29673 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:18.141624 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:18.142344 29743 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:18.142675 29743 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:18.143401 29743 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:18.144513 29743 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:18.152247 29743 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:18.153386 29787 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:18.154276 32215 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:18.154786 32215 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:18.155661 32215 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:18.141448 29816 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:18.179572 29571 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:18.384887 29746 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:18.386497 32209 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:18.454840 29673 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:18.457823 32209 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:18.510690 29671 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:18.517093 32207 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:18.587937 30348 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:18.597646 32207 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:18.690871 29742 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:18.693655 31838 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:18.773257 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:18.834538 29674 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:18.873121 32209 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:11:19.178544 29674 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:11:19.219228 29640 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 924dd112e90f41f492fd016c204c1a21. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.220558 29741 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:19.229046 29816 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:19.235260 32247 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:19.236657 32121 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:19.242235 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:19.301865 32245 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.309376 29744 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.322347 29816 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.362403 29571 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.396476 29744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:11:19.397603 29744 raft_consensus.cc:606] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:19.411302 29744 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:19.419706 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:19.422106 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:19.454073 29715 consensus_peers.cc:597] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d5d5d9cc0034eee95e6e5d81dfcaeeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.460137 29674 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:19.460799 29816 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:19.463800 32207 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:19.467139 32234 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:19.536983 32234 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.550762 29816 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.559635 29674 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.585321 32233 raft_consensus.cc:993] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:19.586021 32233 raft_consensus.cc:1081] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:19.588281 29569 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.602449 29672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45248
I20260709 13:11:19.603147 29672 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:19.603487 29672 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.621814 29741 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:11:19.631738 29715 consensus_peers.cc:597] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fba8307a3fdc4b40993f8208111c67f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.632552 29671 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:19.634308 32233 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:19.636168 29816 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:19.639595 32207 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:19.665194 32265 ts_tablet_manager.cc:933] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:19.681176 32207 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.682260 29674 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.668427 29672 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:19.687685 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:19.688326 29741 raft_consensus.cc:3055] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:19.688639 29741 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:19.689514 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:19.689426 29741 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:19.690750 29741 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.689975 29819 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.690102 29820 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.687825 29672 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:19.703994 29741 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:11:19.718981 29820 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:11:19.720492 29639 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:19.722498 32121 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:19.723003 32121 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:19.723948 32121 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:19.725883 32265 tablet_copy_client.cc:323] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:19.729786 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet 924dd112e90f41f492fd016c204c1a21 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:19.730418 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet 924dd112e90f41f492fd016c204c1a21 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-924dd112e90f41f492fd016c204c1a21
I20260709 13:11:19.735772 29569 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.764017 29684 tablet_copy_source_session.cc:215] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:19.773015 29674 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:19.774326 32265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924dd112e90f41f492fd016c204c1a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.804311 29571 catalog_manager.cc:5697] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 9 to 10, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 10 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:19.822851 29640 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5fd36b246f24922bf4e9f9658c19013. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:19.824270 29819 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:19.824541 29744 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:19.827265 32247 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:19.831633 32245 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:19.832404 32265 tablet_copy_client.cc:806] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:19.833133 32265 tablet_copy_client.cc:670] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:19.847007 32265 tablet_copy_client.cc:538] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:19.860653 32265 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:19.863670 32121 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.865362 29816 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:19.906020 29571 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.926550 29746 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:20.010571 32265 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=2 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:20.011663 32265 tablet_bootstrap.cc:492] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:20.012516 32265 ts_tablet_manager.cc:1403] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.152s	user 0.024s	sys 0.015s
I20260709 13:11:20.015906 32265 raft_consensus.cc:359] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:20.022123 32265 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:20.026496 32265 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:20.038323 32265 ts_tablet_manager.cc:1434] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:11:20.051853 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-924dd112e90f41f492fd016c204c1a21 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:20.052371 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-924dd112e90f41f492fd016c204c1a21 on tablet 924dd112e90f41f492fd016c204c1a21 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:20.056939 32274 ts_tablet_manager.cc:933] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:20.107317 32274 tablet_copy_client.cc:323] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:11:20.107950 30348 raft_consensus.cc:1217] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Deduplicated request from leader. Original: 8.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:11:20.115082 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:11:20.115705 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-4d5d5d9cc0034eee95e6e5d81dfcaeeb
I20260709 13:11:20.166872 32265 ts_tablet_manager.cc:933] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:20.181236 29759 tablet_copy_source_session.cc:215] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:20.193964 32274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.191818 32265 tablet_copy_client.cc:323] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:11:20.212355 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet fba8307a3fdc4b40993f8208111c67f1 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:11:20.212940 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet fba8307a3fdc4b40993f8208111c67f1 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-fba8307a3fdc4b40993f8208111c67f1
I20260709 13:11:20.226055 32274 tablet_copy_client.cc:806] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:20.226821 32274 tablet_copy_client.cc:670] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:20.228456 29759 tablet_copy_source_session.cc:215] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:20.254161 32274 tablet_copy_client.cc:538] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:20.260233 32265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba8307a3fdc4b40993f8208111c67f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.283851 29746 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:20.286397 32246 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:20.294243 32277 ts_tablet_manager.cc:933] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:20.312415 32274 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:20.338553 29816 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:20.338850 32265 tablet_copy_client.cc:806] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:20.341025 32265 tablet_copy_client.cc:670] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:20.341509 32247 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:20.361652 32277 tablet_copy_client.cc:323] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:20.411644 32265 tablet_copy_client.cc:538] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:20.423271 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:20.424149 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet c5fd36b246f24922bf4e9f9658c19013 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:20.424757 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet c5fd36b246f24922bf4e9f9658c19013 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-c5fd36b246f24922bf4e9f9658c19013
W20260709 13:11:20.468357 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 47757.9us
W20260709 13:11:20.468734 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 48664.3us
W20260709 13:11:20.532557 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 66945.7us
I20260709 13:11:20.547408 29684 tablet_copy_source_session.cc:215] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:20.553771 32277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5fd36b246f24922bf4e9f9658c19013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.572665 32265 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:20.698199 32283 raft_consensus.cc:1064] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:20.700870 32283 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 3, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:20.728221 32274 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:20.729266 32274 tablet_bootstrap.cc:492] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:20.730029 32274 ts_tablet_manager.cc:1403] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.418s	user 0.036s	sys 0.014s
I20260709 13:11:20.753630 32277 tablet_copy_client.cc:806] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
W20260709 13:11:20.781699 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58847.6us
I20260709 13:11:20.777422 32277 tablet_copy_client.cc:670] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:20.806989 32277 tablet_copy_client.cc:538] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:20.827340 32274 raft_consensus.cc:359] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:20.828302 32274 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:20.829037 32274 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:20.848542 32265 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:20.849690 32265 tablet_bootstrap.cc:492] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:20.850569 32265 ts_tablet_manager.cc:1403] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.278s	user 0.032s	sys 0.006s
I20260709 13:11:20.873370 30348 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:20.874631 29816 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:20.876016 32277 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:20.853662 32265 raft_consensus.cc:359] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:20.996461 32265 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:20.997460 32265 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:20.876379 32288 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:20.987927 32274 ts_tablet_manager.cc:1434] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.258s	user 0.007s	sys 0.000s
I20260709 13:11:20.994966 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:11:21.007009 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 129085us
I20260709 13:11:21.077028 32265 ts_tablet_manager.cc:1434] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.226s	user 0.009s	sys 0.002s
I20260709 13:11:21.084583 32283 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:21.085994 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 208833us
I20260709 13:11:21.142645 29758 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fba8307a3fdc4b40993f8208111c67f1 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:11:21.143164 29758 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fba8307a3fdc4b40993f8208111c67f1 on tablet fba8307a3fdc4b40993f8208111c67f1 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:21.146203 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-4d5d5d9cc0034eee95e6e5d81dfcaeeb received from {username='slave'} at 127.0.0.1:36354
I20260709 13:11:21.146713 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-4d5d5d9cc0034eee95e6e5d81dfcaeeb on tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:21.204741 30350 raft_consensus.cc:1217] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
W20260709 13:11:21.214473 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 188952us
W20260709 13:11:21.278144 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 100984us
I20260709 13:11:21.303532 30348 raft_consensus.cc:1217] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Deduplicated request from leader. Original: 6.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 13:11:21.337513 32277 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=1 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:21.338500 32277 tablet_bootstrap.cc:492] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:21.339205 32277 ts_tablet_manager.cc:1403] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.463s	user 0.024s	sys 0.012s
I20260709 13:11:21.347226 32121 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.352154 29820 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.357509 29744 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:11:21.366166 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 192456us
I20260709 13:11:21.372004 32277 raft_consensus.cc:359] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:21.372910 32277 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:21.373569 32277 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:21.390803 30348 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.397948 32277 ts_tablet_manager.cc:1434] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:11:21.405262 32247 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:21.412900 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-c5fd36b246f24922bf4e9f9658c19013 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:21.413429 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-c5fd36b246f24922bf4e9f9658c19013 on tablet c5fd36b246f24922bf4e9f9658c19013 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:21.432928 29668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:21.433558 29668 raft_consensus.cc:606] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:21.436471 29571 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.454491 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:21.456207 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:21.486455 29744 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.532267 32207 raft_consensus.cc:1064] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:21.548192 29668 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:21.555497 30348 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:21.557680 32246 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:21.559281 32207 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:21.568594 32247 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.579250 29819 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:21.576347 30348 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.580937 32121 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:21.587872 29819 raft_consensus.cc:2955] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.637578 30350 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.639333 32286 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:21.651233 29814 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.662565 29569 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.663024 32290 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:21.714586 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 924dd112e90f41f492fd016c204c1a21 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:21.738719 32290 raft_consensus.cc:1064] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:21.740762 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 924dd112e90f41f492fd016c204c1a21 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:21.743343 32290 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:21.752559 32322 tablet_replica.cc:333] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:11:21.753723 32322 raft_consensus.cc:2243] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:21.755715 32322 raft_consensus.cc:2272] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:21.767622 32322 ts_tablet_manager.cc:1916] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:21.831525 32264 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.867981 29674 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:21.878216 29816 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.882349 29820 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:21.886320 30348 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:21.906224 29674 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:21.906416 30350 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:21.878562 32207 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:11:21.930343 30350 raft_consensus.cc:1217] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Deduplicated request from leader. Original: 8.4->[8.5-8.5]   Dedup: 8.5->[]
I20260709 13:11:21.913968 32264 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:11:21.926569 29572 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.975535 32286 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:21.976514 32290 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:21.981470 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 58829.7us
W20260709 13:11:22.003589 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 77358.7us
I20260709 13:11:22.068414 32322 ts_tablet_manager.cc:1929] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 13:11:22.068966 32322 log.cc:1199] T 924dd112e90f41f492fd016c204c1a21 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/924dd112e90f41f492fd016c204c1a21
I20260709 13:11:22.068966 29743 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:22.098258 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 57025.1us
I20260709 13:11:22.084214 32325 raft_consensus.cc:993] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:22.104281 29674 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.102500 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 924dd112e90f41f492fd016c204c1a21 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:22.108804 32246 raft_consensus.cc:1081] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:22.134974 32207 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.147946 29743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:11:22.148567 29743 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:22.148947 29743 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.158470 29671 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.178145 29743 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:22.189584 29743 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:22.190397 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:22.191080 29668 raft_consensus.cc:3055] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:22.191351 29668 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:22.192102 29668 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:22.207521 29668 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:22.209645 32335 log.cc:927] Time spent T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:11:22.214488 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 125065us
I20260709 13:11:22.235888 29668 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:22.239957 29715 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:22.242110 32284 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:22.242637 32284 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:22.243490 32284 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:22.259954 29821 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:22.292533 29570 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.298382 29821 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.319687 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:22.320382 29820 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:22.329998 29572 catalog_manager.cc:5697] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 3 to 4, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.344000 29820 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
W20260709 13:11:22.350385 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 139439us
I20260709 13:11:22.382930 32284 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:22.385340 29741 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:22.396533 30350 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:22.397403 30345 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.408806 30344 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:22.446588 32207 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:22.448899 32207 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:22.450593 29820 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:22.457744 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:22.459183 32332 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:22.467020 32290 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.467022 32234 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.470605 30345 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.469605 30344 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.477348 29816 raft_consensus.cc:2955] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.482545 29821 raft_consensus.cc:2955] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.501212 29570 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.512578 29572 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 5 to 6, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 4 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.520622 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fba8307a3fdc4b40993f8208111c67f1 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:22.538615 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet fba8307a3fdc4b40993f8208111c67f1 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:22.541183 29662 tablet_service.cc:1558] Processing DeleteTablet for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:22.547407 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:22.569952 32247 raft_consensus.cc:1064] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:22.572746 32247 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 3, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:22.693851 32345 tablet_replica.cc:333] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:11:22.695008 32345 raft_consensus.cc:2243] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:22.695957 32345 raft_consensus.cc:2272] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:22.721650 32345 ts_tablet_manager.cc:1916] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:22.725302 29816 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:22.727447 32288 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:22.742362 30344 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:22.748224 32247 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:22.754365 29746 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:22.755805 29821 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:22.758286 32207 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:22.758500 32288 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:22.819680 29672 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:22.821779 32290 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:22.838578 29816 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.835184 32247 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.858402 30345 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:22.863898 32347 log.cc:927] Time spent T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:22.864428 29569 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.875842 29746 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.924131 29670 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:22.939843 30345 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:22.941771 32325 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:22.950676 32246 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.959378 32345 ts_tablet_manager.cc:1929] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 13:11:22.959874 32345 log.cc:1199] T fba8307a3fdc4b40993f8208111c67f1 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/fba8307a3fdc4b40993f8208111c67f1
I20260709 13:11:22.961956 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet fba8307a3fdc4b40993f8208111c67f1 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:22.962713 32345 tablet_replica.cc:333] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:11:22.958585 30345 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:22.964203 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5fd36b246f24922bf4e9f9658c19013 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:22.998247 29741 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:11:23.010362 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 46176.4us
I20260709 13:11:23.011458 32246 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:23.017059 29741 raft_consensus.cc:2955] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:23.027346 29569 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:23.040601 32345 raft_consensus.cc:2243] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:23.046030 32345 raft_consensus.cc:2272] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:23.052320 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet c5fd36b246f24922bf4e9f9658c19013 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:23.060987 32355 tablet_replica.cc:333] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:23.182358 32345 ts_tablet_manager.cc:1916] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:23.195026 32355 raft_consensus.cc:2243] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:23.231316 32355 raft_consensus.cc:2272] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:23.244380 32355 ts_tablet_manager.cc:1916] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:23.254804 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:23.310034 29741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:11:23.310663 29741 raft_consensus.cc:606] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:23.312427 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:23.315095 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:23.357291 32345 ts_tablet_manager.cc:1929] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:11:23.363024 32345 log.cc:1199] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/4d5d5d9cc0034eee95e6e5d81dfcaeeb
I20260709 13:11:23.364810 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet 4d5d5d9cc0034eee95e6e5d81dfcaeeb (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:23.357908 32355 ts_tablet_manager.cc:1929] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.6
I20260709 13:11:23.365720 32355 log.cc:1199] T c5fd36b246f24922bf4e9f9658c19013 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/c5fd36b246f24922bf4e9f9658c19013
I20260709 13:11:23.367578 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet c5fd36b246f24922bf4e9f9658c19013 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:23.490167 32360 raft_consensus.cc:993] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:23.490711 32360 raft_consensus.cc:1081] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:23.493319 29672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45248
I20260709 13:11:23.493975 29672 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:23.494364 29672 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:23.518167 29672 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:23.531656 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:23.532260 29741 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:23.532547 29741 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:23.536886 29741 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:23.538244 29672 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:23.538069 29741 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:23.539460 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:23.540033 30345 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:23.547408 29741 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:23.549661 29638 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:23.550602 32325 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:23.551115 32325 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:23.551990 32325 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:23.557662 30345 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:23.568079 29570 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.090552 29746 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:24.093339 30345 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:24.093520 32359 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:24.097249 32359 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:24.155444 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 52920.2us
I20260709 13:11:24.316397 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:24.480613 29816 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:11:24.508860 29789 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43661428e7964263870fe7a8e07bf265. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.510383 29743 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:24.512435 32358 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:24.525750 29672 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:24.532081 32291 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:24.542500 32291 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:24.560117 29670 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:24.588920 29743 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:24.594380 29816 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:24.595268 29569 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.598630 29746 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:24.601681 32369 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:24.603654 32369 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:24.607149 29672 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:24.596451 29640 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0dba966d409c4e37bce58c7db358ebbb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.695768 29816 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:24.705453 29743 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:24.743117 32370 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:24.890265 29814 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:24.949610 29570 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:24.951283 29789 consensus_peers.cc:597] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b03ee62645904e089f0f2c4dffb22b40. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.954661 29744 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:24.956049 29670 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:24.963589 32382 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:24.970341 32382 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:24.992058 32380 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.006510 29668 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.031443 29741 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.159821 32398 ts_tablet_manager.cc:933] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:25.168273 29569 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.204702 29668 consensus_queue.cc:237] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:25.211966 32401 ts_tablet_manager.cc:933] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:25.221316 32398 tablet_copy_client.cc:323] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:11:25.233482 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 43661428e7964263870fe7a8e07bf265 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:11:25.234164 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 43661428e7964263870fe7a8e07bf265 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-43661428e7964263870fe7a8e07bf265
I20260709 13:11:25.236514 32401 tablet_copy_client.cc:323] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:25.238544 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet 0dba966d409c4e37bce58c7db358ebbb from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:25.239120 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet 0dba966d409c4e37bce58c7db358ebbb from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-0dba966d409c4e37bce58c7db358ebbb
I20260709 13:11:25.261237 29814 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:11:25.263648 29640 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6262c59cea24959ab0dd23d4279895c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.264329 32369 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:25.307019 29741 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:25.309571 29833 tablet_copy_source_session.cc:215] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.303498 29684 tablet_copy_source_session.cc:215] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.321380 32369 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:25.333266 32401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dba966d409c4e37bce58c7db358ebbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.339653 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43661428e7964263870fe7a8e07bf265. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.363968 32370 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.365801 29814 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.389436 29741 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.408272 29572 catalog_manager.cc:5697] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:25.446806 32398 tablet_copy_client.cc:806] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.447438 32398 tablet_copy_client.cc:670] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.448654 32401 tablet_copy_client.cc:806] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.449250 32401 tablet_copy_client.cc:670] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.456897 32398 tablet_copy_client.cc:538] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:25.462145 32409 ts_tablet_manager.cc:933] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:25.463984 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:25.458897 32401 tablet_copy_client.cc:538] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:11:25.468109 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 85229.9us
I20260709 13:11:25.505584 32398 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:25.506223 32409 tablet_copy_client.cc:323] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:11:25.507979 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet b03ee62645904e089f0f2c4dffb22b40 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:11:25.508550 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet b03ee62645904e089f0f2c4dffb22b40 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-b03ee62645904e089f0f2c4dffb22b40
I20260709 13:11:25.520121 29833 tablet_copy_source_session.cc:215] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:11:25.533067 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 93007.7us
I20260709 13:11:25.541431 32401 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:25.547919 32409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03ee62645904e089f0f2c4dffb22b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.570142 29668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:25.570786 29668 raft_consensus.cc:606] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:25.572381 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:25.574047 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:25.635762 32398 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:25.638607 32401 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:25.639556 32401 tablet_bootstrap.cc:492] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:25.641485 32398 tablet_bootstrap.cc:492] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:25.642529 32410 raft_consensus.cc:993] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:25.643178 32410 raft_consensus.cc:1081] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:25.645035 32409 tablet_copy_client.cc:806] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.645116 29741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:11:25.649883 29741 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:25.650341 29741 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.650451 32409 tablet_copy_client.cc:670] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:25.657311 29741 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:25.645910 32398 ts_tablet_manager.cc:1403] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.141s	user 0.027s	sys 0.015s
I20260709 13:11:25.659485 32409 tablet_copy_client.cc:538] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:25.660851 32398 raft_consensus.cc:359] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:25.661741 32398 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:25.662429 32398 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:25.640273 32401 ts_tablet_manager.cc:1403] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.099s	user 0.027s	sys 0.004s
I20260709 13:11:25.668001 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:25.668635 29668 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:25.668911 29668 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:25.669670 29668 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:25.671408 29668 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.677138 32401 raft_consensus.cc:359] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:25.678066 32401 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:25.680440 32401 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:25.688805 29668 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:25.705559 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:25.711807 29820 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.713115 32401 ts_tablet_manager.cc:1434] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.004s
I20260709 13:11:25.714931 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-0dba966d409c4e37bce58c7db358ebbb received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:25.715358 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-0dba966d409c4e37bce58c7db358ebbb on tablet 0dba966d409c4e37bce58c7db358ebbb with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:25.728403 32398 ts_tablet_manager.cc:1434] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.000s
I20260709 13:11:25.730517 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-43661428e7964263870fe7a8e07bf265 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:11:25.731004 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-43661428e7964263870fe7a8e07bf265 on tablet 43661428e7964263870fe7a8e07bf265 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:25.737867 29820 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:25.706084 29741 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:25.739629 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:25.744413 32391 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:25.747887 32391 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:25.748848 32391 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:25.749581 32409 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:25.788551 32398 ts_tablet_manager.cc:933] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:25.867028 32398 tablet_copy_client.cc:323] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:25.870484 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet f6262c59cea24959ab0dd23d4279895c from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:25.871053 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet f6262c59cea24959ab0dd23d4279895c from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-f6262c59cea24959ab0dd23d4279895c
I20260709 13:11:25.884430 29684 tablet_copy_source_session.cc:215] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:25.914276 32398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6262c59cea24959ab0dd23d4279895c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:25.900938 29570 catalog_manager.cc:5697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.997642 32398 tablet_copy_client.cc:806] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:25.998317 32398 tablet_copy_client.cc:670] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:26.018213 32398 tablet_copy_client.cc:538] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:26.020833 30345 raft_consensus.cc:1217] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:11:26.048202 32409 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.061296 32398 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:26.079620 32409 tablet_bootstrap.cc:492] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:26.088124 32409 ts_tablet_manager.cc:1403] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.339s	user 0.038s	sys 0.011s
I20260709 13:11:26.091355 32409 raft_consensus.cc:359] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:26.104072 32409 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:26.105144 32409 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:26.115738 32409 ts_tablet_manager.cc:1434] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.004s
I20260709 13:11:26.124375 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-b03ee62645904e089f0f2c4dffb22b40 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:11:26.124842 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-b03ee62645904e089f0f2c4dffb22b40 on tablet b03ee62645904e089f0f2c4dffb22b40 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:26.167136 32398 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:26.168097 32398 tablet_bootstrap.cc:492] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:26.168844 32398 ts_tablet_manager.cc:1403] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.008s
I20260709 13:11:26.185406 32398 raft_consensus.cc:359] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:26.186539 32398 raft_consensus.cc:740] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:26.187198 32398 consensus_queue.cc:260] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:26.190188 32398 ts_tablet_manager.cc:1434] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:11:26.191892 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f6262c59cea24959ab0dd23d4279895c received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:26.192313 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f6262c59cea24959ab0dd23d4279895c on tablet f6262c59cea24959ab0dd23d4279895c with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:26.225376 29820 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:26.227082 32415 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.272742 30345 raft_consensus.cc:1217] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:11:26.277357 29668 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:26.283958 32417 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.339744 30345 raft_consensus.cc:1217] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:11:26.347540 30345 raft_consensus.cc:1217] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:11:26.475414 32291 raft_consensus.cc:1064] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:26.487787 32291 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:26.540707 30345 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:26.542071 32407 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.541386 29746 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:26.552600 29668 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:26.554239 32407 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.570050 32430 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.586344 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:26.612432 32407 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.623057 29668 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.651773 32359 raft_consensus.cc:1064] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:26.653301 29570 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.654531 32359 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:26.655103 30345 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.656944 29741 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.728755 30345 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:26.731137 32410 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.734781 29821 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:26.758550 32438 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.759452 32437 raft_consensus.cc:1064] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:26.762331 32437 consensus_queue.cc:237] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:26.793071 32407 raft_consensus.cc:1064] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:26.796147 32407 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:26.811775 29814 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:26.830618 29668 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:26.832183 29741 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:26.833938 32291 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:26.834697 32366 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:26.834714 30344 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:26.838989 32430 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:26.868148 30344 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:26.868678 32291 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.870522 29744 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:26.871672 32439 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:26.872721 29820 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:11:26.873003 32410 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:26.878242 32410 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:26.881731 29670 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:26.950299 32443 log.cc:927] Time spent T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:11:26.949651 32359 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.959342 29572 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.965022 29814 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.975661 29746 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:26.981963 32410 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:27.020642 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 100470us
I20260709 13:11:27.031041 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43661428e7964263870fe7a8e07bf265 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:27.064796 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 43661428e7964263870fe7a8e07bf265 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:27.098619 30350 raft_consensus.cc:2955] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:27.202425 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 114337us
I20260709 13:11:27.228116 29814 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.257946 30350 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:27.272015 29572 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:27.282485 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 47153.4us
I20260709 13:11:27.286707 29744 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:27.306064 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 52234.1us
I20260709 13:11:27.352123 30350 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.403407 32460 tablet_replica.cc:333] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:11:27.412117 32460 raft_consensus.cc:2243] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:27.404064 32430 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:11:27.419139 32460 raft_consensus.cc:2272] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:27.422994 32460 ts_tablet_manager.cc:1916] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:27.441592 29571 catalog_manager.cc:5697] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:27.474306 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 225472us
W20260709 13:11:27.521546 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 168468us
I20260709 13:11:27.526952 30350 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.531177 29746 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.603379 32479 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:11:27.618052 29668 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:27.625533 32460 ts_tablet_manager.cc:1929] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:11:27.626053 32460 log.cc:1199] T 43661428e7964263870fe7a8e07bf265 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/43661428e7964263870fe7a8e07bf265
I20260709 13:11:27.627894 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 43661428e7964263870fe7a8e07bf265 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
W20260709 13:11:27.637575 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44424.7us
I20260709 13:11:27.657578 32291 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:27.696862 32291 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.710260 30344 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.717258 29746 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.745682 29673 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.733412 29572 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.782555 29819 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:27.787299 29672 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:27.792348 29673 consensus_queue.cc:237] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:27.805792 30350 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:27.806303 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:27.807454 32485 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:27.815584 30350 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:27.816672 29742 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:27.819079 32437 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:27.820130 32485 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:27.823761 30345 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.830900 29821 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:27.831255 32440 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.837481 32471 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:11:27.822266 32485 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.846520 29742 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.850073 30350 raft_consensus.cc:2955] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.871201 29746 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:27.873286 32450 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:27.881892 29820 raft_consensus.cc:2955] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.883492 32380 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.890080 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0dba966d409c4e37bce58c7db358ebbb with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:27.890784 29746 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.898344 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b03ee62645904e089f0f2c4dffb22b40 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:27.904485 30344 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:27.908744 32380 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:27.924153 30348 raft_consensus.cc:2955] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.936336 29572 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.966238 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet 0dba966d409c4e37bce58c7db358ebbb with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:27.973412 29571 catalog_manager.cc:5697] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 5 to 6, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 3 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:27.975219 29571 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:28.003829 32492 tablet_replica.cc:333] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:28.005065 32492 raft_consensus.cc:2243] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:28.008467 32492 raft_consensus.cc:2272] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:28.013501 32492 ts_tablet_manager.cc:1916] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:28.014650 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet f6262c59cea24959ab0dd23d4279895c with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:28.029981 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet b03ee62645904e089f0f2c4dffb22b40 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:28.053467 32460 tablet_replica.cc:333] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:11:28.058315 32460 raft_consensus.cc:2243] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:28.059222 32460 raft_consensus.cc:2272] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:28.064463 32460 ts_tablet_manager.cc:1916] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:28.098299 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6262c59cea24959ab0dd23d4279895c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:28.098853 32493 tablet_replica.cc:333] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:11:28.099921 32493 raft_consensus.cc:2243] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:28.100935 32493 raft_consensus.cc:2272] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:28.103947 29746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:11:28.104589 29746 raft_consensus.cc:606] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:28.109973 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:28.112234 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:28.142804 32460 ts_tablet_manager.cc:1929] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:11:28.143354 32460 log.cc:1199] T f6262c59cea24959ab0dd23d4279895c P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/f6262c59cea24959ab0dd23d4279895c
I20260709 13:11:28.145023 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet f6262c59cea24959ab0dd23d4279895c (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:28.145352 32492 ts_tablet_manager.cc:1929] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:11:28.147866 32493 ts_tablet_manager.cc:1916] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:28.145769 32492 log.cc:1199] T 0dba966d409c4e37bce58c7db358ebbb P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/0dba966d409c4e37bce58c7db358ebbb
I20260709 13:11:28.242821 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet 0dba966d409c4e37bce58c7db358ebbb (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:28.300737 32493 ts_tablet_manager.cc:1929] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:11:28.301258 32493 log.cc:1199] T b03ee62645904e089f0f2c4dffb22b40 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/b03ee62645904e089f0f2c4dffb22b40
I20260709 13:11:28.302933 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet b03ee62645904e089f0f2c4dffb22b40 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:28.562453 32415 raft_consensus.cc:993] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:28.562964 32415 raft_consensus.cc:1081] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:28.564667 29819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51156
I20260709 13:11:28.565229 29819 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:28.565552 29819 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.574602 29819 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:28.583647 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:28.584287 29673 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.592545 29673 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:28.598178 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:28.599086 32452 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:28.599591 32452 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:28.600927 29819 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:28.602056 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:28.602632 29746 raft_consensus.cc:3055] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:28.602818 29746 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:28.603866 29746 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:28.605146 29746 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.603811 32452 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:28.613438 29746 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:28.627249 29571 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 5, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:29.053367 29673 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:29.060102 32291 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:29.113642 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.158788 29746 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:29.205734 32452 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:11:29.307226 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 58301.5us
I20260709 13:11:29.360504 29743 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:11:29.427888 29715 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc891e1e674747fda6007601f64c4341. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:29.438577 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 44875.4us
I20260709 13:11:29.439180 29670 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:29.446341 32507 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:29.457445 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 63875.2us
I20260709 13:11:29.481079 29820 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:29.482779 32417 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:29.486382 32415 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.487751 29670 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.498050 29819 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.510764 29671 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:29.512377 29569 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:29.552770 29820 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:29.554314 32485 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:29.556736 29743 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:29.563581 32485 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:29.565733 32440 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.571596 29814 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:29.619164 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 69717.3us
I20260709 13:11:29.622123 29743 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:29.633157 29640 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27ef48e8ba554972a5c426adeff23599. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:29.645960 29746 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:11:29.666953 29715 consensus_peers.cc:597] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7943a6965d54826a2eee391b1459b90. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:29.667807 29670 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:29.670279 29814 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:29.672744 32415 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:29.674590 32507 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:29.709307 29571 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.755106 32417 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.758702 29670 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.783762 29572 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 7 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.794143 29819 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:29.795781 29814 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:29.851331 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3147da791a394c9da4f7b521dd52a560. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:29.873351 29743 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:29.875607 32291 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:29.881048 29670 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:29.883651 32450 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:29.956584 32450 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.988559 29672 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:29.992080 29743 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:30.010427 29572 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:30.081391 32527 ts_tablet_manager.cc:933] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:30.092190 32526 ts_tablet_manager.cc:933] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:30.102353 32526 tablet_copy_client.cc:323] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:30.104622 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet 27ef48e8ba554972a5c426adeff23599 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:30.104712 32527 tablet_copy_client.cc:323] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:11:30.105448 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet 27ef48e8ba554972a5c426adeff23599 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-27ef48e8ba554972a5c426adeff23599
I20260709 13:11:30.106917 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet fc891e1e674747fda6007601f64c4341 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:11:30.107385 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet fc891e1e674747fda6007601f64c4341 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-fc891e1e674747fda6007601f64c4341
I20260709 13:11:30.115437 29759 tablet_copy_source_session.cc:215] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:30.128248 32527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc891e1e674747fda6007601f64c4341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.182271 29684 tablet_copy_source_session.cc:215] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:30.186401 32526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27ef48e8ba554972a5c426adeff23599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.212690 32530 ts_tablet_manager.cc:933] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:30.231832 32530 tablet_copy_client.cc:323] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:11:30.233690 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet d7943a6965d54826a2eee391b1459b90 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:11:30.234287 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet d7943a6965d54826a2eee391b1459b90 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-d7943a6965d54826a2eee391b1459b90
I20260709 13:11:30.267509 29759 tablet_copy_source_session.cc:215] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:30.278856 32530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7943a6965d54826a2eee391b1459b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.308106 32527 tablet_copy_client.cc:806] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:30.313787 32527 tablet_copy_client.cc:670] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:30.330132 32532 ts_tablet_manager.cc:933] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:30.331555 32527 tablet_copy_client.cc:538] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:30.343869 32527 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:30.347851 32532 tablet_copy_client.cc:323] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:11:30.350847 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 3147da791a394c9da4f7b521dd52a560 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:11:30.352651 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 3147da791a394c9da4f7b521dd52a560 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-3147da791a394c9da4f7b521dd52a560
I20260709 13:11:30.362382 29833 tablet_copy_source_session.cc:215] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:30.370458 32530 tablet_copy_client.cc:806] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:30.386350 32530 tablet_copy_client.cc:670] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:30.374480 32526 tablet_copy_client.cc:806] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:30.387938 32532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3147da791a394c9da4f7b521dd52a560. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:30.388387 32526 tablet_copy_client.cc:670] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:30.404552 32530 tablet_copy_client.cc:538] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:30.410357 32526 tablet_copy_client.cc:538] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:30.429164 32526 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:30.441500 32530 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:30.536417 32532 tablet_copy_client.cc:806] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:30.557798 32532 tablet_copy_client.cc:670] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:30.573606 32532 tablet_copy_client.cc:538] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:30.612222 32532 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:30.664589 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:30.712112 32532 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:30.713850 32532 tablet_bootstrap.cc:492] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:30.721134 32532 ts_tablet_manager.cc:1403] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.008s
I20260709 13:11:31.415293 32527 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.416388 32527 tablet_bootstrap.cc:492] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:31.417150 32527 ts_tablet_manager.cc:1403] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 1.074s	user 0.046s	sys 0.020s
I20260709 13:11:31.500401 32526 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.501449 32526 tablet_bootstrap.cc:492] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:31.502249 32526 ts_tablet_manager.cc:1403] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 1.073s	user 0.038s	sys 0.000s
I20260709 13:11:31.508018 32532 raft_consensus.cc:359] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.515342 32532 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:31.516342 32532 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.514412 32527 raft_consensus.cc:359] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.517674 32527 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:31.518386 32527 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.522426 32532 ts_tablet_manager.cc:1434] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.800s	user 0.009s	sys 0.008s
W20260709 13:11:31.522807 32532 ts_tablet_manager.cc:1467] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Tablet startup took 800ms
W20260709 13:11:31.523147 32532 ts_tablet_manager.cc:1469] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Trace:
0709 13:11:30.316775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.316918 (+   143us) service_pool.cc:224] Handling call
0709 13:11:30.330598 (+ 13680us) ts_tablet_manager.cc:934] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
0709 13:11:30.386730 (+ 56132us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:30.399289 (+ 12559us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:30.399415 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:30.466911 (+ 67496us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:30.467230 (+   319us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:30.467528 (+   298us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:30.467592 (+    64us) inbound_call.cc:177] Queueing success response
0709 13:11:30.602996 (+135404us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:11:30.722662 (+119666us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:11:31.505603 (+782941us) tablet_replica.cc:261] Starting instrumentation
0709 13:11:31.506225 (+   622us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":369,"raft.queue_time_us":2110,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"tablet-copy.queue_time_us":12587,"tablet-download-pool.queue_time_us":120,"tablet-download-pool.run_cpu_time_us":1093,"tablet-download-pool.run_wall_time_us":8324,"thread_start_us":24845,"threads_started":2}
W20260709 13:11:31.530344 32530 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.021s	sys 0.003s
W20260709 13:11:31.530786 32530 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.021s	sys 0.003s
I20260709 13:11:31.531656 32526 raft_consensus.cc:359] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.532652 32526 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:31.534170 32527 ts_tablet_manager.cc:1434] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
I20260709 13:11:31.534674 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-3147da791a394c9da4f7b521dd52a560 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:11:31.535166 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-3147da791a394c9da4f7b521dd52a560 on tablet 3147da791a394c9da4f7b521dd52a560 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:31.643582 32549 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:31.644203 32549 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.644059 32526 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.646744 32526 ts_tablet_manager.cc:1434] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.000s
I20260709 13:11:31.649008 32549 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:31.654693 32450 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:31.655351 32450 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:31.657423 32450 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:31.659382 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:31.661188 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:31.666875 32450 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:31.667459 32450 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:31.670486 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:31.673007 32450 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:31.683679 32530 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.684793 32530 tablet_bootstrap.cc:492] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:31.687268 32530 ts_tablet_manager.cc:1403] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 1.246s	user 0.052s	sys 0.005s
W20260709 13:11:31.702879 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 61249.6us
I20260709 13:11:31.710928 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:31.715700 32530 raft_consensus.cc:359] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.722791 32530 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:31.723337 30350 raft_consensus.cc:1217] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Deduplicated request from leader. Original: 8.7->[8.8-8.8]   Dedup: 8.8->[]
W20260709 13:11:31.724951 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080031d3a0 after lost signal to thread 28568
I20260709 13:11:31.725628 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:31.726210 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3d40 after lost signal to thread 29606
W20260709 13:11:31.727475 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08000353e0 after lost signal to thread 29698
I20260709 13:11:31.727368 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:31.728615 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080010aee0 after lost signal to thread 29773
I20260709 13:11:31.729269 32554 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:11:31.729707 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3de0 after lost signal to thread 29847
W20260709 13:11:31.732509 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080014c2c0 after lost signal to thread 30374
I20260709 13:11:31.729831 32554 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:31.737480 32554 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:31.741143 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:31.743999 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-27ef48e8ba554972a5c426adeff23599 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:31.744503 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-27ef48e8ba554972a5c426adeff23599 on tablet 27ef48e8ba554972a5c426adeff23599 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:31.752602 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:31.724901 32530 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:31.760934 32530 ts_tablet_manager.cc:1434] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 13:11:31.771311 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fc891e1e674747fda6007601f64c4341 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:11:31.771816 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-fc891e1e674747fda6007601f64c4341 on tablet fc891e1e674747fda6007601f64c4341 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:31.774808 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-d7943a6965d54826a2eee391b1459b90 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:11:31.775233 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-d7943a6965d54826a2eee391b1459b90 on tablet d7943a6965d54826a2eee391b1459b90 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:31.775884 29714 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:31.776851 32549 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:31.800737 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:31.803686 32450 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.805609 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:31.806589 32450 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:31.783874 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:31.810592 32554 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:31.861122 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 45463.1us
I20260709 13:11:31.865036 29820 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:31.865785 29820 raft_consensus.cc:606] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:31.873411 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:31.877027 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:32.079684 30345 raft_consensus.cc:1217] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:11:32.082492 30350 raft_consensus.cc:1217] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:11:32.150746 32549 raft_consensus.cc:1064] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:32.153437 32549 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:32.175213 32450 raft_consensus.cc:993] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:32.175770 32450 raft_consensus.cc:1081] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:32.179769 29746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:32.180363 29746 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.180867 29746 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.185957 29746 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:32.189082 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:32.189685 29820 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:32.190035 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:32.190114 29820 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:32.190798 29674 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.191318 29820 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:32.192850 29820 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:32.198508 29674 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:32.203745 29819 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:32.206063 32552 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:32.219527 30350 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:32.224419 30350 raft_consensus.cc:1217] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 13:11:32.228814 29715 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:32.235176 32552 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:32.235390 29670 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:32.235955 32552 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:32.236938 32552 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:32.189663 29746 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:32.253512 32549 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:32.296017 29820 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:32.297880 32548 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:32.302711 32549 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:32.351181 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 50088.7us
I20260709 13:11:32.353225 30350 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.375638 29569 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 5 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.387482 29571 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.411523 29674 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.442342 29823 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.452569 32546 raft_consensus.cc:1064] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:32.464483 32546 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:32.503993 30350 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:32.504729 29819 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:32.506073 32440 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:32.506973 32485 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:32.522083 29746 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:32.545411 32440 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.549245 30350 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.617630 32571 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:32.618131 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53270.2us
W20260709 13:11:32.638422 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 100955us
I20260709 13:11:32.662529 29743 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.664558 29823 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:32.666487 32548 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:32.669198 29674 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:32.688766 32548 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:11:32.715198 32580 raft_consensus.cc:1064] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:32.756055 32580 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:32.756944 30350 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Advancing to term 6
I20260709 13:11:32.768910 30350 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:32.784451 32575 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:32.789144 29743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:32.789752 29743 raft_consensus.cc:606] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Received request to transfer leadership
I20260709 13:11:32.819765 29819 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.844127 29743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:32.845163 29743 raft_consensus.cc:606] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Received request to transfer leadership
W20260709 13:11:32.846626 29557 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 3147da791a394c9da4f7b521dd52a560 already in progress [suppressed 13 similar messages]
I20260709 13:11:32.864320 30345 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:32.868235 32576 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:32.877297 29570 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:32.878104 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.871001 29668 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:32.902076 32580 raft_consensus.cc:993] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:32.902583 32580 raft_consensus.cc:1081] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
W20260709 13:11:32.930146 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 50976.1us
I20260709 13:11:32.937072 29821 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:32.942128 29823 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51156
I20260709 13:11:32.959848 32553 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:32.960866 32549 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:32.970041 29823 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:32.970569 29823 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.981783 29823 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:33.008289 29823 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:33.007952 32581 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.010387 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:33.020520 29820 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.030230 30350 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.042600 29571 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.051015 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:32.997201 29557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 150703us
I20260709 13:11:33.057814 29742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:33.062587 29746 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:33.072089 32575 raft_consensus.cc:1064] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:11:33.072641 32575 raft_consensus.cc:1068] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Service unavailable: leader transfer in progress
I20260709 13:11:33.074203 29743 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:33.074651 29743 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:33.072512 32580 raft_consensus.cc:1064] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:33.075423 29743 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:33.076857 29743 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.076573 29672 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:33.078632 29674 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:11:33.080109 32549 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:33.082494 29746 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:33.085846 29743 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:33.085563 30350 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:11:33.087039 29742 raft_consensus.cc:606] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:11:33.088327 29742 raft_consensus.cc:614] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:33.095599 32553 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:33.100589 30350 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:33.104372 29823 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:33.106596 32576 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:33.112600 32578 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:33.120364 29820 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:11:33.128959 32580 raft_consensus.cc:1068] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Replica 42c443079435463daa8845e244cec9d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:33.136308 32546 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.142459 32553 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.150930 30345 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.157980 32549 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:33.165673 29620 auto_rebalancer.cc:893] Removing replace marker failed: Replica 42c443079435463daa8845e244cec9d3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:33.166180 29620 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:11:33.166465 29620 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:11:33.168334 30348 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.171372 29787 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:33.172560 32450 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:33.173065 32450 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:33.173584 29820 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.173907 32450 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:11:33.174662 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 49329.2us
I20260709 13:11:33.177670 32570 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:33.189179 30350 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:33.193542 29823 raft_consensus.cc:2955] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.196587 29572 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.193679 29670 raft_consensus.cc:2955] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 9 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.202250 32549 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:33.203040 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7943a6965d54826a2eee391b1459b90 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:33.224170 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27ef48e8ba554972a5c426adeff23599 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:33.241585 29571 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 6 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 7 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:33.242297 30350 raft_consensus.cc:2955] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:33.282472 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51241.5us
I20260709 13:11:33.295564 29570 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.298494 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fc891e1e674747fda6007601f64c4341 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:33.299018 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet d7943a6965d54826a2eee391b1459b90 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:33.352706 32595 tablet_replica.cc:333] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:11:33.363114 29569 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 9 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:33.381858 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 27ef48e8ba554972a5c426adeff23599 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:33.389504 32595 raft_consensus.cc:2243] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.392192 32595 pending_rounds.cc:70] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Trying to abort 1 pending ops.
I20260709 13:11:33.392602 32595 pending_rounds.cc:77] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Aborting op as it isn't in flight: id { term: 7 index: 6 } timestamp: 7305636629444853760 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "d7943a6965d54826a2eee391b1459b90" old_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } } new_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } } }
I20260709 13:11:33.399781 32595 raft_consensus.cc:2917] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Aborting config change with OpId 7.6: Aborted: Op aborted
I20260709 13:11:33.400286 32595 raft_consensus.cc:2889] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:11:33.402266 32595 raft_consensus.cc:2272] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.401729 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet fc891e1e674747fda6007601f64c4341 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:33.401387 32596 tablet_replica.cc:333] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:11:33.405541 32596 raft_consensus.cc:2243] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.406380 32596 raft_consensus.cc:2272] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.419224 32596 ts_tablet_manager.cc:1916] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:33.428601 32595 ts_tablet_manager.cc:1916] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:33.423507 32597 tablet_replica.cc:333] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:33.441732 32597 raft_consensus.cc:2243] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:33.442709 32597 raft_consensus.cc:2272] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:33.447113 32597 ts_tablet_manager.cc:1916] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:33.475927 32595 ts_tablet_manager.cc:1929] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:11:33.476576 32595 log.cc:1199] T d7943a6965d54826a2eee391b1459b90 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/d7943a6965d54826a2eee391b1459b90
I20260709 13:11:33.478596 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet d7943a6965d54826a2eee391b1459b90 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:33.497202 32597 ts_tablet_manager.cc:1929] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.9
I20260709 13:11:33.497800 32597 log.cc:1199] T fc891e1e674747fda6007601f64c4341 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/fc891e1e674747fda6007601f64c4341
I20260709 13:11:33.501835 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet fc891e1e674747fda6007601f64c4341 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:33.503859 32596 ts_tablet_manager.cc:1929] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:11:33.504498 32596 log.cc:1199] T 27ef48e8ba554972a5c426adeff23599 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/27ef48e8ba554972a5c426adeff23599
I20260709 13:11:33.507103 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 27ef48e8ba554972a5c426adeff23599 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:33.573140 29742 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:33.577235 32450 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:33.723486 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 104970us
W20260709 13:11:33.758028 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 133521us
I20260709 13:11:33.823084 29670 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.861678 29670 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:33.951319 30350 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Advancing to term 7
W20260709 13:11:33.952086 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 161069us
W20260709 13:11:33.986439 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 221327us
I20260709 13:11:33.990324 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:33.990675 30350 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:34.087628 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 75234.7us
W20260709 13:11:34.142786 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 45804.6us
I20260709 13:11:34.143348 32606 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:34.144829 32606 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:34.217962 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:34.218794 29819 raft_consensus.cc:606] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:34.220598 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:34.222927 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:34.217998 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 77297.7us
I20260709 13:11:34.277329 32604 raft_consensus.cc:1064] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:34.286172 32604 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:34.304646 29745 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:34.306221 32606 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:34.309705 30350 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:34.310063 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 168856us
I20260709 13:11:34.314411 32606 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:34.309705 29668 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:34.334720 32544 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.358254 32604 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:34.360492 30348 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.396950 29671 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.396950 29743 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.408571 29569 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.561064 32604 raft_consensus.cc:993] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:34.561578 32604 raft_consensus.cc:1081] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:34.584750 29743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:34.585372 29743 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.585696 29743 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.623360 29743 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:34.637735 29743 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:34.638634 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:34.640376 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:34.640559 29671 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.640982 29819 raft_consensus.cc:3055] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:34.641271 29819 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:34.642001 29819 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:34.643054 29819 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:34.661171 29671 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:34.662473 29715 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:34.663591 32612 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:34.664101 32612 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:34.664943 32612 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:34.699074 29569 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 5 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.719384 29819 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:34.780241 29671 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:34.816648 29816 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:11:34.818265 29640 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b85eaa84d2104a8aa1d25054d069fd33. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.818387 32618 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:34.827783 29743 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:34.833806 32618 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:34.854743 29819 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:34.860172 30348 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:34.866580 32606 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:34.872092 29671 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:34.875664 32607 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:11:34.884791 32544 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.896770 30348 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.919431 29745 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:34.920794 29819 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:34.929425 29674 raft_consensus.cc:2955] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:34.916988 32618 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:34.933902 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3147da791a394c9da4f7b521dd52a560 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:34.942925 29569 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 7 to 8, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.973841 29572 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:34.991498 29819 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:35.011808 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 3147da791a394c9da4f7b521dd52a560 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:35.043537 32627 tablet_replica.cc:333] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
W20260709 13:11:35.078126 29789 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a95760a1b04359956b38a1861eeca2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.079304 32627 raft_consensus.cc:2243] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:35.080684 32627 raft_consensus.cc:2272] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:35.081014 29745 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:35.083030 32544 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:35.080996 29674 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:35.100046 32544 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:35.104035 32627 ts_tablet_manager.cc:1916] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:35.130689 32604 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.146919 29745 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.177251 29674 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.183616 29819 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:35.200016 29569 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 6 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.219986 29743 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:35.221644 32544 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:35.222667 29789 consensus_peers.cc:597] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4dc2bf2df3534ed4bb09dedb2cec3002. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.224655 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:35.247004 29674 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:35.273881 29816 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:35.274822 32607 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:11:35.302377 32631 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:11:35.321514 32627 ts_tablet_manager.cc:1929] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:11:35.358054 32627 log.cc:1199] T 3147da791a394c9da4f7b521dd52a560 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/3147da791a394c9da4f7b521dd52a560
I20260709 13:11:35.360121 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 3147da791a394c9da4f7b521dd52a560 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:35.361229 32633 ts_tablet_manager.cc:933] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:35.360905 32636 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:35.385768 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 98859.6us
I20260709 13:11:35.327970 32612 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:11:35.450012 29672 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:35.451761 32612 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:11:35.490664 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 92115.5us
I20260709 13:11:35.509287 32633 tablet_copy_client.cc:323] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:35.514811 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet b85eaa84d2104a8aa1d25054d069fd33 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:35.518189 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet b85eaa84d2104a8aa1d25054d069fd33 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-b85eaa84d2104a8aa1d25054d069fd33
I20260709 13:11:35.544920 29684 tablet_copy_source_session.cc:215] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:35.545099 29668 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:35.571141 32633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b85eaa84d2104a8aa1d25054d069fd33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.582511 29744 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.576822 29571 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:35.589793 29672 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.636314 32654 ts_tablet_manager.cc:933] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:35.657019 29821 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:11:35.685715 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 72132us
I20260709 13:11:35.676426 32618 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:11:35.715137 32654 tablet_copy_client.cc:323] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:11:35.723934 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 11a95760a1b04359956b38a1861eeca2 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:11:35.724577 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 11a95760a1b04359956b38a1861eeca2 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-11a95760a1b04359956b38a1861eeca2
W20260709 13:11:35.728257 29640 consensus_peers.cc:597] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0d5a34ce22a44e2a4882baa5443f81e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:35.748601 29833 tablet_copy_source_session.cc:215] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:35.752199 32654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a95760a1b04359956b38a1861eeca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.758309 29745 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:35.782773 32618 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.789466 29821 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.792682 32658 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:11:35.793140 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 105967us
I20260709 13:11:35.822395 32633 tablet_copy_client.cc:806] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:35.826416 32633 tablet_copy_client.cc:670] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:35.827751 29745 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.824450 32654 tablet_copy_client.cc:806] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:35.832587 32633 tablet_copy_client.cc:538] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:35.833127 32654 tablet_copy_client.cc:670] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:35.836131 29569 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 5, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:35.842767 32633 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:35.853905 32654 tablet_copy_client.cc:538] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:35.863184 32663 ts_tablet_manager.cc:933] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:35.885114 32663 tablet_copy_client.cc:323] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:11:35.889602 32654 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:35.891069 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 4dc2bf2df3534ed4bb09dedb2cec3002 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:11:35.902985 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 4dc2bf2df3534ed4bb09dedb2cec3002 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-4dc2bf2df3534ed4bb09dedb2cec3002
I20260709 13:11:35.911722 29833 tablet_copy_source_session.cc:215] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:35.914887 32663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc2bf2df3534ed4bb09dedb2cec3002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:35.951881 32633 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=1 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:35.962438 32633 tablet_bootstrap.cc:492] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:35.963281 32633 ts_tablet_manager.cc:1403] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.121s	user 0.026s	sys 0.007s
I20260709 13:11:35.966384 32633 raft_consensus.cc:359] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:35.991590 32633 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:35.992468 32633 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:35.968020 32663 tablet_copy_client.cc:806] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:35.993753 32663 tablet_copy_client.cc:670] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:36.002031 32663 tablet_copy_client.cc:538] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:36.007403 32633 ts_tablet_manager.cc:1434] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:11:36.015525 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-b85eaa84d2104a8aa1d25054d069fd33 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:36.015997 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-b85eaa84d2104a8aa1d25054d069fd33 on tablet b85eaa84d2104a8aa1d25054d069fd33 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:36.060954 32663 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:36.080096 32654 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:36.081211 32654 tablet_bootstrap.cc:492] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:36.082989 32654 ts_tablet_manager.cc:1403] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.194s	user 0.029s	sys 0.005s
I20260709 13:11:36.099404 32654 raft_consensus.cc:359] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:36.100361 32654 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:36.101157 32654 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:36.103763 32654 ts_tablet_manager.cc:1434] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 13:11:36.119752 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-11a95760a1b04359956b38a1861eeca2 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:11:36.120230 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-11a95760a1b04359956b38a1861eeca2 on tablet 11a95760a1b04359956b38a1861eeca2 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:36.203294 32654 ts_tablet_manager.cc:933] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:36.260314 32654 tablet_copy_client.cc:323] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:36.261971 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet f0d5a34ce22a44e2a4882baa5443f81e from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:36.262508 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet f0d5a34ce22a44e2a4882baa5443f81e from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-f0d5a34ce22a44e2a4882baa5443f81e
I20260709 13:11:36.273304 32663 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:36.275691 29684 tablet_copy_source_session.cc:215] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:36.283547 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:36.290870 32663 tablet_bootstrap.cc:492] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:36.291738 32663 ts_tablet_manager.cc:1403] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.231s	user 0.033s	sys 0.007s
I20260709 13:11:36.302685 32654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d5a34ce22a44e2a4882baa5443f81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:36.314137 32663 raft_consensus.cc:359] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:36.315184 32663 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:36.315920 32663 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:36.378911 32663 ts_tablet_manager.cc:1434] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.004s
I20260709 13:11:36.397874 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-4dc2bf2df3534ed4bb09dedb2cec3002 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:11:36.398394 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-4dc2bf2df3534ed4bb09dedb2cec3002 on tablet 4dc2bf2df3534ed4bb09dedb2cec3002 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:36.437958 30345 raft_consensus.cc:1217] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Deduplicated request from leader. Original: 6.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:11:36.462832 32654 tablet_copy_client.cc:806] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:36.463506 32654 tablet_copy_client.cc:670] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:36.468106 32654 tablet_copy_client.cc:538] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:36.492715 32654 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:36.526435 29742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:11:36.527117 29742 raft_consensus.cc:606] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:36.531039 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:36.532709 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:36.609302 30345 raft_consensus.cc:1217] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:11:36.618407 32641 raft_consensus.cc:993] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:36.619700 32581 raft_consensus.cc:1081] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:36.626230 29816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51156
I20260709 13:11:36.626788 29816 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:36.627188 29816 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.642652 29816 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:36.644223 32654 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:36.645157 32654 tablet_bootstrap.cc:492] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:36.645753 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:36.646359 29672 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.662701 29672 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:36.664096 29789 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:36.664944 32637 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:36.648917 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:36.665534 32637 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:36.665763 29745 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:36.666100 29745 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:36.645910 32654 ts_tablet_manager.cc:1403] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.153s	user 0.025s	sys 0.005s
I20260709 13:11:36.647936 29816 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:36.666760 32637 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:36.666824 29745 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:36.686787 29745 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:36.691007 32654 raft_consensus.cc:359] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:36.691922 32654 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:36.692732 32654 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:36.695399 32654 ts_tablet_manager.cc:1434] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:11:36.702963 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f0d5a34ce22a44e2a4882baa5443f81e received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:36.703426 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f0d5a34ce22a44e2a4882baa5443f81e on tablet f0d5a34ce22a44e2a4882baa5443f81e with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:36.732195 29745 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:36.740753 30345 raft_consensus.cc:1217] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:11:36.810285 29571 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.875141 30345 raft_consensus.cc:1217] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
W20260709 13:11:37.268950 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44711.8us
W20260709 13:11:37.357885 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 47606.2us
W20260709 13:11:37.364589 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50295.7us
I20260709 13:11:37.383111 32675 raft_consensus.cc:1064] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:37.385746 32675 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:37.406169 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 98489.7us
W20260709 13:11:37.426244 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 118969us
W20260709 13:11:37.453969 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 184049us
I20260709 13:11:37.455451 32682 raft_consensus.cc:1064] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:11:37.458535 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 157126us
I20260709 13:11:37.495441 29741 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:37.489734 32682 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:37.507205 32695 raft_consensus.cc:1064] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:37.533731 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:37.557884 32677 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:11:37.560590 32607 raft_consensus.cc:1064] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:37.567854 29672 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:37.570508 32607 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:37.509753 32695 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:37.587544 29816 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:37.594578 32687 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:11:37.602074 30345 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:37.608181 32706 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:37.610587 32705 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:37.620854 29743 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:37.635215 32705 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:37.638485 30344 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:37.641292 29819 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:37.646682 29743 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:37.640058 32704 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.652791 32578 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.656131 32675 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.674505 30350 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:37.675684 29674 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:37.677418 32644 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:37.680550 29744 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:37.721704 32694 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:11:37.748708 32695 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:11:37.785709 29743 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:37.794371 32705 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:37.960433 29671 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:37.961637 30344 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:37.990804 32689 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:37.994937 29743 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:37.995692 29823 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.029389 32578 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.034634 30344 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.045186 29821 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.024529 32694 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:11:38.081894 29569 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 4 to 5, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:38.145304 32702 log.cc:927] Time spent T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:38.074200 32637 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
W20260709 13:11:38.164404 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 55227.4us
W20260709 13:11:38.168865 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62634.9us
I20260709 13:11:38.174924 29743 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.225301 29672 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.212435 32677 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.299434 30348 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:38.351927 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 107140us
W20260709 13:11:38.355681 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 112056us
I20260709 13:11:38.419884 30350 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:38.439677 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 75983.3us
W20260709 13:11:38.450174 32721 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.090s	user 0.005s	sys 0.000s
W20260709 13:11:38.470369 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 53091.6us
I20260709 13:11:38.481312 29571 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.495540 32687 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.496111 30350 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:38.554528 32690 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.068s	user 0.006s	sys 0.005s
I20260709 13:11:38.575654 29672 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.579615 29741 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.582304 29570 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 5 to 6, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.611817 29569 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.642385 29741 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.642518 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:38.680693 29821 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:38.688076 30350 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:38.689307 29667 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:38.689409 32687 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:38.693570 32687 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:38.701361 32729 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.708067 30350 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.712097 29667 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:38.706480 29671 raft_consensus.cc:2955] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.715888 29821 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:38.717649 29743 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:38.719285 30345 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:38.720904 32700 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:38.589852 29670 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:38.724702 32700 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:38.726982 30344 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:38.728842 32687 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:38.738054 32732 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.733398 32737 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.743570 29744 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.750634 30344 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:38.743577 29743 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:38.752620 32700 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:38.753441 32687 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:38.758105 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 11a95760a1b04359956b38a1861eeca2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:38.761703 30348 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.763468 29743 raft_consensus.cc:2955] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.766543 30345 raft_consensus.cc:2955] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.773437 32672 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.774981 29569 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 6 to 7, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 6 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.778568 30344 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.792225 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4dc2bf2df3534ed4bb09dedb2cec3002 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:38.818004 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f0d5a34ce22a44e2a4882baa5443f81e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:38.831885 29559 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b85eaa84d2104a8aa1d25054d069fd33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:38.842857 29741 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:38.853598 32708 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:38.859787 29570 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 6 to 7, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.883409 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet f0d5a34ce22a44e2a4882baa5443f81e with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:38.889441 29744 raft_consensus.cc:2955] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:38.905462 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 11a95760a1b04359956b38a1861eeca2 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:48012
I20260709 13:11:38.915572 32744 tablet_replica.cc:333] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:38.923435 32744 raft_consensus.cc:2243] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:38.928488 29572 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index 5 to 6, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.937434 32744 raft_consensus.cc:2272] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:38.938903 32745 tablet_replica.cc:333] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:11:38.955969 32745 raft_consensus.cc:2243] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:38.959605 32745 raft_consensus.cc:2272] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:38.983372 29821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:38.983958 29821 raft_consensus.cc:606] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Received request to transfer leadership to TS a9d8198d0b954886af452e89a8029614
I20260709 13:11:38.986093 32744 ts_tablet_manager.cc:1916] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:38.992319 32745 ts_tablet_manager.cc:1916] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:39.021656 32744 ts_tablet_manager.cc:1929] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:11:39.022205 32744 log.cc:1199] T f0d5a34ce22a44e2a4882baa5443f81e P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/f0d5a34ce22a44e2a4882baa5443f81e
I20260709 13:11:39.054625 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:39.053347 29569 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.070958 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet f0d5a34ce22a44e2a4882baa5443f81e (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:39.093019 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet b85eaa84d2104a8aa1d25054d069fd33 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:39.143890 32744 tablet_replica.cc:333] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:39.165668 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dc2bf2df3534ed4bb09dedb2cec3002 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:39.179813 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:39.196223 32728 raft_consensus.cc:993] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:39.196949 32728 raft_consensus.cc:1081] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Signalling peer a9d8198d0b954886af452e89a8029614 to start an election
I20260709 13:11:39.205999 29672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
 from {username='slave'} at 127.0.0.1:45236
I20260709 13:11:39.206777 29672 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:39.207237 29672 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.217206 32749 tablet_replica.cc:333] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:11:39.219480 29672 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:39.219916 32749 raft_consensus.cc:2243] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:39.221640 32749 raft_consensus.cc:2272] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:39.240106 32745 ts_tablet_manager.cc:1929] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:11:39.240890 32745 log.cc:1199] T 11a95760a1b04359956b38a1861eeca2 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/11a95760a1b04359956b38a1861eeca2
I20260709 13:11:39.243777 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 11a95760a1b04359956b38a1861eeca2 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:39.258818 29672 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:39.256801 32749 ts_tablet_manager.cc:1916] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:39.279917 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:39.280777 29741 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:39.296833 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:39.297498 29823 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:39.297806 29823 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:39.298938 29823 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:39.300515 29823 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:39.389393 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 144544us
W20260709 13:11:39.396852 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 92964.2us
I20260709 13:11:39.405797 29741 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
W20260709 13:11:39.410053 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 76760.3us
I20260709 13:11:39.410781 32744 raft_consensus.cc:2243] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:39.437050 29823 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:39.439749 29638 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:39.450522 32744 raft_consensus.cc:2272] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:39.454371 32744 ts_tablet_manager.cc:1916] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:39.475869 32749 ts_tablet_manager.cc:1929] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:11:39.476416 32749 log.cc:1199] T 4dc2bf2df3534ed4bb09dedb2cec3002 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/4dc2bf2df3534ed4bb09dedb2cec3002
I20260709 13:11:39.489421 32744 ts_tablet_manager.cc:1929] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:11:39.490110 32744 log.cc:1199] T b85eaa84d2104a8aa1d25054d069fd33 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/b85eaa84d2104a8aa1d25054d069fd33
I20260709 13:11:39.493360 32672 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:39.495981 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 44277.5us
I20260709 13:11:39.493978 32672 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:39.502007 32672 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:39.506007 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet 4dc2bf2df3534ed4bb09dedb2cec3002 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
W20260709 13:11:39.508437 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 68771.7us
W20260709 13:11:39.531315 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 54001.2us
I20260709 13:11:39.542595 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet b85eaa84d2104a8aa1d25054d069fd33 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:39.600975 29569 catalog_manager.cc:5697] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:40.047793 29821 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:40.052523 32737 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:40.080332 29744 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:40.082036 32700 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:40.192435 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:41.476711   301 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.477494   301 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.481292   301 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.490628 32692 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.530730 32692 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.531088 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.507839 32754 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.508776   302 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.517118 32764 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.533833   302 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.538390   302 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.539881 32764 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.541630 32764 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.542946 32754 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.545431 32754 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.570811 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.568750 32730 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.573179 32730 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.575661 32730 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.569674   301 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.576689   301 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.579386   301 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:41.582760 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.583879 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.585114 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.569797 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.590222 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:41.594713 30345 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:41.606753 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:41.608460 32730 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:41.609508 32730 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.614126 32730 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.611348 32692 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.630968 32730 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.633076 32730 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:41.610066 32754 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:11:41.623684 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 348180us
I20260709 13:11:41.634433 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:41.660529 30350 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.608964   301 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:41.638733 29671 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 2340) took 1096 ms. Trace:
I20260709 13:11:41.657799   312 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.662129 29671 rpcz_store.cc:276] 0709 13:11:40.542258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.637710 (+1095452us) service_pool.cc:224] Handling call
0709 13:11:41.638088 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:41.638276 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:41.638301 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:41.638341 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:41.638372 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:41.638422 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:41.638546 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:41.663329 32754 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:41.671633 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 85487.5us
W20260709 13:11:41.676435 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 93003.1us
W20260709 13:11:41.678241 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 84647.9us
I20260709 13:11:41.689750 30350 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:41.691370 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:41.719035 32754 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.713263 30344 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:41.721990   304 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:41.722532   304 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:41.723450   304 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.665808   312 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.730845 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.665207   301 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.751672   312 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.753086   301 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.757304   301 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.757983   301 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.760111   301 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:41.764547 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 85612.5us
I20260709 13:11:41.765883 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.766569 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.766901   301 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.769555 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.781527   301 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.784089   301 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.787592 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.789204 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.789592 32728 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.790174 32728 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.791354 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:41.792316 32728 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.792908 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.793112 32728 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.793934 32728 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.794240 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.795856 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.796201 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.800812 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:41.829457 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 116099us
W20260709 13:11:41.807418 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 116121us
I20260709 13:11:41.801332 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.843544 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.825690 32692 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.845167 32692 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.842970 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.849078   301 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.849738   318 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.849705   301 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.850371   318 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.851761 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:41.852120   301 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:41.852794   318 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:41.797773 32728 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:41.858067 32700 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.858222 32767 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.858501 29746 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:41.858714 32700 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.859376 32767 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.860042 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.861616 32700 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.861750 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.859421 32765 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.861800 32767 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.858840 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.862605   306 consensus_queue.cc:1059] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:41.863304 29673 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:11:41.860332 32692 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.864506   306 raft_consensus.cc:3055] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:41.864866   306 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:41.858929 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.865624   306 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.866219 29671 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:41.866664   306 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.867117 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.862722 32765 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.870061 32765 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.870357 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:41.867904 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.872927 29819 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:41.878132 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.798650 32766 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.882249 29820 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:41.882090 32766 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.880518 30314 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.880375 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.884215 32766 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.884423 29823 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:41.880987 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.890198 29571 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 5, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:41.883812 30315 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:41.896617   307 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:41.898566 32767 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.907097 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.907588 32767 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.909612 32767 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.899977 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.900373 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.902814 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.899859 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:41.895797 32692 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:41.925307 32692 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.925788 32692 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:41.903542 29638 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.930737   300 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:41.930882 29638 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.929620 32765 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:41.931576 32765 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.931979 32765 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:41.932300 32766 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:41.935166 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.940407 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.943195 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.943958 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.945576 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.945142 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:41.946694 32767 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:41.946929 29638 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.947860 32767 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:41.940425 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:41.951501 29638 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.943786 32692 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:41.952245 32767 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:41.954949 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:41.954943 32765 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:41.955958 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.957086 32767 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:41.957873 32692 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.958524 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:41.959820 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:41.961843 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.963053 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:41.963510 32765 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:41.964048 32767 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:41.961768 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:41.969971 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:41.970206 30314 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.970961 32692 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:41.971138   318 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:41.972343   318 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:41.972998 29715 consensus_peers.cc:597] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f35983a3f0f340da8a2b9daae61af306. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:41.973491 29789 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:41.974359   318 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:41.976289 29673 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:11:41.977741   306 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:41.980697 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:41.981521   318 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:41.985735 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.989311 29789 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:41.990347   301 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:41.990516 29789 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:41.991030   318 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:41.991253   301 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:41.991488   318 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.991648 29789 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:41.991746   301 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:41.992587 32728 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:41.992616   301 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:41.993243 29789 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:41.994028   304 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:41.996430 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:41.998950 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:42.004506 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:42.005806 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:42.006634 32728 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:42.007550 32728 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.010764 29789 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:42.012018   317 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:42.017789   301 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:42.020054   301 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:42.021572 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:42.022214   306 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:42.024080 29673 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:41.992106   318 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.049422 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:42.056208 29789 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:42.060451 32728 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:42.062145 29844 debug-util.cc:398] Leaking SignalData structure 0x7b080034f3c0 after lost signal to thread 28568
W20260709 13:11:42.063254 29844 debug-util.cc:398] Leaking SignalData structure 0x7b080034f540 after lost signal to thread 29606
W20260709 13:11:42.064498 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800307740 after lost signal to thread 29698
W20260709 13:11:42.065562 29844 debug-util.cc:398] Leaking SignalData structure 0x7b080008e6c0 after lost signal to thread 29773
W20260709 13:11:42.075043 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800358fe0 after lost signal to thread 29847
W20260709 13:11:42.076416 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800399680 after lost signal to thread 30374
I20260709 13:11:42.041738   318 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:42.096128 29819 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:42.100010 29569 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 reported cstate change: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:42.104714   306 consensus_queue.cc:1059] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:42.107470   310 raft_consensus.cc:3055] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:42.102963 29671 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:42.107908   310 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:42.108467 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:42.108973   310 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:42.107789 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:42.113626   318 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:42.114104   310 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:42.130867 29746 raft_consensus.cc:2410] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:42.133527 29787 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:42.134550   317 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:42.146595 29819 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:42.148270   300 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:42.158923 29640 consensus_peers.cc:597] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa5a096f6b164ab5849280a34b19d3b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.161721 29746 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:42.164820   300 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:42.167083 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:42.172941 29671 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:42.175019   310 consensus_queue.cc:1059] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:42.177347   319 raft_consensus.cc:3055] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:42.177757   319 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:42.178612   319 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:42.179744   319 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:42.195868 32765 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:42.199766 29819 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:42.208648 29745 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:42.224773 30350 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:42.226418   320 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:42.227483   320 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:42.233943   320 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:42.238683 29746 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:42.234884   320 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:42.244711 29570 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:42.245707   320 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.266206 30350 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:42.267620   301 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:42.330332 29745 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:42.334890   318 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:42.352954 29819 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:42.354516 29715 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5bb27f7a1364209b951570c1c03f996. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:42.354759   320 consensus_queue.cc:1059] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:42.355890   320 raft_consensus.cc:3055] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:42.356261   320 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:42.357115   320 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:42.359473   320 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:42.356439 29671 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:42.382192 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:42.383867 29819 raft_consensus.cc:606] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:42.400009 29671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:42.400641 29671 raft_consensus.cc:606] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:42.402047 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:42.403692 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:42.610507   318 raft_consensus.cc:993] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:42.611032   318 raft_consensus.cc:1081] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:42.615213 29746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:42.615801 29746 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:42.616143 29746 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.638345 29746 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:42.656472 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:42.657092 29669 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.664353 29669 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:11:42.665530 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:42.666190 29819 raft_consensus.cc:3055] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:42.666476 29819 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:42.667241 29819 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:42.668362 29819 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:42.671159 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:42.672502   320 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:42.673015   320 raft_consensus.cc:697] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:42.673879   320 consensus_queue.cc:237] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:42.716845 29746 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 2 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:42.725185 29819 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 2.
I20260709 13:11:42.770056   339 ts_tablet_manager.cc:933] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:42.775672   300 raft_consensus.cc:993] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:42.776232   300 raft_consensus.cc:1081] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:42.778880 29821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51152
I20260709 13:11:42.779451 29821 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:42.779762 29821 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.800215 29570 catalog_manager.cc:5697] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 1 to 2, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.820636 29821 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:42.825549 29821 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:42.826597 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:42.828327 29746 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.827644 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:42.830447 29669 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:42.830821 29669 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:42.831658 29669 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:42.832962 29669 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:42.844290 29746 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:42.845894 29787 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:42.847529 29669 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:42.850848   339 tablet_copy_client.cc:323] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:42.851737   301 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:42.852286   301 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:42.853056 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet aa5a096f6b164ab5849280a34b19d3b7 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:42.853739 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet aa5a096f6b164ab5849280a34b19d3b7 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-aa5a096f6b164ab5849280a34b19d3b7
I20260709 13:11:42.853181   301 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:42.864435 29684 tablet_copy_source_session.cc:215] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:42.892650   339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa5a096f6b164ab5849280a34b19d3b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:42.901398 29569 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:42.933360   339 tablet_copy_client.cc:806] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:42.934732   339 tablet_copy_client.cc:670] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:42.954041   339 tablet_copy_client.cc:538] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:42.975837   339 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:43.050292   339 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:43.051664   339 tablet_bootstrap.cc:492] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:43.056553   339 ts_tablet_manager.cc:1403] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.019s
I20260709 13:11:43.065701   339 raft_consensus.cc:359] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:43.076452   339 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:43.077344   339 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:43.080354   339 ts_tablet_manager.cc:1434] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.023s	user 0.000s	sys 0.006s
I20260709 13:11:43.082772 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-aa5a096f6b164ab5849280a34b19d3b7 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:43.083298 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-aa5a096f6b164ab5849280a34b19d3b7 on tablet aa5a096f6b164ab5849280a34b19d3b7 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:43.155164 29821 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:43.173309   306 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:43.248099 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 83287.3us
W20260709 13:11:43.259086 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 90296.8us
I20260709 13:11:43.291581 29669 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:43.298714   306 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:43.406431 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:43.409642 29741 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:43.415974   342 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:43.459643 29673 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:43.461901 30345 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:43.474707   342 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:43.476147   342 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:43.535347 32765 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:43.535957 32765 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:43.539669 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:43.545439 29746 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:43.541407 32765 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:43.542774 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:43.547945 29821 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:43.550541 29638 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:43.553525 32765 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:43.553988 32765 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:43.554364 32765 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:43.583341   357 raft_consensus.cc:1064] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:43.585945   357 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:43.595995 30345 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.597278   317 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.598879 32765 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:43.599375 29673 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.601904 29746 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.604336   317 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.605448   342 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.606094 32765 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:43.607095 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:43.611647 29821 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 4: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:43.613799 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:43.617570   342 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:43.618284   342 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:43.620476   342 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:43.622211 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:43.628373 29741 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:43.623270 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:43.629402 30345 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:43.626953 29745 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:43.625159   361 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:43.635650 29746 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:43.638130 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:43.638079 29638 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:43.647209 32765 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:43.647735 32765 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:43.648617 32765 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:43.653689 29671 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:43.657392   342 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:43.657806   342 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:43.658182   342 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.666795   342 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:43.683652 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:43.687219 29569 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 4, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.698173 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:43.699079 30345 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:43.697190   342 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:43.705222 29746 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:43.710171 30345 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:43.713754 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:43.715225   342 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:43.715993   342 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:43.716923   342 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:43.716101 29570 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 6 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.729838   348 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.730504   348 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:43.737440 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:43.738173 29669 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:43.739807 29715 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:43.740090   348 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:43.740267 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:43.740653   320 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:43.740957 29821 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:43.741168   320 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.741559   320 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.755657   320 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:43.763808 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:43.764556 29669 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.795370   320 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:43.803105 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:43.809551 29821 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:43.832360 29572 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.835952 29821 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:43.852524 32765 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:43.869242 32765 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:43.872862 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:43.873692 29745 raft_consensus.cc:2410] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:43.874640 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:43.875427 29821 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:43.876245 32765 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:43.865392 29714 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:43.876469 29639 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:43.877591   317 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.889673   317 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:43.892045   317 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:43.892699   306 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:43.892870 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:43.893610 29671 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:43.894805   300 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:43.895125 29789 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:43.899260   317 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:43.899675   317 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.899986   317 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.904775   300 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:43.910137 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:43.911032 29746 raft_consensus.cc:2410] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:43.912992   306 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:43.914026   306 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:43.803838 29669 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:43.954845 29569 catalog_manager.cc:5697] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.957028   320 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.957617   320 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:43.962854   342 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:43.963465   342 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:43.965755   342 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:43.967217 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:43.968891 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:43.969476 29669 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:43.970758 29715 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:43.971714   306 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:43.972074   306 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:43.972401   306 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:43.989357 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:43.990065   320 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:43.990295 29745 raft_consensus.cc:2410] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:43.996919 29787 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:43.998078   342 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:43.995875 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:43.993572   317 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:44.021317 29821 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:44.023264 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:44.025362 29669 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.036442 32762 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:44.037072 32762 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:44.040092 32762 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:44.041851 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:44.048961 29669 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:44.050314 29789 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:44.053391 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:44.007855   306 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:44.054419 29746 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:44.054458   357 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:44.055516   357 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:44.056413   357 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:44.056788 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:44.058621 29669 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:44.062991 30314 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:44.064124   353 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:44.064566   353 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:44.064903   353 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.065675 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:44.067296 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:44.068367   368 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:44.069401   306 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:44.070565 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:44.071372 29746 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:44.053552   317 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:44.081645   353 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:44.099098 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:44.091431 29572 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.103807   353 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:44.129144 29741 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:44.131215 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:44.131225   313 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:44.132032 29740 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:44.140668 29640 consensus_peers.cc:597] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f35983a3f0f340da8a2b9daae61af306. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:44.141362 29740 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:44.142313 30314 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:44.143615   353 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:44.144101   353 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:44.144956   353 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:44.191135 29745 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:44.192708   317 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:44.193809   342 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:44.194211   342 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:44.195024   342 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:44.196064   342 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:44.229574 29821 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:11:44.231364 32765 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:44.259707 30345 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:44.269230 29572 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 8 to 9, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 9 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.269893 29821 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:44.391563 29821 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:44.393796   306 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:11:44.424423 29671 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:44.437471   320 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:44.466878 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:44.502552 29671 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:44.510737   317 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:44.593163 29740 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:44.594736   353 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:44.605564 29745 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:11:44.605973 29745 pending_rounds.cc:85] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 4
I20260709 13:11:44.606192 29745 pending_rounds.cc:107] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.5
I20260709 13:11:44.606463 29745 raft_consensus.cc:2917] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Aborting config change with OpId 6.5: Aborted: Op aborted by new leader
I20260709 13:11:44.606801 29745 raft_consensus.cc:2889] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.607264 29745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:36344 (request call id 13) took 2370 ms. Trace:
I20260709 13:11:44.607549 29745 rpcz_store.cc:276] 0709 13:11:42.236557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:42.236701 (+   144us) service_pool.cc:224] Handling call
0709 13:11:42.250720 (+ 14019us) log.cc:844] Serialized 506 byte log entry
0709 13:11:44.607179 (+2356459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2854,"raft.queue_time_us":2923,"raft.run_cpu_time_us":1663,"raft.run_wall_time_us":1662,"thread_start_us":99059,"threads_started":1,"wal-append.queue_time_us":95957,"wal-append.run_cpu_time_us":1712,"wal-append.run_wall_time_us":1001746}
W20260709 13:11:44.609721 29620 auto_rebalancer.cc:629] Failed to schedule move for tablet b5bb27f7a1364209b951570c1c03f996: Aborted: Op aborted by new leader
I20260709 13:11:44.613504   342 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:44.620406 29817 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:44.657613 29741 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:44.660153 29671 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:44.661880   356 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:44.666867   385 ts_tablet_manager.cc:933] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
W20260709 13:11:44.658871 29789 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0801ed5c1b69497e8182bfe2461cdbf3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:44.670742 29817 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:11:44.682500 29817 pending_rounds.cc:85] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 7
I20260709 13:11:44.682832 29817 pending_rounds.cc:107] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:11:44.683065 29817 raft_consensus.cc:2889] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:44.687136   353 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:44.690157   356 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:44.743975 29821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:44.744700 29821 raft_consensus.cc:606] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:44.754472   385 tablet_copy_client.cc:323] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
I20260709 13:11:44.758832 29684 tablet_copy_service.cc:140] P a9d8198d0b954886af452e89a8029614: Received BeginTabletCopySession request for tablet f35983a3f0f340da8a2b9daae61af306 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:57422)
I20260709 13:11:44.759428 29684 tablet_copy_service.cc:161] P a9d8198d0b954886af452e89a8029614: Beginning new tablet copy session on tablet f35983a3f0f340da8a2b9daae61af306 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:57422: session id = 121060c6c5b14502957b76fd1dfc7b2d-f35983a3f0f340da8a2b9daae61af306
I20260709 13:11:44.771198 29669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:11:44.771942 29669 raft_consensus.cc:606] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
W20260709 13:11:44.781796 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 63224.9us
I20260709 13:11:44.809581   356 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:44.837494 29684 tablet_copy_source_session.cc:215] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:11:44.843397 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 56790.9us
W20260709 13:11:44.848368 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 61666.6us
I20260709 13:11:44.852252 29821 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:49542
I20260709 13:11:44.852900 29821 raft_consensus.cc:606] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:44.855487 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:44.857249 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:44.858415   397 raft_consensus.cc:993] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:44.867055 29740 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:44.869748 29569 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.871297 29671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:44.871896 29671 raft_consensus.cc:606] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:11:44.877560 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:44.878060 29819 raft_consensus.cc:606] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Received request to transfer leadership
I20260709 13:11:44.888666   385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f35983a3f0f340da8a2b9daae61af306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:44.889364 29671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:44.890015 29671 raft_consensus.cc:606] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:11:44.859681   397 raft_consensus.cc:1081] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
W20260709 13:11:44.927107 29559 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for f35983a3f0f340da8a2b9daae61af306 already in progress
I20260709 13:11:44.942369 29740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:11:44.943087 29740 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.943468 29740 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:44.959522   394 raft_consensus.cc:993] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:44.960120   313 raft_consensus.cc:1081] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:11:44.962116 29819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51152
I20260709 13:11:44.962693 29819 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.963053 29819 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:44.967767   385 tablet_copy_client.cc:806] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:44.972579   385 tablet_copy_client.cc:670] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:44.975447 29671 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:11:44.961498 29740 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:44.992304   385 tablet_copy_client.cc:538] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:44.997202 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:44.997812 29671 raft_consensus.cc:3055] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:44.999223 29671 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:44.999974 29671 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:45.001186 29671 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:11:45.002890 29559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 75820.9us
I20260709 13:11:45.001138 29819 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:45.007193 29673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:45.007793 29673 raft_consensus.cc:606] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Received request to transfer leadership
I20260709 13:11:45.009760 29671 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:45.010839 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:45.011041 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:45.011458 29821 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.011953   392 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:45.012501   392 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:45.013360   392 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:45.009830 29740 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:45.020406 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:45.021027 29819 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:45.022042 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:45.022660 29745 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.031114 29821 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:45.031102 29745 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:45.033790   385 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:45.021044 29671 raft_consensus.cc:3055] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:45.039353 29671 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:45.039901 29787 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:45.040158 29671 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:45.041718   356 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:45.042313   356 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:45.043272   356 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:45.041740 29671 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:45.074514 29671 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
W20260709 13:11:45.081130 29620 auto_rebalancer.cc:893] Removing replace marker failed: Replica a9d8198d0b954886af452e89a8029614 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:11:45.081565 29620 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f35983a3f0f340da8a2b9daae61af306 already in progress
W20260709 13:11:45.081856 29620 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f35983a3f0f340da8a2b9daae61af306 already in progress
I20260709 13:11:45.086301   396 raft_consensus.cc:993] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:45.089016   342 raft_consensus.cc:993] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:45.089512   342 raft_consensus.cc:1081] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:45.086933   396 raft_consensus.cc:1081] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:45.091445 29741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:45.092078 29741 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.092432 29741 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.097718 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:45.103737 29819 raft_consensus.cc:606] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Received request to transfer leadership
I20260709 13:11:45.097808 29745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:45.104954 29745 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.105307 29745 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.111562 29741 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.115290 29741 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:45.117470 29819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:45.118129 29819 raft_consensus.cc:606] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Received request to transfer leadership
I20260709 13:11:45.119756 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:45.120301 29671 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.121606   408 ts_tablet_manager.cc:933] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:45.118057 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:45.142408 29821 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:45.142774 29821 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:45.124716 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:45.143937 30345 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.143563 29821 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.145059 29821 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:45.145599   408 tablet_copy_client.cc:323] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
W20260709 13:11:45.146873 29620 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:11:45.147279 29620 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for aa5a096f6b164ab5849280a34b19d3b7 already in progress
I20260709 13:11:45.147405 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 0801ed5c1b69497e8182bfe2461cdbf3 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:11:45.147984 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 0801ed5c1b69497e8182bfe2461cdbf3 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-0801ed5c1b69497e8182bfe2461cdbf3
I20260709 13:11:45.149088 29571 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 2 to 3, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:45.151995 29620 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for aa5a096f6b164ab5849280a34b19d3b7 already in progress
I20260709 13:11:45.140154 29572 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 4 to 5, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.133052 29671 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:45.157714 29671 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:45.154619 30345 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:45.159524 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:45.160094 29833 tablet_copy_source_session.cc:215] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:45.160737   392 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:45.161252   392 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:45.163697   408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0801ed5c1b69497e8182bfe2461cdbf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:45.166105 29821 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:45.165201   392 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.172008 29745 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.179805 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:45.180486 30345 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.183873 29745 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:45.184278 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:45.187707 29821 raft_consensus.cc:3055] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:45.188050 29821 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:45.194994 29821 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.196414 29821 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.201965 30345 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:45.207386 29715 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:45.208698   368 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:45.209228   368 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:45.210071 29821 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:45.211160   368 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.227680   396 raft_consensus.cc:993] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:45.228214   396 raft_consensus.cc:1081] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:45.234746   385 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:45.235778   385 tablet_bootstrap.cc:492] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:45.236516   385 ts_tablet_manager.cc:1403] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.203s	user 0.038s	sys 0.018s
I20260709 13:11:45.237203 29745 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48026
I20260709 13:11:45.237818 29745 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.238209 29745 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.252456 29745 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.262468 29745 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:45.263411 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:45.264051 30345 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.264777 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:45.265359 29821 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:45.265645 29821 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:45.274250 29821 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.275440 29821 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:45.278057 29572 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.285472 29821 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:45.287164 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:45.288151   392 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:45.288723   392 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:45.289270   408 tablet_copy_client.cc:806] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:45.289873   408 tablet_copy_client.cc:670] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:45.289736   392 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.301250   408 tablet_copy_client.cc:538] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:45.308156 30345 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:45.319960   408 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:11:45.327832   385 raft_consensus.cc:359] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:45.348801   385 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:45.349542   385 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:45.364475   385 ts_tablet_manager.cc:1434] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.128s	user 0.010s	sys 0.000s
I20260709 13:11:45.347111 29572 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.376078 29572 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.376860 29684 tablet_copy_service.cc:342] P a9d8198d0b954886af452e89a8029614: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f35983a3f0f340da8a2b9daae61af306 received from {username='slave'} at 127.0.0.1:57422
I20260709 13:11:45.379712 29684 tablet_copy_service.cc:434] P a9d8198d0b954886af452e89a8029614: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f35983a3f0f340da8a2b9daae61af306 on tablet f35983a3f0f340da8a2b9daae61af306 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:45.417770 29821 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:45.418601   408 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:45.419660   408 tablet_bootstrap.cc:492] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:11:45.421139   408 ts_tablet_manager.cc:1403] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.101s	user 0.041s	sys 0.009s
I20260709 13:11:45.422680   389 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:45.441870   408 raft_consensus.cc:359] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:45.444708 30345 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEARNER]: Advancing to term 5
I20260709 13:11:45.444646   408 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:11:45.447593   408 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:11:45.450765   408 ts_tablet_manager.cc:1434] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 13:11:45.453619 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-0801ed5c1b69497e8182bfe2461cdbf3 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:11:45.454082 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-0801ed5c1b69497e8182bfe2461cdbf3 on tablet 0801ed5c1b69497e8182bfe2461cdbf3 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:45.484470 30345 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:45.490209   357 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:45.517356 29673 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:45.518795   306 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:45.525234   356 raft_consensus.cc:1064] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:11:45.525676   356 raft_consensus.cc:1068] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Unable to promote non-voter 121060c6c5b14502957b76fd1dfc7b2d: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:11:45.530230 29670 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:45.532760   396 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:45.581581 29740 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:45.591815 30345 raft_consensus.cc:1217] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:11:45.595566   396 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:45.614405   357 raft_consensus.cc:1064] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:45.616947   357 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:45.628022 30345 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:45.632154   317 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:45.654712 29671 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:45.657006   317 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:45.669251 30344 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:45.670768   392 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:45.681838 30345 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:45.683666   392 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:45.693189 29819 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:45.695400   392 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:45.720233 29673 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:45.737636   389 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:45.740053   419 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:11:45.765599 29741 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:45.768517   357 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:45.768469 30345 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:45.771111 29819 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:45.773607   389 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:45.775388   357 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:45.783429 29741 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:45.815903   389 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:45.829651 29572 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:45.858270 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:45.899701 29673 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:45.951833 29821 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:45.966305 30344 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:45.976269   368 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:11:46.040397   356 consensus_queue.cc:1175] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "121060c6c5b14502957b76fd1dfc7b2d" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:11:46.042611 29821 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:46.056843 30344 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:46.058422   396 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:46.060000 29746 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:46.062551   396 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:46.074537   357 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:46.088052 29746 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:46.099767 30344 raft_consensus.cc:2955] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:46.113202 29570 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:46.121109 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f35983a3f0f340da8a2b9daae61af306 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:46.131821 29659 tablet_service.cc:1558] Processing DeleteTablet for tablet f35983a3f0f340da8a2b9daae61af306 with delete_type TABLET_DATA_TOMBSTONED (TS a9d8198d0b954886af452e89a8029614 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:45220
I20260709 13:11:46.143432   396 raft_consensus.cc:1064] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:11:46.146001   396 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:46.153587   430 tablet_replica.cc:333] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:11:46.154981   430 raft_consensus.cc:2243] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:46.167883   430 raft_consensus.cc:2272] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:46.178541   430 ts_tablet_manager.cc:1916] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:46.251389   430 ts_tablet_manager.cc:1929] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 13:11:46.253800   430 log.cc:1199] T f35983a3f0f340da8a2b9daae61af306 P a9d8198d0b954886af452e89a8029614: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/wals/f35983a3f0f340da8a2b9daae61af306
I20260709 13:11:46.240547 30344 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:46.262166 29559 catalog_manager.cc:5028] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): tablet f35983a3f0f340da8a2b9daae61af306 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:11:46.274304 29746 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:46.277706   356 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:46.284783   317 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:46.324342 29673 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:46.335852   317 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:46.352582 29746 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:46.368152 30345 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:46.374413 29673 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:46.382182   368 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:46.383844   389 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:46.404601   368 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Committing config change with OpId 9.10: config changed from index 8 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:46.442632 30345 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 8 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:46.459431 29673 raft_consensus.cc:2955] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Committing config change with OpId 9.10: config changed from index 8 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:47.702020 28570 debug-util.cc:398] Leaking SignalData structure 0x7b080000fc60 after lost signal to thread 29789
W20260709 13:11:47.702621 28570 kernel_stack_watchdog.cc:198] Thread 29789 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 201ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:11:47.979241 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa5a096f6b164ab5849280a34b19d3b7 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:11:48.144296 29640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.723s	user 0.010s	sys 0.018s
W20260709 13:11:48.144375 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080003daa0 after lost signal to thread 28568
W20260709 13:11:48.144877 29640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.723s	user 0.011s	sys 0.018s
W20260709 13:11:48.145294 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 1.72374e+06us
I20260709 13:11:48.155194   441 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.155884   441 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.158071   441 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.159377   441 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.160090   441 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.160408   436 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:11:48.162009 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 1.66248e+06us
I20260709 13:11:48.160329   443 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.163174   441 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.161991   436 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.163895   441 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.164512   441 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.165336   436 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.166007   436 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.162894   443 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.166566   436 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.168619   436 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.171479   444 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.172171   444 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.174978   444 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.176419   445 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.176486   444 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.177073   445 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.177121   444 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.179440   445 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.179909   444 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.180534   444 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.180896   444 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.182564   444 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.189734   444 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.190626   443 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.190420   444 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.192692   444 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.198626   448 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.201031   446 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.199465   445 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.200544   444 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.201360   448 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.203222 29570 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 8 to 10, VOTER 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) evicted. New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:48.199764   447 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.203181   441 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.206504   445 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.214104   447 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.224584   445 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.284561   448 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.343117   447 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.382449   392 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.383147   392 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.214334   444 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.535234   444 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.204798   446 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.538163   446 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.532337   353 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.539117   353 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.541308   353 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.532240   447 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.542315   447 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.580464   392 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.583549   392 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.655781   444 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.654431   447 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.617601   392 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.655874   452 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:11:48.660058 29603 debug-util.cc:398] Leaking SignalData structure 0x7b0800086200 after lost signal to thread 29606
I20260709 13:11:48.662153   453 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.662416   456 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.663105   456 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:48.665200   437 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.665486   456 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:48.665825   437 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.667174   399 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.667812   399 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.659014   444 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.670146   444 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.670389   399 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.671900   392 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.673118 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.673838 29741 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:48.667946   437 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.675732 29746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2009) took 2092 ms. Trace:
I20260709 13:11:48.676168 29746 rpcz_store.cc:276] 0709 13:11:46.583099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:48.674956 (+2091857us) service_pool.cc:224] Handling call
0709 13:11:48.675240 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:48.675419 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:48.675444 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:48.675485 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:48.675527 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.675578 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.675674 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:48.678697 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.678340   452 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.679402 29746 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:48.668013   453 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.682417   453 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.684391   436 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.684629   437 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.685437   435 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.685190   437 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.686031   435 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.688582   452 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.685159   441 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.690366   441 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.691224   437 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.692401   441 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.684942   443 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.695127   443 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.697249   443 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.697798 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 2468) took 2240 ms. Trace:
I20260709 13:11:48.698439 29673 rpcz_store.cc:276] 0709 13:11:46.457625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:46.458867 (+  1242us) service_pool.cc:224] Handling call
0709 13:11:46.459147 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:46.459315 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:46.500495 (+ 41180us) log.cc:844] Serialized 14 byte log entry
0709 13:11:48.697350 (+2196855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:48.697419 (+    69us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:48.697470 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:48.697556 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:48.697696 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70974,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104}
I20260709 13:11:48.688870   397 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.700088   446 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.699883   397 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.700600   446 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.702263   436 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.703161   446 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.704083   446 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.704380   436 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.704538   446 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.705566   397 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.705031   435 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.707124   446 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:48.707979 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080032cfc0 after lost signal to thread 29698
I20260709 13:11:48.699223   455 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.710366   455 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.712617   455 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.712824 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.715039 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.715232   399 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.715757 29746 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:48.715790   399 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.718470   399 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.718957   399 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.719504   443 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.719416   399 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.720062   443 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.722059   435 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.722996   441 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.722733   435 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:48.724093 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080031d900 after lost signal to thread 29773
I20260709 13:11:48.723534   441 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:48.724783 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.725441 29746 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:48.726070   435 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.722657 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:48.722797   397 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.726660   435 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.726364   436 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.727249   435 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.727025   397 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.729681   436 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.731788   436 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.731968   435 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.732528   435 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.721891   399 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.732999   435 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.736240   435 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.738230   443 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.726147   441 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.729990   397 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.740705   389 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.741328   389 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.742165   368 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.741397   456 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.742913 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:48.743065   456 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.745199   456 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.743430   389 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:48.745678 29603 debug-util.cc:398] Leaking SignalData structure 0x7b0800035940 after lost signal to thread 29847
I20260709 13:11:48.745822   389 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.746441   389 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:48.746860 29603 debug-util.cc:398] Leaking SignalData structure 0x7b0800343320 after lost signal to thread 30374
I20260709 13:11:48.747208   453 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.747435 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:48.747905   453 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.748838   452 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.749428 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:48.749481   452 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:48.747208 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08003219e0 after lost signal to thread 30375
I20260709 13:11:48.751818   452 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.748416   389 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.753116 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.753945 29746 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:48.756395   437 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.756953   437 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.759063   437 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.759542   437 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.759994   437 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.762063   443 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.762666   443 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.767078 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.767406 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.768092 29740 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:48.768222 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.768314 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.768884 29745 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:48.768981 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.767750 29742 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:48.778569 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.791152 29673 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:48.794842 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.796620   392 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.797407   456 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.797245   392 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.801437 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.802291 29673 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
W20260709 13:11:48.802841 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 639975us
I20260709 13:11:48.804862 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.810441 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.776875   453 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.777827   397 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.815765 29673 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:11:48.795583   437 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.818756 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.816931 29747 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:48.750255   368 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.836131 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.836277   448 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.836983   455 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.837073   446 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.837568   455 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.837692   446 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.798079   456 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.816321   467 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.849980 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.850067 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:48.850744 29669 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:48.819690   453 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.856920   392 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.857398   466 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.857821   457 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.859516   455 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.858795   470 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:48.839246   441 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.880833 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.881274   441 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.883441   441 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.884132 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.884788 29671 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:48.885876 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.886686 29749 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:48.861956   389 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.862555   456 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.863034   443 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.837157   447 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.837519   448 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.863628   368 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.864136   396 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:48.866674 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.867321 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.897763 29745 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:48.868160 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.872139 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.889437   356 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.898861 29742 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:48.875128 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.870721   467 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.843942   435 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.844142   399 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.877128 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.880658   446 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.887954 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.889024 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.831810   397 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.902369 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.872402   453 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.899292 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.902043 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.892473 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:48.906769 29749 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:48.906872 29742 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:48.900593   396 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.903565 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:48.910276   465 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:48.896903   447 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.910899   465 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.912828   447 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.903657   435 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.904129   356 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.876443   466 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.903594   399 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.897096   389 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:48.905210   317 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.890100   457 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.913491 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.918501 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.923130   448 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.941869 30345 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:48.942195   397 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.942580   453 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.927076   435 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.944206   396 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.944689 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.945986 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.946316 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.946637 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.947203 29747 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:48.948367   389 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.946321 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.913116   465 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.927929   467 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.936455   474 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:48.944581   457 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:48.955668 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:48.956792 29638 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:48.956818 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.958254 29741 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:48.958993 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.950438   474 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:48.970690 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:48.971504 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.973356 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:48.976523 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.979945 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.948300   466 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.923344   356 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:48.988741 29638 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:48.980676 29670 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:48.990471 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:48.978363   397 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:48.998334 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:48.985795   435 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.005156   435 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:48.999737   397 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.188187 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.188511   397 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.189640 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.190688 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.192703 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.193332 30342 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:48.974570   317 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.189554   484 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.195613   317 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.196131   317 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.196591   317 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.196950 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.197064 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:49.098929 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 110279us
I20260709 13:11:49.198602 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.198871 29638 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.199434 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.114308 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.165066   469 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:49.200232   469 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.200512 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.200727 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.165278 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.165876 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.202603 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.202979 30348 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:49.195086   484 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.166392 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.167585   479 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.199795 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.168874 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.204613   479 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.169219 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.206110 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.169581   357 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.206743 29819 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:49.207332   356 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.207155   357 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.205286 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.208073   356 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.170238 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.207646 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.209218   357 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.170619 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.171271   466 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:49.209754   357 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.206777   479 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.210112   466 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.209849 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.210323   357 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.169865 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.171865   478 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.211302 29819 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:49.171691 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.172492   473 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.209411 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.212229   466 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.213990   473 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.214599 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.211694   478 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.216454 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.173499   461 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.216876   356 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.180013 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.212248 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.181401 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.217978 29819 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:49.182056 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.182080 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.217670 29672 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:49.218848   473 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.211678 29820 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:49.206147   437 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.217240   461 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.220813   437 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.221221   437 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:48.998781   396 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.221850   396 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.178532 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.222981 29821 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:49.222841   389 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.201840 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.222834 30345 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:49.174358   477 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.220238 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.225471   477 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.226202 29818 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:49.010111   468 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.202358   469 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.166236 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.203820 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.205253 29638 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.167584 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.227422 29815 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:49.227610   477 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.227770   441 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.216697 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.216914   478 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.224848   357 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.228233   441 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.229487   441 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.229847   399 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.222539   461 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:48.988081   467 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.224370   389 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.230453   399 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.230748   389 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.231621 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.232378 29815 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:11:49.234896 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.218814 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.235723   436 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.236106   436 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.236251 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.236792 30316 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.208405 29823 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:49.212787 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.215041 29814 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:49.236903 29815 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:49.237507   436 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.226881   468 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.240077 29816 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:48.999657   458 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:49.247218   458 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.247651   458 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:49.249780 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.250463 29742 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:49.250996 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.251370 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.251487   389 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.252954 29748 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:49.254030 29715 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:49.256603 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.257107 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.258000 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.261368 29640 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.246712   317 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.226423   396 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.262310   475 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.262769   475 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.263238   475 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.263505   484 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.254474   436 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:49.270417 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:49.256238 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.274240   448 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.187741   474 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.255260   467 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.277299 29749 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:49.278524   467 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.278321   397 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.280467   397 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.237252 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:49.282280 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 45088.9us
I20260709 13:11:49.217504 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.283252   481 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.283717   481 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.284099   481 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.270224   399 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.284644   399 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.286360   437 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.172060   463 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.274739   448 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.287395   448 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.287025   475 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.283964 30316 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.253674   389 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.139357   480 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:49.288502 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.288475 29668 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:49.283301 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.300765 30314 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.302759 30314 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.261178   458 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.305143 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:49.299626 30316 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.307658 29742 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:49.300350 30344 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:49.273025   435 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.309018 29715 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:49.311636 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.314762 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.315080 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:49.315711 29748 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.316979 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.319065 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.309015   397 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:49.345088 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.347437 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.307260   447 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:49.350036 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.307060   463 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.342552 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.306833   468 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.347175   437 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.355440 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.356123 29823 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:49.357756 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.308594   457 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:49.342708   397 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.299506   441 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.389151   460 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.349010   474 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.352890   447 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.354487   463 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.388052   397 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.308413   480 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.387806   483 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.367717   468 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.389714   460 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.385268   445 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:49.384910   455 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:49.406414   457 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:49.409629   447 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:49.434024   457 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.447402   480 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.410876   474 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.410392   436 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.413533 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.317339   389 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:49.453270 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 153702us
I20260709 13:11:49.416761   460 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.414707   483 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.460810   441 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.461737   483 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.416463   445 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.462620   445 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:49.416095   468 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.434396   455 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.467365   455 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.466984   481 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.467679   468 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.469738   481 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.454807 30316 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.470703   474 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.471028   397 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.471396   490 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:49.471938   490 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.472345   490 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.454351   389 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.454643   475 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.478021   458 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.478238   397 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.475231   460 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.188716 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 196) took 2088 ms. Trace:
I20260709 13:11:49.551179 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.553089 29815 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:49.553838 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.480571   460 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.554709 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.559139 29748 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:49.564443 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.566759 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.570166   445 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.582580   455 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.585026 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.480981   490 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.485706   457 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.480226   399 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.591585 29665 raft_consensus.cc:2393] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:49.488444   447 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.499905   448 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.595463   457 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.599570 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.475382   389 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.568554 29570 rpcz_store.cc:276] 0709 13:11:47.100591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:47.164424 (+ 63833us) service_pool.cc:224] Handling call
0709 13:11:49.188658 (+2024234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:48.218592 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:48.219205 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:48.219242 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:11:48.219263 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:48.219628 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:48.219704 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:48.219742 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:48.220871 (+  1129us) tablet.cc:701] Row locks acquired
0709 13:11:48.221512 (+   641us) write_op.cc:260] PREPARE: finished
0709 13:11:48.521339 (+299827us) write_op.cc:270] Start()
0709 13:11:48.544929 (+ 23590us) write_op.cc:276] Timestamp: P: 1783602708423650 usec, L: 0
0709 13:11:48.544962 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:11:48.545690 (+   728us) log.cc:844] Serialized 536 byte log entry
0709 13:11:48.876182 (+330492us) op_driver.cc:464] REPLICATION: finished
0709 13:11:49.022383 (+146201us) write_op.cc:301] APPLY: starting
0709 13:11:49.114928 (+ 92545us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:49.127309 (+ 12381us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:49.184986 (+ 57677us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:49.185201 (+   215us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:49.185385 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:49.185434 (+    49us) write_op.cc:312] APPLY: finished
0709 13:11:49.185619 (+   185us) log.cc:844] Serialized 23 byte log entry
0709 13:11:49.186361 (+   742us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.186440 (+    79us) write_op.cc:454] Released schema lock
0709 13:11:49.186477 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:49.186823 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:49.186849 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":145914,"apply.run_cpu_time_us":18284,"apply.run_wall_time_us":164451,"num_ops":1,"prepare.queue_time_us":9494,"prepare.run_cpu_time_us":9163,"prepare.run_wall_time_us":420568,"raft.queue_time_us":188219,"raft.run_cpu_time_us":8808,"raft.run_wall_time_us":111648,"replication_time_us":331069,"thread_start_us":332511,"threads_started":4,"wal-append.queue_time_us":140307}]]}
I20260709 13:11:49.604784   445 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.607738 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.609306 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.495904   435 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.613866 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.614977   490 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.616187   435 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.623155 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.626389   448 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:49.629235 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 326404us
I20260709 13:11:49.631151 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.633080   399 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.495244   463 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.636114 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.635499 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:49.637799 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 182974us
I20260709 13:11:49.635449 29742 raft_consensus.cc:1240] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:49.639683 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.642347 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.644770 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.597059   455 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.646989 29748 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:49.648427 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.649539 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.651965 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.653800 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.658486 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.661963 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.663097 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.670293 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.678898 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:11:49.679884 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 294988us
I20260709 13:11:49.685163 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.686657 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.687857 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:49.688277 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.688689 30344 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.689509 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.706838 30314 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.710199 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.713445 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.715312 30347 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:49.718520 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.713191   455 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:49.720793   455 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:49.723526   455 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.712536   493 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:49.725692 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.726426 30314 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.727509   445 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:49.727694 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.728039   445 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:49.724663 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.724745 30315 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.730243   445 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.736891 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.738616 30344 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:49.741534 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.741470   448 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:49.741793 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.743096 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.744375 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.745114 29665 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.746577 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.736790   447 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.754035 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.754169 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.754417 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.754912 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.755177 29672 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:49.757205 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.758229 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.759797 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.760681 29670 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:49.765305 29671 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:49.766170 30315 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:49.766508 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.767338 29668 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:49.768587   490 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.769048   490 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.769439   490 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.769490   489 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:49.770967   457 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:49.771341   457 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:49.774358   457 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.775772   457 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.779207 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.779690 30315 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.780121 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.781345 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.781664 29672 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:49.783656 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.782948 29744 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:49.784945 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:49.786657 29670 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:49.791021 29748 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:45612
I20260709 13:11:49.791352 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.791858 29748 raft_consensus.cc:606] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:49.795621   389 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.796411 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.796980 29746 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:49.797179 29669 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:49.798166 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 88617.5us
I20260709 13:11:49.798174 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.798725 29672 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:49.799125 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.799858   389 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:49.800230 29670 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:49.749378   463 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.780432 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:49.802850 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.803066 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.803897 29670 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:49.804782 30350 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:49.804989   490 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.806317   489 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:49.807119 29674 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:49.809288 29671 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:49.810093 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 83773.5us
I20260709 13:11:49.810253 30315 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:49.805790 30345 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:49.810920 30314 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.811614   448 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:49.811892   446 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:49.812117   448 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:49.812417   446 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:49.812741   448 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:49.812893   446 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:49.818467 30315 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.819363 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:49.800999 29715 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.826234   453 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:49.800915 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 429403us
I20260709 13:11:49.822292   489 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:49.826692   453 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.827154   453 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:49.831379 29570 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:49.832197   448 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.832955 29665 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:49.835642 29672 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:49.835827   453 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.834918 29640 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:49.838882 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:49.838578   453 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.834698 30344 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:49.843478 29668 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:11:49.824229 30315 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.839107 29715 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.843165   490 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.854305 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.857131 29640 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.853703   389 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:49.868149   447 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:49.868402 29638 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.854174   399 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:49.869531   399 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:49.870126   399 raft_consensus.cc:697] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:49.871186   399 consensus_queue.cc:237] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.864403   453 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.878432   453 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:49.878887   453 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.882117   481 raft_consensus.cc:2764] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:49.907768 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.908082 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:49.910079 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 44206.3us
I20260709 13:11:49.911759 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.912178 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.913340 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.913872 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.915949 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.914933 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.918460 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.918987   446 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.920380 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.921252 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.921583 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:49.922515 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 98404us
I20260709 13:11:49.922852 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.926586 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.927182 29674 raft_consensus.cc:1813] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Handling vote request from an unknown peer 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:49.927699 29674 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:49.928630 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.929648   448 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:49.929836 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:49.930524 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62682.4us
I20260709 13:11:49.915395 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.934353 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.934821   445 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.935920 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.936582 30344 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:49.938381 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.938912 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.939755 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:49.940685 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 80732us
I20260709 13:11:49.943203 29639 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:49.943008   473 consensus_queue.cc:1059] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:49.945209 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 120300us
I20260709 13:11:49.945973 30316 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.950814   490 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:49.951406   490 raft_consensus.cc:697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:49.954514   490 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.955603   468 raft_consensus.cc:3055] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:49.956061   468 raft_consensus.cc:740] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:49.954367 30316 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:49.957060   468 consensus_queue.cc:260] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:49.957731   447 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:49.957674 30316 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:49.950309 30315 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:49.960441   463 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:49.960891   463 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:49.960811 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.961582 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.962697 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:49.921206   446 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.963496   447 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:49.965541   448 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:49.971027 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.971805   447 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:49.972081   448 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:49.977535 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:49.971369 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:49.979373 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.980517 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:49.962663   463 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:49.979295 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:49.963069   445 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:49.978250   457 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:49.985463   468 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:49.964816   483 consensus_queue.cc:1059] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:11:49.993781 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:49.994169 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 51088.3us
I20260709 13:11:49.998368 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.007565 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.006791 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.006640 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.011407   475 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:50.013365   467 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:50.014215 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.007148 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.016204 30314 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.013724   467 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.028143   467 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.043722 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.052271   399 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:50.052981   399 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.053414   399 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:50.058969 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 57137.4us
I20260709 13:11:50.059983 29715 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:50.060880   500 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:50.056978   445 raft_consensus.cc:2764] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:11:50.066362 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 63622.1us
I20260709 13:11:50.070427   455 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.071035 30348 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.072105 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.073251   472 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.053704 29639 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.054314   448 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.078795 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:50.077682   481 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:50.080862   481 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.081281   481 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.081415 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.083637   443 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.084157   443 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.084581   443 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.087088   483 consensus_queue.cc:1059] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:50.089061 29639 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:50.093397   473 raft_consensus.cc:3055] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:50.079834 29714 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.061501   500 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.099802 30314 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.103720 29714 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.104607   389 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.105316   467 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.105391   389 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.118470   435 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:50.119072   435 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:50.100153   473 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.106544   493 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:11:50.119470   435 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.130683 29811 tablet_service.cc:1558] Processing DeleteTablet for tablet aa5a096f6b164ab5849280a34b19d3b7 with delete_type TABLET_DATA_TOMBSTONED (TS 389c080a49494f8fb56c53fa7e6087f3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:51138
I20260709 13:11:50.132225 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.133248   441 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:50.133652   441 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.134238   441 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.134766   473 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.136124   473 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.139032   455 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:50.140223 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:50.133632 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.102134   500 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:50.144403 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 50529.6us
I20260709 13:11:50.139151   493 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:50.148998 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.151067   463 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.152318 29665 raft_consensus.cc:1240] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:50.143915   495 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.165391   492 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:50.165907   492 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.166278   475 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:50.166832   453 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.167007   475 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.169178   453 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:50.173746 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 77257.1us
I20260709 13:11:50.174564   399 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.175034   447 consensus_queue.cc:1059] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:50.176199   447 raft_consensus.cc:3055] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:50.176571   447 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:50.169595   475 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:50.183177 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 49587.3us
I20260709 13:11:50.177529   447 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.194660   399 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.186017 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:50.198428 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.174427   457 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:11:50.199232 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.200802 29639 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.204416   447 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:50.158949   463 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:50.193275 30314 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.206162 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.154556   493 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.207451   399 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.208606 29639 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.211268 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.211874   457 raft_consensus.cc:3055] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:50.212316   457 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:50.212949 30314 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.214084   445 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.214313   460 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.214725   460 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.215049   475 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:50.215703   475 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.205909   463 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:50.216604   463 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.166347   492 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.217049   463 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.208261   493 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.216998 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.214901   445 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.178122   389 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:50.211324   490 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.213394   457 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.224010   460 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.224695   457 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.224901   435 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.223101   389 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.228713   475 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:50.222983   493 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.228901 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:50.229424   389 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:50.231805 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.204058   443 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.232533 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:50.216101 30314 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.232137   435 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:50.247331   441 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:50.250620   501 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:50.252296   441 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.246363   448 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:50.246189   399 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:50.255396   399 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.255810   399 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:50.256238 29748 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.254985   448 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:50.258128   448 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.258733   502 consensus_queue.cc:1059] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:50.260084   502 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:50.260483   502 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.261552   468 raft_consensus.cc:3055] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:50.261408   502 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.262071   468 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.262703   502 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.263345   468 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.269729   507 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:50.270386   507 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.270762   507 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.280900   443 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.288308 29639 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.285271   468 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:50.295634 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 46862.3us
I20260709 13:11:50.305171 29640 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.306924 29640 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.307276   481 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.309979 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.310232 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.310626 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.311455 29640 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.312987   506 tablet_replica.cc:333] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:11:50.320540 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.320847 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.321345 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.322855 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.323009 29749 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:11:50.295225   443 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:50.324348   443 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:50.324729   443 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:50.330142 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 97044.3us
I20260709 13:11:50.323824   435 raft_consensus.cc:2764] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:50.331851   435 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.332437   441 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.339093 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.340525 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.343600   506 raft_consensus.cc:2243] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.344437   506 raft_consensus.cc:2272] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.345649   399 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.345842 29571 catalog_manager.cc:5697] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:50.347926   399 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.348632 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.354651 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.347828   506 ts_tablet_manager.cc:1916] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:50.359980   443 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.362798   481 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.363631   463 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.363844   460 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.364792 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.374621   492 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:50.379463 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 93441.9us
I20260709 13:11:50.380486 29665 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:50.381039 29742 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
W20260709 13:11:50.386106 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.400492 29789 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.401190 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:50.403208   474 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:50.404069   474 consensus_queue.cc:1059] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:50.405213   503 raft_consensus.cc:3055] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:50.405594   503 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.406315   447 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:50.406531 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.406471   503 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.407459   447 raft_consensus.cc:3055] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:50.407581   483 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:50.407891   447 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:50.407598   463 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.408249   503 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.408947   492 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.408809   447 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.409863   509 consensus_queue.cc:1059] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:50.410821 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:50.401171   460 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.411182   483 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:50.411646   483 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.411938   447 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.412578   483 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.386997 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:50.388605 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:11:50.386642 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 100622us
I20260709 13:11:50.389670 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:50.395018 30347 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:50.414404   473 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:50.414974 29639 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.396914 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.354113   448 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.421695 30343 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:50.412936 30314 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:50.410007 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 53287.3us
I20260709 13:11:50.425004 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.426360 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.426614 30314 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.427639   445 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:50.428382   445 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.428725   448 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.430999 29665 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:50.431142   474 consensus_queue.cc:1059] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:50.419330   483 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.436978 29639 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.438580 30344 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:50.436293 30314 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.440809 30314 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.442463 30314 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.442533 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.442628   448 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.445022 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.448947 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.450656 30314 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.452111   448 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.446506   490 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.453167 29714 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.454157 30314 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.454588 29639 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.455480   475 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:50.456086 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.441490   460 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:50.458014   512 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.458312 29639 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.458851   513 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:50.459564   513 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.461309   490 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:50.446694   467 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.462136   490 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:50.462347 29714 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.458092   475 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.459494 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.463225   490 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.463253   500 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.442749   495 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:50.465561   512 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.476184 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.477042 29741 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 6: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:50.463321   448 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:50.479496 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.468086 29571 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 5 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 6 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:50.480203   502 consensus_queue.cc:1059] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:50.481797   467 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:50.482714 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 171358us
I20260709 13:11:50.486424 29816 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:50.454818   493 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.500376 30315 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.501987   448 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:50.502504   448 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:50.502609   473 raft_consensus.cc:3055] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:50.503010   473 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.503439   448 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.504040   509 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:50.503901   473 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.504578   509 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:11:50.510888 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.524307 29741 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:50.525004 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.505616   509 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.526636 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.528620   475 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.520654 29640 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:50.530978 29671 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:50.532884 29715 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.537334   453 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.539760   504 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:50.519342   503 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:50.544523   503 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.547147   503 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:50.547848 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:50.561314   492 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.560163 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.563670 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.564267 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.571030 29571 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 5, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 5 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:11:50.572041 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.575337 30344 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:50.576809   443 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.580164   475 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:50.580715 29674 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:50.582451   509 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.473410   507 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.590524 29815 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:50.591357 30350 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:50.588341 29820 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:50.592170 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.602975 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.603474   495 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:50.607357 30345 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
W20260709 13:11:50.608034 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 192939us
W20260709 13:11:50.607942 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 87367.8us
I20260709 13:11:50.613881 29668 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:50.613957 29674 raft_consensus.cc:1240] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:50.616370 29640 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:50.618934 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.620121 29640 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.630579 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.632882 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.560288   512 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:11:50.635895 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.636478   517 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:50.636897   517 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.637228 29674 raft_consensus.cc:1240] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:50.640987   510 raft_consensus.cc:3055] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:50.641469   510 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.642328   510 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.643565   510 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.637708   517 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.646260   443 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:50.646579   517 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.647856   507 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:50.618743   513 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:11:50.648906 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:50.648456 29571 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 9 to 10, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 10 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:50.649430   513 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:50.649798   513 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:50.650749   513 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.652258   513 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:50.639459 29640 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:50.654227   512 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:50.654712   512 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:50.655560   512 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.658356   443 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:50.659457   443 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.622933   463 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:50.662000   463 raft_consensus.cc:697] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:50.660087 29640 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.666917   492 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:50.667618   492 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:50.668624   492 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:50.669457   518 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:50.629575   453 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.691432 29665 raft_consensus.cc:1240] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:50.702279   521 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:11:50.702378 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 69575.9us
I20260709 13:11:50.704809 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.704402 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.712971 29748 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:50.714715   448 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:50.729540 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.741255 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:50.743218 29668 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:50.737561 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:50.745306 29667 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:50.745040   516 consensus_queue.cc:1059] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:50.745992 29815 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:50.750033 29674 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:50.750231 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 43618us
I20260709 13:11:50.750533 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:50.751142 29670 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:50.752332 29669 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.753480 29673 raft_consensus.cc:1240] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:50.755954 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.757407 29789 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.760004 29671 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:50.758860   503 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.731426   473 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.766139 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:50.767908 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.770767 29673 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.773533   515 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:50.777572 29789 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.778429   515 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:50.779153 29789 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:50.779865 29789 raft_consensus.cc:2686] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:11:50.780870 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.758302   510 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:50.745568   463 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.787243 29639 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.788681 29673 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:50.789786   475 consensus_queue.cc:1059] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:50.790643 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:50.790545   472 consensus_queue.cc:1059] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:50.790894   475 consensus_queue.cc:1059] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:50.791217   519 consensus_queue.cc:1059] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:50.791950   467 raft_consensus.cc:3055] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:50.792388   467 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.793119 30345 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.792618 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.793290   467 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.792580 29667 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:50.794764   467 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.791993   475 raft_consensus.cc:3055] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:50.795609   475 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.796414   475 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.796901   519 raft_consensus.cc:3055] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:50.797299   519 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.793293 30344 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:50.797633   475 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:50.801841 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:50.803834 29671 raft_consensus.cc:1240] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:50.800904   493 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.805351 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.791721   472 consensus_queue.cc:1059] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:11:50.808532 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:11:50.810040 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.781569   515 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.792164   500 raft_consensus.cc:3055] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:50.828754 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:50.838433   493 consensus_queue.cc:1059] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:50.839692   493 raft_consensus.cc:3055] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:50.840065   493 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.840962   493 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.843372 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.846262 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.852993 29822 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:50.853440 29822 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:50.854219 29822 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.857781 29741 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:50.830214   500 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:50.861946   455 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:50.855391 29822 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:50.862874   500 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.864125   500 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:50.853042   467 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:11:50.804699   519 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.811277   513 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:50.879210 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:50.804644   510 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:50.860476   389 consensus_queue.cc:1059] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:50.876561   493 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:50.878037   515 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.878013   492 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:50.912782 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 70228.9us
I20260709 13:11:50.899693   509 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:50.910590   519 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:50.917418   389 raft_consensus.cc:3055] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:50.917855   389 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:11:50.954216 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 110917us
I20260709 13:11:50.955140 29639 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:11:50.962807 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.963439 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.963346   510 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:50.919900   492 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:11:50.970469 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 56160.6us
W20260709 13:11:50.975617 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 150376us
I20260709 13:11:50.971302 29789 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
W20260709 13:11:50.986275 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.918778   389 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:50.950736   506 ts_tablet_manager.cc:1929] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.9
I20260709 13:11:51.026544   506 log.cc:1199] T aa5a096f6b164ab5849280a34b19d3b7 P 389c080a49494f8fb56c53fa7e6087f3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/wals/aa5a096f6b164ab5849280a34b19d3b7
I20260709 13:11:51.029143   492 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.005678   503 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.037210 29822 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:51.037938   483 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:11:51.047243   453 raft_consensus.cc:3055] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:51.047657   453 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:51.048429   453 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.049412   453 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:51.052368 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 97351.2us
I20260709 13:11:51.061254 29816 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:51.064586   441 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:51.065213   441 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:11:51.066181 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.067183 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.068084   512 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:51.069964 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 98705.8us
I20260709 13:11:51.070794 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.069308 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:11:51.071906 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 158350us
I20260709 13:11:51.072695 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.073210 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.074569 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:11:51.071740 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 102202us
I20260709 13:11:51.072719   435 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:51.077663 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.076179 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.076689 29639 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.080636   399 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:51.080857 29639 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.081813 30344 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:11:51.086320 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:51.085096 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.087612 30345 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:51.090341   492 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.073678   389 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.090780   535 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.130858   457 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:51.131914   447 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:51.106312 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:51.097321 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
W20260709 13:11:51.135308 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 45435.9us
I20260709 13:11:51.136045 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.137790 29816 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:51.139508   493 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:51.143038 29816 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.143594   483 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:51.144397   483 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.145519   521 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:51.146106   521 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.148469   521 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:51.148968   521 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:51.150194   483 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:51.150707   483 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.153050   483 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:51.149406   521 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.144917 29572 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 8 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.158293 29816 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:51.159075   447 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:11:51.163344 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.159950 29572 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 7 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.168329   521 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:51.168816 29572 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 6, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:51.172101 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.090670 29639 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.075752   500 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.088857   513 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.086122   532 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:11:51.081530   443 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:51.082113   481 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:51.102617 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.182338 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:51.183120 29742 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:51.184278 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:51.096570   441 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.087594   503 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.119154 30345 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:51.122228   472 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:11:51.174276 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 83675.7us
I20260709 13:11:51.195745 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.193222 29745 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:51.193295 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:51.174494   512 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:51.198176 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:51.202699 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.204747 29741 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:51.208359 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.188134   483 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.208395 29747 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.194334   472 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:51.225346 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.228029 29740 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:51.204315   507 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:51.212366   473 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:51.229686 29820 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:51.180677   495 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:11:51.208551   460 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.224236   509 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.240248 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.244328   537 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:11:51.237483   473 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:51.228184   447 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:11:51.238396   483 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.229899   475 consensus_queue.cc:1059] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:11:51.261420 29787 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:51.262885 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.269984 29820 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:51.265692   473 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.247815   472 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.281320 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.277880   503 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:51.263094   435 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:11:51.294363 29747 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:51.288141 29789 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.288658   502 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.280452   509 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.284142   515 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:51.309199 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 97950.4us
I20260709 13:11:51.315032 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:51.316514 29669 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.296281   503 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:51.296154   475 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:51.325894 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.323855 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.312599   521 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:51.310663   515 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:51.332408 29667 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:51.312011   472 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:51.335443 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.325090   503 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.332824   467 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.362771 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.338266   515 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.339847   483 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:51.339838   509 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:51.386365 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 43713us
I20260709 13:11:51.386456   460 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:51.387519 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.372567   521 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:51.332644   475 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.397395   475 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:51.394017   509 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.400293   509 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:51.400489 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:51.424103 29714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.622s (SENT) [suppressed 1 similar messages]
I20260709 13:11:51.428153 30344 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:11:51.430104 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 94575.8us
I20260709 13:11:51.431561   558 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:51.435181 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 72512.8us
I20260709 13:11:51.436049 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.440749 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:51.442020 29669 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:51.442023 29818 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.428258   495 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:51.459492 30348 raft_consensus.cc:1240] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.460400 30345 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.460659 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:51.461391 30350 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
W20260709 13:11:51.459738 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 117129us
I20260709 13:11:51.450503   521 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:51.468055 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:51.478827 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:51.482249 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:51.486295 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:11:51.487362 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.487644 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.491359 29819 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:51.495957   473 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.456557   495 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.500862   503 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.489642   475 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.501688   562 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:11:51.460414   509 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:11:51.527446   515 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.526979 29822 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:51.530961   473 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:51.531405 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:51.531826 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:51.532568 29669 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:51.534322 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:51.538020 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.517282 29818 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:51.523337 29820 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:51.524371   503 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:51.527254   495 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:51.539367 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 68552.1us
W20260709 13:11:51.548944 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.551494 29749 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:51.553011 29787 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:51.554684 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:51.560029   493 raft_consensus.cc:3055] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:51.560499   493 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:51.562120   562 consensus_queue.cc:1059] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:51.563341   562 raft_consensus.cc:3055] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:51.530352   515 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:51.536239   500 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:51.568473 29823 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.561357   493 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.553762   441 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:11:51.563730   562 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:51.573777   562 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.575038   562 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:51.576735 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.565945   483 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:51.578284   533 raft_consensus.cc:3055] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:51.578346   483 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:51.579727   483 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.582229 29667 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:51.599697 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.599879 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.601219 29746 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:51.545399   567 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:11:51.618404   467 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:51.616533 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:51.620710 29744 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:51.622641 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.578734   533 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:51.636080 30350 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:51.634760 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 92280.7us
I20260709 13:11:51.641207 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:51.641485 30315 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.643359 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:51.644896 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:51.627943   467 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.583142   500 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.649222 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:51.649803   551 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:51.652064 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:51.634595   515 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:51.651813 29819 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 13:11:51.651165 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:51.652706 29823 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:51.666913 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:51.662992   576 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:51.672345   467 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:51.676779 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.678673   569 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:11:51.679812   569 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:51.680162   569 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:51.681036   569 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:51.659142   532 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:51.682554   560 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:11:51.683645   560 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:51.684011   560 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:51.684836   560 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.686729   532 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:51.687281   532 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.687613   500 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:51.662222   515 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:51.688910   515 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.689532   532 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:51.691363   533 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.695012   533 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:51.701057   475 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:51.708580   560 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:51.714711 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:51.715607 29666 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:51.716684 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:51.717489 29670 raft_consensus.cc:2393] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:51.717875 29671 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:51.726970 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 73404.4us
I20260709 13:11:51.726768 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:51.734377 29671 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:51.735425 29667 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:51.746227 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:51.746642 30344 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:51.743955 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:51.765509 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:51.766377 29667 raft_consensus.cc:2393] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:51.776191 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:51.777024 29670 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:51.778680 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 135398us
I20260709 13:11:51.779800 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.737658   502 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:51.783034 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 140434us
I20260709 13:11:51.777899   521 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.764349   503 consensus_queue.cc:1059] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:11:51.789587 29714 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:11:51.791251 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 143478us
I20260709 13:11:51.783946   569 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:51.804033 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:51.811435 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:51.812306 30344 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:51.815934   503 raft_consensus.cc:3055] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:51.816510   503 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:51.818120   521 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:51.817430   503 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.819236   503 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:51.820393   509 consensus_queue.cc:1175] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "42c443079435463daa8845e244cec9d3" responder_term: 5 status { last_received { term: 5 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 5 index: 3 } }
I20260709 13:11:51.827329   443 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:51.827747   443 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:51.828553   521 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:51.829082   443 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:51.830989 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:51.831828   566 log.cc:927] Time spent T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.412s	user 0.008s	sys 0.000s
I20260709 13:11:51.830950 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:51.829486   521 consensus_queue.cc:1059] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:51.844851 30344 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:51.846000 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:51.846320 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:51.846887 29815 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:51.855301 30348 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:51.850239 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:51.790776   515 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:11:51.838881   502 consensus_queue.cc:1059] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:11:51.857551   500 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:11:51.855511   467 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.802953   562 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:11:51.865621   502 raft_consensus.cc:3055] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:51.860628   519 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:51.888190   531 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:11:51.869619   502 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:11:51.891085   580 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:11:51.894902   586 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:51.864189   435 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:11:51.897223   435 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:51.886853   532 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:51.886776   519 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:51.922261   582 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:51.923000   582 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:51.905733   435 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:51.925537   519 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:51.936223   435 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.937691   576 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:51.917665   472 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:51.957077 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 90970.2us
I20260709 13:11:51.924237   582 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:51.961164 29820 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:51.949487   472 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.966534   472 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:51.963500   590 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.969229   590 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:51.992435   590 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:51.998392 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.000919   519 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:52.005651 29670 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:52.009513   519 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:52.403172 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:52.572750   562 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:52.573601   562 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:52.576589   562 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:53.011754   562 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:53.012360   562 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:52.782075   500 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.014227   500 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.016557   500 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:52.948902 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:53.048275 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08003b98a0 after lost signal to thread 28565
W20260709 13:11:53.048846 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08003b96a0 after lost signal to thread 28568
I20260709 13:11:53.161875   562 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:53.163156   562 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.163772   562 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:53.214054   562 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.425213   562 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.425959   562 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:53.224553   597 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.428813   597 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.431262   597 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:53.431958   597 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.432520   597 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:53.445453 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:53.403879   512 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.470562   512 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:53.378084 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 90442.2us
I20260709 13:11:53.514703   585 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.515412   585 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.531095   493 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:53.563946   507 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.564723   507 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:53.581426   562 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.582211   562 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.582796   562 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:53.587881   512 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.588660   512 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:53.589252   512 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.604027   585 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.604882   585 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:53.605469   585 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.607797   585 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:53.710551 30343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49712 (request call id 715) took 2151 ms. Trace:
I20260709 13:11:53.707624   512 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:53.711232 30343 rpcz_store.cc:276] 0709 13:11:51.558986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.562064 (+  3078us) service_pool.cc:224] Handling call
0709 13:11:51.562460 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.562792 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.562827 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.563352 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.673002 (+109650us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:51.673050 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.673126 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.599866 (+1926740us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b540066fba0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a32dbe 00007fd9e9a3d930 00007fd9e9a3d8d8 00007fd9e9a3d858 00007fd9e9a3d813 00007fd9e9a3ca9c 00007fd9ef928626 00007fd9ef922dd8 00007fd9e9a797cb 00007fd9e9a7c2c0
0709 13:11:53.659623 (+ 59757us) raft_consensus.cc:1685] finished
0709 13:11:53.672456 (+ 12833us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.710155 (+ 37699us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9595,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":94,"spinlock_wait_cycles":8737920,"thread_start_us":96352,"threads_started":1,"wal-append.queue_time_us":99215}
I20260709 13:11:53.714170   472 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:53.715385   472 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.716497   597 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.718065   472 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:53.718268   562 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.719383   472 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:53.710805   601 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.721035   601 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:53.716043   493 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:53.726218 29746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2103) took 2012 ms. Trace:
I20260709 13:11:53.726423   493 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.725155   601 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.725143 29747 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:11:53.726684 29746 rpcz_store.cc:276] 0709 13:11:51.713481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.713619 (+   138us) service_pool.cc:224] Handling call
0709 13:11:51.714056 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.723335 (+  9279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.723366 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.748788 (+ 25422us) log.cc:844] Serialized 26 byte log entry
0709 13:11:51.886142 (+137354us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:51.886187 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:51.886268 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.725985 (+1839717us) raft_consensus.cc:1685] finished
0709 13:11:53.726006 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.726145 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8893,"raft.queue_time_us":9041,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":23355,"thread_start_us":98786,"threads_started":1,"wal-append.queue_time_us":154042,"wal-append.run_cpu_time_us":27646,"wal-append.run_wall_time_us":1423319}
I20260709 13:11:53.728720   493 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:53.729187   493 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:53.725627 29671 consensus_meta.cc:287] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 1.835s	user 0.014s	sys 0.023s
I20260709 13:11:53.720409   472 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:53.730618 29671 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:11:53.731626   512 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:53.732188 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:53.732113   512 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.732853 29747 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:53.733661 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:53.734709 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:53.735332 29747 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:53.734220   472 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:53.733953   493 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:53.736657 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:53.737320 29747 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:53.737792 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:53.739398 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:53.739576   493 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:53.740034 29746 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:53.750640   602 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:53.751281   602 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:53.752549 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2105) took 1835 ms. Trace:
I20260709 13:11:53.753032 29743 rpcz_store.cc:276] 0709 13:11:51.916771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.917060 (+   289us) service_pool.cc:224] Handling call
0709 13:11:51.917485 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:51.917872 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:51.917899 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:51.918492 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:11:53.750400 (+1831908us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:53.750443 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:53.750533 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:53.752307 (+  1774us) raft_consensus.cc:1685] finished
0709 13:11:53.752325 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:53.752483 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":5193,"thread_start_us":1259,"threads_started":1,"wal-append.queue_time_us":1811041}
W20260709 13:11:54.485371 29637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.708s	user 0.015s	sys 0.026s
W20260709 13:11:54.486150 29637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.709s	user 0.017s	sys 0.026s
I20260709 13:11:54.506928   512 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:54.558534 29671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 2467) took 2815 ms (client timeout 1995 ms). Trace:
W20260709 13:11:54.773118 29671 rpcz_store.cc:269] 0709 13:11:51.743557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.743690 (+   133us) service_pool.cc:224] Handling call
0709 13:11:54.558198 (+2814508us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001a3bd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:54.558367 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321045760}
W20260709 13:11:54.652671 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 118395us
I20260709 13:11:54.684580   550 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.685146   567 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.819572   567 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.690662   537 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.822252   537 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.823431   591 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.824087   591 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.824525   537 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.700874   441 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.827338   441 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.828857   602 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.706256   606 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.829416   602 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.829425   441 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.829715   606 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.829990   608 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.831076   608 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.831796   512 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.708181 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.833117   608 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.827338 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.821856   567 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.832063   606 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.836720   560 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.721679 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.727216 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.727798 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.837375   560 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.731639   609 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.737674   594 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.837249   581 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:54.838546 29670 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:54.836278   602 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.838871   594 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.840982   602 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.841259   594 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.737720   582 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.842084   582 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.842628   581 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.741192   610 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:54.843410   560 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.843881   610 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.744711   611 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.846196   611 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.847289   435 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.848280   581 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.848423   611 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.850603   542 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.851125   533 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:54.851392   542 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.832316   512 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.741942   531 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.852830   531 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.853538   542 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.853538   512 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.854933   531 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.854998   574 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.758338 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.766587   571 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.833662   608 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.856014   610 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.855908   574 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.850692   582 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.856513   608 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.857257   490 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.857761   490 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.756186   572 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.838490   609 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.858683   608 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.859227   608 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.859644   608 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.754689   455 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:54.860281   490 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.860664   455 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.861443   463 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.861560   608 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.727077   607 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.862044   463 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.862095   509 raft_consensus.cc:3055] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:54.862771   455 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:54.863010   509 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:54.863000   607 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.860321   609 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.864267   531 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.864076   509 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.864766   531 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.865382   607 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.866362   463 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.866909   463 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.867358   463 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.866923   571 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.869038   572 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.867085   531 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.721414   481 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.870394   509 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:54.870998 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.872418 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.873004 29743 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:11:54.866364   608 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:54.874552 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.875149 29749 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:54.875445   572 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.875975 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.876119 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.876654 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.876943 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.876648 29667 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:54.869392   463 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.879166 30316 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:54.879320   481 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.880025   457 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:54.880451   457 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.880789   457 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.874600   608 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.884093 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.884399 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.884822 29745 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:54.882699   481 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.885701 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.877260 29670 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:54.886468 29742 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:54.885957   614 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.887223 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.887447 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.887810 29749 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:54.886509 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.887933 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.888438 29745 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:54.888607 29668 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 9: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:54.888970 29742 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:54.889210 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.889825 29747 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
W20260709 13:11:54.870127 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:54.890190 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.890920 29746 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:54.891402   613 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.888777 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:54.892114 29743 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:54.891990   613 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.887585 30316 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:54.885252   533 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.887329   614 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.894830 29748 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:54.895128 29820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 2535) took 3261 ms. Trace:
I20260709 13:11:54.895576   532 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.896174   532 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.896821   579 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:54.897258   579 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:54.897691   579 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:54.897900   515 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.895488 29820 rpcz_store.cc:276] 0709 13:11:51.634137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.634280 (+   143us) service_pool.cc:224] Handling call
0709 13:11:51.634531 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:51.962465 (+327934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.894872 (+2932407us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b5400054bd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:54.895055 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750762240}
I20260709 13:11:54.899164   515 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:54.899969   532 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.901126   587 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:54.913882   587 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.898983   473 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:54.903215   583 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.916214 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.916018   583 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.918377   583 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.884251   608 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.904246   594 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.871017   550 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.919476   594 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.921053   550 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.921833   571 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:54.922117   594 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:54.922852   608 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:54.904158 30315 connection.cc:256] RPC call timeout handler was delayed by -1.165207189000057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:11:54.923527   608 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.927002 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.928269   550 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:54.897258   614 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.906524   579 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.908586   457 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.909632   532 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.910245   607 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.910185   557 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.910867   609 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.911432   582 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.911665   443 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.911787   507 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:54.912206   610 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.930119 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.945302 29668 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:54.946648 30316 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:54.934530 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:54.940302 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9b40 after lost signal to thread 29558
I20260709 13:11:54.940642   619 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.941370   616 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:54.942382   614 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:54.942291   582 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.947903 29638 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:54.948074   616 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.948906 29638 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:54.950006   582 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.950382   616 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.950656 29638 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:54.918947   473 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:54.948130   614 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.952404   551 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:54.952127   473 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.953130   473 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.952800   551 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.953307   614 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:54.950224   558 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:54.953980   551 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:54.954396 29823 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:54.954476   463 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:54.955040   463 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.955395   463 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:54.947619 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9720 after lost signal to thread 29570
I20260709 13:11:54.956444 29823 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:11:54.956715 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9c80 after lost signal to thread 29571
W20260709 13:11:54.957442 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080033edc0 after lost signal to thread 29606
I20260709 13:11:54.950969   616 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:11:54.957849 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08003488e0 after lost signal to thread 29626
I20260709 13:11:54.958433 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:54.958902 29770 debug-util.cc:398] Leaking SignalData structure 0x7b0800096920 after lost signal to thread 29698
I20260709 13:11:54.959053 29741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2108) took 1235 ms. Trace:
I20260709 13:11:54.954547   558 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.961478   558 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:54.961650   595 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.962188   595 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:54.964447   595 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:54.966004 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080009f960 after lost signal to thread 29699
I20260709 13:11:54.951321   535 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:54.966846   535 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.960173   572 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:54.967854   572 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.965467 29741 rpcz_store.cc:276] 0709 13:11:53.724004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.958367 (+1234363us) service_pool.cc:224] Handling call
0709 13:11:54.958619 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:54.958767 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.958788 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:54.958835 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:54.958862 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:54.958910 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:54.959003 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:54.905525   445 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:54.968426   572 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:54.975133 29638 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:54.967052 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08002773c0 after lost signal to thread 29773
W20260709 13:11:54.976042 29770 debug-util.cc:398] Leaking SignalData structure 0x7b0800369d40 after lost signal to thread 29774
I20260709 13:11:54.968961   535 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:54.968492 29570 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 5, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.959424   616 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:54.977665 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080034b360 after lost signal to thread 29847
W20260709 13:11:55.009191 29770 debug-util.cc:398] Leaking SignalData structure 0x7b0800378e20 after lost signal to thread 29848
I20260709 13:11:55.009042 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:54.983198 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.010138 29748 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:54.896822   533 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.006379 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.995499 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.012095 29822 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:55.012451 30350 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:55.011137 29770 debug-util.cc:398] Leaking SignalData structure 0x7b08002da0c0 after lost signal to thread 30374
W20260709 13:11:55.013432 29770 debug-util.cc:398] Leaking SignalData structure 0x7b080039ef80 after lost signal to thread 30375
I20260709 13:11:54.901400   515 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:55.017078   625 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.018774   624 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.020004   623 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.011497 29668 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
W20260709 13:11:55.029306 29639 connection.cc:256] RPC call timeout handler was delayed by -1.6041968659999384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
I20260709 13:11:55.005502 29570 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 6, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:55.030871 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.009704 29817 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:55.032091 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.036373 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:54.947100   622 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.037904 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.038161 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.039633 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.040274 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:55.043251 29639 connection.cc:256] RPC call timeout handler was delayed by -1.5303968660000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 13:11:55.044521 29639 connection.cc:256] RPC call timeout handler was delayed by -1.3026968660000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2247s for a response
W20260709 13:11:55.044853 29639 connection.cc:256] RPC call timeout handler was delayed by -1.2243968660000064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23340000000000002s for a response
I20260709 13:11:55.046216 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.047216 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:55.047747 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.048213 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.048411 29667 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:55.049762 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:55.035622 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 56472.9us
I20260709 13:11:55.043323 29816 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:55.056092 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.061631 29822 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 2.
I20260709 13:11:55.043785 29815 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:55.063520 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:55.047339 29670 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:55.019016   629 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.067426 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.033347   595 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:54.947681   619 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.071768   441 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:55.008618   507 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:55.076135 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.070943 29638 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:55.073400 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.068186   624 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.077577   615 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.078123 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.078284 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.058796   533 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.071768 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.098662 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.079321   509 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.095335 29638 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:55.079864 29818 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:55.080549   617 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.885744   502 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.009896   445 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.035192   613 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:54.944373   607 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:54.943401   532 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.041106   515 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:54.974450   551 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.044991   614 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.105237 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.098309 30346 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:55.119962 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.011544   610 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.011729   609 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.140995 29815 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:55.094882   507 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.096570 29817 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:55.107715 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:55.110555 29748 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:55.074884   595 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.111820 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.038184   463 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.116931 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.117892 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.159595 29749 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:55.118254 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:54.974368   557 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.094544   441 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.069273   591 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.097543 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.165861 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.166239 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.166503 29749 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:11:55.120710 29747 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:55.097363   567 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:55.144413   613 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:55.141858 29743 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:55.109341   537 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:55.153141   587 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.154031 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.145502   519 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.154249 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.061264   623 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.156598 30349 raft_consensus.cc:2393] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:55.189682 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.190296 30349 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:55.190469   623 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.191048   623 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:55.045140   625 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.191238 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.192426 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.161185 29666 raft_consensus.cc:2393] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:55.162448 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.193799 29742 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:11:55.108764   509 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.156118 29715 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:55.164439 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.102326   533 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.141155   571 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.184353 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.183372 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.168211 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.159704   595 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.168394 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.165290   441 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.109754   579 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.194644 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.219738 29747 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:55.223539 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.145128   634 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:55.194738 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.157299   576 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:55.153863   507 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.211782   623 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.147981   614 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.212023 30342 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:55.186851   537 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.159089   583 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:55.159816   594 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:55.205354   519 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.158907   447 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.212059   631 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:55.217007 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.183689   567 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:55.221350 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 65308.3us
I20260709 13:11:55.215493   587 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.227174 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.302132 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.159338   515 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.306159 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:55.235414 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 127779us
I20260709 13:11:55.219743   457 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.260104 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.307823 29638 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:55.241281   625 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.161890   582 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:11:55.086156   629 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.107016   615 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.220849   550 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:55.263638 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 108840us
I20260709 13:11:55.283393   602 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.114815   617 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.194649   613 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.279815   619 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.225600   611 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:55.067094   622 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.283236 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:55.288856 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.289651 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.356299 29744 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:55.302764 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.225633   571 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.284508   537 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:55.368417 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.369616 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.311523 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.311719   624 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.312623   630 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:55.313215 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.304097   594 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.315443   515 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.304823   447 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.318113   616 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:55.318624   632 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:11:55.319252   509 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.320013   607 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.321305   463 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.275388   475 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.326259 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.327028 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:55.328660 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.467213 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.333036 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.334478   473 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:55.336974   638 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:55.337471 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:55.337702 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:55.473446 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.338092 29823 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:55.338871 29668 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:55.338264 29665 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:55.339569 30314 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:55.339944 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 2541) took 3445 ms. Trace:
I20260709 13:11:55.342702 30315 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:11:55.474926 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 137511us
W20260709 13:11:55.475137 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 135661us
I20260709 13:11:55.241130 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.302271   567 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.328326 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:11:55.476380 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 148130us
I20260709 13:11:55.477252 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.258180   576 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.346342   609 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.353394 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:55.358582 29789 connection.cc:256] RPC call timeout handler was delayed by -1.3207269640000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
I20260709 13:11:55.309743   587 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.364427 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.358937   611 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.365464   571 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.366791   533 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.367303   610 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.336752   558 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:55.360015 30316 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:55.374928 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.484858 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.303396   583 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.337987   574 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.379599 29748 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:55.313823   637 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.364974   532 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.480919   509 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:55.386893 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.431272 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.560496 29742 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:55.305799   631 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.433621   594 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.482028   457 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:55.382542 30342 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:55.235309   634 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.577615 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.434741 30344 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
W20260709 13:11:55.443387 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.483918   611 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:55.360942   602 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.375463   625 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.390754   551 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.468032 29667 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:55.471091 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.471578 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.475737 29638 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:11:55.478509 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 135915us
I20260709 13:11:55.478920 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:55.475872 30349 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:55.477869 29747 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:11:55.477883 29787 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:55.446679   607 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.483695 29815 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 9: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:55.344321   550 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.486882 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:55.487411 30346 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:55.487665 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
W20260709 13:11:55.489236 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 129298us
I20260709 13:11:55.475056 29819 rpcz_store.cc:276] 0709 13:11:51.894880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.895621 (+   741us) service_pool.cc:224] Handling call
0709 13:11:54.851830 (+2956209us) spinlock_profiling.cc:243] Waited 6.14 ms on lock 0x7b58001d0498. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:11:54.852010 (+   180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:54.942194 (+ 90184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:54.942226 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:54.942699 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.142374 (+199675us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:55.259037 (+116663us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.259261 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.259339 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:55.337431 (+ 78092us) raft_consensus.cc:1685] finished
0709 13:11:55.339732 (+  2301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.339883 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":203974,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":26599,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":23007,"spinlock_wait_cycles":14131584,"thread_start_us":377213,"threads_started":3,"wal-append.queue_time_us":254262}
I20260709 13:11:55.474628   512 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.472658   638 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.721026   638 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:55.386814   630 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.548211 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.379843 29814 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:55.556943   576 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:55.558511   644 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:11:55.480854   463 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:55.470269   557 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.473353   475 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.569943 29670 raft_consensus.cc:2368] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8.
I20260709 13:11:55.570861   447 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:55.571610   535 consensus_meta.cc:287] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.001s
W20260709 13:11:55.571998   646 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:55.575275   537 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.576134   623 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.548867   531 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:11:55.569074 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:55.809615 29665 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:55.728542   625 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:55.659468 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 181649us
I20260709 13:11:55.814616 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:11:55.689070 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 210214us
W20260709 13:11:55.689692 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 214025us
I20260709 13:11:55.691527 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.485556   515 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
W20260709 13:11:55.580806   572 consensus_meta.cc:287] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:11:55.715998 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.716459 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.770401   613 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.690136 29746 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:55.482071   616 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:11:55.720060   445 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.569571   509 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.830142   509 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.830295 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.830938 29817 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:55.831765 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.832302 29817 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:55.833087 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.833613 29817 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
W20260709 13:11:55.741364 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 250854us
I20260709 13:11:55.580821   579 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:55.751397 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.751639   629 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.752156   640 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:55.753250   615 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.754259 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.580682   435 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 13:11:55.576718   507 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.692011   550 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.861546 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.760260   622 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.717203   457 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:55.722774   619 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:55.874589   619 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:55.875242   475 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.875515   619 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.569092   610 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:55.755996   614 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.721983   607 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.906689 29749 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:55.907354 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.907677   607 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.569583   637 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.908979   567 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.798106   618 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:55.798677 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.799083   634 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.804771 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.583272   602 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.549342   571 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:55.793255   463 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:55.717150 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 229548us
I20260709 13:11:55.818228 30314 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:55.819787 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:55.817361 29742 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:11:55.821053 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.922672 30315 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:55.826639 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:55.828356   502 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:55.835666 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.840834 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.854842 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.967870 29746 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:55.940620   571 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.860170 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.685039   519 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.863678   631 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.802628   535 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.866559 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:55.868542   441 consensus_meta.cc:287] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.000s
I20260709 13:11:55.842155   623 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:55.878697 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:55.976387 29815 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:11:55.897516 29671 raft_consensus.cc:2368] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:11:55.898476 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:55.815606   611 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.852768   640 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:55.913308 29665 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:55.823204   572 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:55.897599   558 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.910526   587 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.978132   507 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.988152   640 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.036973   611 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:55.943153 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 123441us
W20260709 13:11:55.942498 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 124341us
I20260709 13:11:55.921757 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.948125 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:55.950450 30345 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 7. Ops: []
I20260709 13:11:55.766531   512 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:55.947548 29821 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
W20260709 13:11:55.969079 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 46497.1us
W20260709 13:11:55.859114 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:55.967701 29819 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:55.940476   463 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:55.921974   630 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:55.966099   652 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.973960 29748 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:55.914978   618 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:55.974792 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.914999   610 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:55.977612 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 79235.2us
I20260709 13:11:55.977705 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.978124   435 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.035151   608 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:55.972175   571 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:55.984987   441 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.051723   435 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.056123   435 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.056830   572 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.057166   441 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.057602 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.051604   567 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.987725 29820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 1896) took 1035 ms. Trace:
I20260709 13:11:56.058696 30349 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:11:55.984315   535 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:55.995612 29743 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 10: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:56.060482 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.982661 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.045249 30315 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.044044 29745 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:11:55.946074   531 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:56.046272 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.062484 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:55.971694   576 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.046849 29749 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:11:56.048054 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.044786 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.058496 29820 rpcz_store.cc:276] 0709 13:11:54.952812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.952937 (+   125us) service_pool.cc:224] Handling call
0709 13:11:54.953264 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:55.371679 (+418415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.371711 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:55.382975 (+ 11264us) log.cc:844] Serialized 26 byte log entry
0709 13:11:55.755020 (+372045us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:55.755060 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:55.987240 (+232180us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400324454. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:55.987398 (+   158us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:55.987459 (+    61us) raft_consensus.cc:1685] finished
0709 13:11:55.987471 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:55.987667 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40385,"raft.queue_time_us":3060,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5306,"spinlock_wait_cycles":960828160,"thread_start_us":320643,"threads_started":1,"wal-append.queue_time_us":374266}
I20260709 13:11:56.050637 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:56.063830 29746 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:56.041857 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.064195 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.064970 29638 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.062407 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.066057 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.066391 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.066582 29745 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:11:56.067107 30347 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:56.067333   535 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.067559 30347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49712 (request call id 723) took 1098 ms. Trace:
I20260709 13:11:56.068028   652 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.067914   535 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:56.068013 30347 rpcz_store.cc:276] 0709 13:11:54.969301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.976059 (+  6758us) service_pool.cc:224] Handling call
0709 13:11:55.080734 (+104675us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:11:56.066260 (+985526us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998e9c 00007fd9e6998a5b 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:11:56.067481 (+  1221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78031616}
I20260709 13:11:56.068951   535 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.051417 30314 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:56.069443 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.069839 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.070070 29748 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:56.070896   652 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.053421 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.071780 29815 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:55.982383   625 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.072762 30315 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.073349 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.054514 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.050601   618 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.073987   652 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:56.074409   652 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.074755   652 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.075325   617 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.046665   637 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:56.055626   654 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:11:56.057981 29669 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:55.972831   595 consensus_meta.cc:287] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.000s
I20260709 13:11:56.034608 30316 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.061381 30350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 427) took 1015 ms. Trace:
I20260709 13:11:56.063102 29744 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:55.975430   623 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:55.980736   509 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:56.081151   572 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:56.083564   572 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.084153   572 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.084724   509 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:11:56.071130 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.065590 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.077445 29742 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
W20260709 13:11:56.057837   443 consensus_meta.cc:287] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 1.083s	user 0.007s	sys 0.004s
I20260709 13:11:56.086666 29674 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:56.087060   610 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.087163   481 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.087718   481 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.069010   567 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.088783   567 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.089144   567 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.079133 30350 rpcz_store.cc:276] 0709 13:11:55.045573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.045733 (+   160us) service_pool.cc:224] Handling call
0709 13:11:55.982506 (+936773us) spinlock_profiling.cc:243] Waited 917 us on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:11:56.061326 (+ 78820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108672}
I20260709 13:11:56.091230 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.092394 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.093111 30350 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:56.073998 29815 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
W20260709 13:11:56.083534 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 49025.8us
I20260709 13:11:56.071254 30314 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.095597 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.096300 29820 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:56.049780 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:11:56.102376 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 52655.1us
I20260709 13:11:56.092875   595 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.104082   509 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:56.104513   509 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:56.104858   509 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:56.105208   595 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.105691   579 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.106205   579 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.103153 29787 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.107827 30343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 423) took 1171 ms. Trace:
I20260709 13:11:56.108289 30343 rpcz_store.cc:276] 0709 13:11:54.936599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.938320 (+  1721us) service_pool.cc:224] Handling call
0709 13:11:55.031332 (+ 93012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.158786 (+127454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:55.163099 (+  4313us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:55.169474 (+  6375us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:55.183570 (+ 14096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.107533 (+923963us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540090d154. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:56.107586 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.107728 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250332032}
I20260709 13:11:56.110705 30348 raft_consensus.cc:2368] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:11:56.112736 30348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 425) took 1168 ms. Trace:
I20260709 13:11:56.115067 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.147071 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.117444 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:56.158390 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.077234   531 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.160903   531 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.162107 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.163074 30341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 428) took 1092 ms. Trace:
I20260709 13:11:56.163314 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.164206 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 1909) took 1079 ms. Trace:
I20260709 13:11:56.164568 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.165849 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.166028 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.164609 29822 rpcz_store.cc:276] 0709 13:11:55.037799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.037938 (+   139us) service_pool.cc:224] Handling call
0709 13:11:56.116648 (+1078710us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b540012b1d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.116766 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42646912}
I20260709 13:11:56.166939 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.167870 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.168603 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.169029 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.147277   610 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.169770   610 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.170637   473 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.115964   443 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:56.163403 30341 rpcz_store.cc:276] 0709 13:11:55.070244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.077612 (+  7368us) service_pool.cc:224] Handling call
0709 13:11:56.116151 (+1038539us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:11:56.162995 (+ 46844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16364288}
I20260709 13:11:56.171749   443 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.172197   443 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.092702   612 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:51.673291 29558 catalog_manager.cc:5028] TS 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): tablet aa5a096f6b164ab5849280a34b19d3b7 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
W20260709 13:11:56.173683 29558 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 4.52231e+06us
I20260709 13:11:55.971127 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:56.174033 29570 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 4, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 4 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.167079 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.176573 30343 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:56.176990 29558 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 389c080a49494f8fb56c53fa7e6087f3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:56.164021 29815 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:56.178555 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.169181 29820 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:56.177402 29571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 340) took 4961 ms. Trace:
I20260709 13:11:56.179913 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.180578 29820 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:56.181502 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.159827 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:11:56.182451 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 79391.9us
I20260709 13:11:56.179122 29815 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:11:56.176222 29570 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 6 to 7, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:56.093990   623 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:56.183853 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 77724.5us
I20260709 13:11:56.179669 29571 rpcz_store.cc:276] 0709 13:11:51.215689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.215858 (+   169us) service_pool.cc:224] Handling call
0709 13:11:51.838517 (+622659us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b54001bec54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a27090 00007fd9e9ac5f3a 00007fd9ef87c1cc 00007fd9ef97a37e 00007fd9ede3b2a4 00007fd9ede3b232 00007fd9ede3b161 00007fd9ede3b0dc 00007fd9ede3a392 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:56.177290 (+4338773us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3504443,"reported_tablets":2,"spinlock_wait_cycles":12642560}
I20260709 13:11:56.182955 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.169654 29822 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:56.188525 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 1916) took 1109 ms. Trace:
I20260709 13:11:56.188872 29822 rpcz_store.cc:276] 0709 13:11:55.079100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.168791 (+1089691us) service_pool.cc:224] Handling call
0709 13:11:56.188460 (+ 19669us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:56.185760 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 68385.2us
I20260709 13:11:56.113106 30348 rpcz_store.cc:276] 0709 13:11:54.943947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.944102 (+   155us) service_pool.cc:224] Handling call
0709 13:11:56.112531 (+1168429us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54007fe254. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.112682 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457550720}
I20260709 13:11:56.190129 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.186496 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 197) took 5083 ms. Trace:
I20260709 13:11:56.187013 29787 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.191206 29789 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:56.191453 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:56.192471 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 121301us
I20260709 13:11:56.194566 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:56.195416 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.195199 29673 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.193267 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.197118 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.198777 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.193122 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:56.200245 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.198400 30315 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.200996 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.201721 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.199747   612 raft_consensus.cc:697] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:56.201910 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.204016 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.207253 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.198036 29787 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.212317 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.213589 29640 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.218451 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.186451   611 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.223383 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.223188   611 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.224005 29820 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:56.224488 29820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 1923) took 1143 ms. Trace:
I20260709 13:11:56.224776 29820 rpcz_store.cc:276] 0709 13:11:55.081017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.213345 (+1132328us) service_pool.cc:224] Handling call
0709 13:11:56.224430 (+ 11085us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.225325   611 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.202626   625 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.198247   489 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.200527   607 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.190987   473 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:56.223563   447 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:56.194309   617 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.194264   637 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:56.190992 29572 rpcz_store.cc:276] 0709 13:11:51.103346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.103516 (+   170us) service_pool.cc:224] Handling call
0709 13:11:56.186431 (+5082915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:51.192164 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:51.192692 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:51.192725 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:11:51.192751 (+    26us) tablet.cc:662] Decoding operations
0709 13:11:51.193278 (+   527us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:51.193352 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:51.193382 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:51.193687 (+   305us) tablet.cc:701] Row locks acquired
0709 13:11:51.193705 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:51.193861 (+   156us) write_op.cc:270] Start()
0709 13:11:51.203533 (+  9672us) write_op.cc:276] Timestamp: P: 1783602711193811 usec, L: 0
0709 13:11:51.203568 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:11:51.246480 (+ 42912us) log.cc:844] Serialized 1302 byte log entry
0709 13:11:51.354448 (+107968us) op_driver.cc:464] REPLICATION: finished
0709 13:11:51.499011 (+144563us) write_op.cc:301] APPLY: starting
0709 13:11:51.499089 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:51.499226 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:51.499363 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:51.499896 (+   533us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:51.500077 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:11:51.500118 (+    41us) write_op.cc:312] APPLY: finished
0709 13:11:51.500320 (+   202us) log.cc:844] Serialized 35 byte log entry
0709 13:11:51.500493 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.500579 (+    86us) write_op.cc:454] Released schema lock
0709 13:11:51.500615 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:51.500989 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:51.501018 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":214917,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":144324,"apply.run_cpu_time_us":1969,"apply.run_wall_time_us":1969,"num_ops":3,"prepare.queue_time_us":945,"prepare.run_cpu_time_us":3658,"prepare.run_wall_time_us":54636,"replication_time_us":150693,"thread_start_us":90179,"threads_started":2}]]}
I20260709 13:11:56.220950 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.238673 29822 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:56.226641   481 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.235155 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.225759 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.235522 29818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 1905) took 1240 ms. Trace:
I20260709 13:11:56.234401 30344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49712 (request call id 732) took 1121 ms. Trace:
I20260709 13:11:56.235141 29715 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.245410 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.263584 29820 raft_consensus.cc:2368] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8.
I20260709 13:11:56.247162 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.221604   610 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.236423   475 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.235616   652 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.253587 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57422 (request call id 903) took 1426 ms. Trace:
I20260709 13:11:56.253813 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 2522) took 1208 ms. Trace:
W20260709 13:11:56.238914   638 consensus_meta.cc:287] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.517s	user 0.000s	sys 0.019s
I20260709 13:11:56.268317 29674 rpcz_store.cc:276] 0709 13:11:54.826956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.827065 (+   109us) service_pool.cc:224] Handling call
0709 13:11:56.253380 (+1426315us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540034c954. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.253499 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877546752}
I20260709 13:11:56.268416 29668 rpcz_store.cc:276] 0709 13:11:55.045499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.055776 (+ 10277us) service_pool.cc:224] Handling call
0709 13:11:56.253634 (+1197858us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400144bd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.253757 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645220608}
I20260709 13:11:56.256091 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2136) took 1272 ms. Trace:
I20260709 13:11:56.257122 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 2533) took 1158 ms. Trace:
I20260709 13:11:56.224831   606 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:56.236617   642 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:56.213958   630 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.277670 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.264950 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:56.264895 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 44018.4us
I20260709 13:11:56.265628 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.230139   608 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.266461 30344 rpcz_store.cc:276] 0709 13:11:55.112598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.305909 (+193311us) service_pool.cc:224] Handling call
0709 13:11:56.234211 (+928302us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540093e254. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.234334 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292980608}
I20260709 13:11:56.230281   512 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.227347   625 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.251636   607 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.272092 29740 rpcz_store.cc:276] 0709 13:11:54.984072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.984219 (+   147us) service_pool.cc:224] Handling call
0709 13:11:54.984505 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:55.165724 (+181219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:55.214218 (+ 48494us) log.cc:844] Serialized 14 byte log entry
0709 13:11:56.061369 (+847151us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b1800087580. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d23a 00007fd9e9ac7a2a
0709 13:11:56.204326 (+142957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.204378 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:56.204423 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.255843 (+ 51420us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400166cd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:11:56.255891 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.256031 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6987,"prepare.queue_time_us":40155,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2258,"raft.queue_time_us":93,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10880,"spinlock_wait_cycles":422553728,"thread_start_us":142610,"threads_started":1,"wal-append.queue_time_us":1032900}
I20260709 13:11:56.276429 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:56.251453   473 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:56.275478 29670 rpcz_store.cc:276] 0709 13:11:55.098298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.098406 (+   108us) service_pool.cc:224] Handling call
0709 13:11:56.256944 (+1158538us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b5400341a54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.257070 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082117888}
I20260709 13:11:56.278803 29787 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.231809   640 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.263372 29818 rpcz_store.cc:276] 0709 13:11:54.994782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.994893 (+   111us) service_pool.cc:224] Handling call
0709 13:11:56.235355 (+1240462us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400324954. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.235457 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85431168}
I20260709 13:11:56.275050 29640 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:56.261588   637 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.292698 29668 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:56.273420   587 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:56.268157   475 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.274111   606 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:56.298256 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.299392 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:56.300055 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.294665 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.309332 30348 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:56.296763 29815 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:56.268181   602 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.281095   608 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:56.283650   582 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.273772   642 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.294369 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.309640 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.310139   515 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:56.294704   473 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:56.294339   489 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.312103   399 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.304911 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:56.304037 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.259630   571 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.316160 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.338940 30348 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:56.339211 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.317157   572 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.318675   576 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.345769 29674 raft_consensus.cc:2368] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:56.320214   531 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.321121 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.322952   443 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.239715   612 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.291667   625 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.326869 29673 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:11:56.291200   607 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.328404 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.313580   608 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.294431   637 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.295789   617 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:56.331193 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.358242 30316 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.359640 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.313549   579 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.332959   550 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.335161 29715 leader_election.cc:400] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8.
I20260709 13:11:56.364343 29715 leader_election.cc:403] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:56.339313   515 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:56.356920   658 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:11:56.314214   475 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.304857   587 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:56.277504   638 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.330847   642 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.337316   489 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.346902 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.348812   572 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.351286 29818 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.354967 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.357352 29668 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.342885 30343 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.368619   610 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.360976   617 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:56.332003   630 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:56.360441 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:56.360571 29673 raft_consensus.cc:2393] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.361006 30349 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 8. Ops: []
I20260709 13:11:56.337074 29670 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:56.367028 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 64264.4us
I20260709 13:11:56.390146 29714 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.363204   602 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:56.374100   587 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.375907   638 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.379714 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.331375 29787 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.382727 29672 raft_consensus.cc:2393] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.381031 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:56.402510 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 71206us
I20260709 13:11:56.403271 29787 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.365284   576 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:56.409358 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:56.394371 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:56.358072   618 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.396885   611 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.387079   617 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.399430   579 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.399938   531 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.405157 29668 raft_consensus.cc:2368] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4.
I20260709 13:11:56.415839 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.405833 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.383126   489 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.397069 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.418691 29668 raft_consensus.cc:2368] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:56.392649   602 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:56.410878   611 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:56.421017   611 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.423205   606 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.424533   606 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.426388 29819 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:56.385289   623 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.387405   630 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.410880   502 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.413501   619 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:56.431908 29714 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.432471 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.431821 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.434566 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:56.425683   652 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.426350   602 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.410398 29818 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:56.416361   576 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:56.408928   435 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.445029 29817 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:56.447242   618 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.445585 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.453145 29818 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:56.432963   630 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:56.459304 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62302.2us
I20260709 13:11:56.437817   502 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:56.470665   587 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.438555   619 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:56.443230   640 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.481268 29668 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:56.481863 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.485088 29818 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.439093   535 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.486128   664 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:56.487826   619 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:56.448515   463 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.479162   502 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.460641   631 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.505941 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:56.508450 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 76623.2us
I20260709 13:11:56.502478   664 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:56.515017   664 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:56.498421   537 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.519382   665 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.520504   665 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.522451 30343 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:11:56.514120 29714 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.488729   571 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.512985 29665 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:56.515223 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.527663 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.528781 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.529630 29819 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:56.510784   550 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.530783 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.531359 29819 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:11:56.531582   567 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.532333 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.533692 29667 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.481197   509 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.541244   607 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:56.551558 29823 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 1908) took 1519 ms (client timeout 1912 ms). Trace:
I20260709 13:11:56.536932 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 1917) took 1457 ms. Trace:
I20260709 13:11:56.537716   583 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.543087 29817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52208 (request call id 980) took 1181 ms. Trace:
I20260709 13:11:56.558779 29817 rpcz_store.cc:276] 0709 13:11:55.361413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.840558 (+479145us) service_pool.cc:224] Handling call
0709 13:11:56.542884 (+702326us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b540012a7d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.543016 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1097409408}
I20260709 13:11:56.560060 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.560714 29817 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:56.547049 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.562037   576 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.563694 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.564426 29814 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:56.565418 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.548512 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:56.502830   663 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.507313   606 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:56.556689 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.566910 29673 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.555794 29815 rpcz_store.cc:276] 0709 13:11:55.079402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.183584 (+1104182us) service_pool.cc:224] Handling call
0709 13:11:56.536735 (+353151us) spinlock_profiling.cc:243] Waited 95.9 ms on lock 0x7b5400324e54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.536866 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220557568}
W20260709 13:11:56.554914 29823 rpcz_store.cc:269] 0709 13:11:55.031724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.031845 (+   121us) service_pool.cc:224] Handling call
0709 13:11:56.551353 (+1519508us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540041da54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.551489 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679617792}
I20260709 13:11:56.550280 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.515767   618 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:56.569177 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 55863us
I20260709 13:11:56.596365 29714 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.573411 30315 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:56.574815   665 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.579162   583 consensus_queue.cc:1059] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:56.600214 29714 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.561645 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.533773   399 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.601336 29817 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:56.585487 29715 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.68:42165 timed out after 1.601s (SENT) [suppressed 9 similar messages]
I20260709 13:11:56.586133 29639 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:56.584451 29667 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:56.602809 29714 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.562822 29670 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 2.
I20260709 13:11:56.569248   667 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:56.506508   611 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.528789   473 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.597697 30315 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:56.604249 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.605818 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.597031 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.606683 29815 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.599792   457 raft_consensus.cc:2764] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:11:56.584472   606 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:56.613174 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.516112   631 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.619808 29668 raft_consensus.cc:2368] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:11:56.616572 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.624171 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.625048 29822 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 3.
I20260709 13:11:56.625188 29741 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2134) took 1643 ms. Trace:
I20260709 13:11:56.567566   475 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.606319   665 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:11:56.627822 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:56.585397   625 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.611774   558 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:56.650238 29815 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:56.632148   611 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.598796   608 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.635914 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.617578   600 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:11:56.627413   519 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:56.669464 29819 raft_consensus.cc:2393] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:56.637228 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.561133   642 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.638293 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 2542) took 1251 ms. Trace:
I20260709 13:11:56.638492 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.639492   475 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.629423   457 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:56.641234 29671 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 2523) took 1595 ms (client timeout 1722 ms). Trace:
I20260709 13:11:56.627440   550 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:56.641641   489 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:56.679044 29671 rpcz_store.cc:269] 0709 13:11:55.045784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.045968 (+   184us) service_pool.cc:224] Handling call
0709 13:11:56.641054 (+1595086us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400145fd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.641176 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1956127104}
I20260709 13:11:56.642617   509 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.683156   550 raft_consensus.cc:697] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:56.683488   509 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.684078   509 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.685647   489 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.686219 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.687400 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.687898 30348 raft_consensus.cc:2393] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:56.688410 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.688992 29748 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.643530   666 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.690478   535 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.690733 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.652240 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.614125   606 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.615183   663 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.654589 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.654764 29639 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:56.655385 29817 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:56.655949 29672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 2537) took 1488 ms. Trace:
I20260709 13:11:56.656703 30315 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.659745 29787 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.625535 29741 rpcz_store.cc:276] 0709 13:11:54.981580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.981717 (+   137us) service_pool.cc:224] Handling call
0709 13:11:54.982130 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:54.982358 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:55.034611 (+ 52253us) log.cc:844] Serialized 14 byte log entry
0709 13:11:55.807506 (+772895us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18003fb560. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69d03f3 00007fd9e69d27c1 00007fd9e69d2779 00007fd9e69d2709 00007fd9e69d26d1 00007fd9e69d19cd 000000000038f354 000000000038f199 00007fd9e69b383a
0709 13:11:55.917320 (+109814us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b18003fb560. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e699e2a6 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e96654bc 00007fd9e69b348b
0709 13:11:56.558818 (+641498us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18003fb560. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e96654bc 00007fd9e69b348b 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d23a
0709 13:11:56.624627 (+ 65809us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.624747 (+   120us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:56.624796 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.624930 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.625135 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52453,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":37582,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4901,"spinlock_wait_cycles":17764352,"thread_start_us":131997,"threads_started":2,"wal-append.queue_time_us":66794}
I20260709 13:11:56.637426   502 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.635362   473 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.600106   618 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.664769 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:56.666260 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.667140 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.670918 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.670306 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:56.706830 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 47168.3us
I20260709 13:11:56.707044 29674 raft_consensus.cc:2393] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.707703 29667 raft_consensus.cc:2393] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.707679 29787 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.708711 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.709398 29741 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:11:56.673554 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.677109 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.629678   623 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.630543   665 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:11:56.677906 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 73733.3us
I20260709 13:11:56.707113 29749 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:11:56.675328 29669 rpcz_store.cc:276] 0709 13:11:55.386497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.386643 (+   146us) service_pool.cc:224] Handling call
0709 13:11:56.638097 (+1251454us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54001450d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.638238 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144355200}
I20260709 13:11:56.679242 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.679428 29673 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:56.643261   435 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:56.681087 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.712318 29743 raft_consensus.cc:2368] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
I20260709 13:11:56.681082 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.644013   558 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:56.682086 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.716246 29671 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 11: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.715520 30316 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.682324 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.716687 29821 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:56.717104 29816 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.681270 29818 raft_consensus.cc:2393] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:56.717365 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52208 (request call id 977) took 1410 ms. Trace:
I20260709 13:11:56.711488 29668 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.694525 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.698508 29666 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:56.711095 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.713179 29749 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:56.712977 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.718457 29815 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:56.712419 29670 raft_consensus.cc:2368] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:56.653661   667 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:56.713912 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 57281.5us
I20260709 13:11:56.680655   457 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:56.713429 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:56.732761 29667 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.691854 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.733649 29822 raft_consensus.cc:2393] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
W20260709 13:11:56.720870 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 82460.7us
I20260709 13:11:56.717694 29821 rpcz_store.cc:276] 0709 13:11:55.306958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.669326 (+1362368us) service_pool.cc:224] Handling call
0709 13:11:56.717311 (+ 47985us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:11:56.724997 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 70334.8us
I20260709 13:11:56.712239 29746 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:56.706943 29672 rpcz_store.cc:276] 0709 13:11:55.167757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:55.167957 (+   200us) service_pool.cc:224] Handling call
0709 13:11:56.655721 (+1487764us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540030eb54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:56.655889 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664051328}
I20260709 13:11:56.717823 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.735864 29817 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.679279   582 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.739229 29669 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:11:56.739593 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.741892 29822 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:56.712180   610 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8.
W20260709 13:11:56.744956 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 159484us
I20260709 13:11:56.738564 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.746824 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:56.750864 29789 leader_election.cc:400] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:11:56.751655 29741 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:56.752147 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.752774 29820 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:11:56.752166 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.725400   558 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:56.754025 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:56.724176   574 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:56.731594   473 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:56.716076   509 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.755326 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.755615 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:56.760476 29745 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:56.760733 29746 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.755349 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.761399 29819 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:56.756014 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:56.762249 29672 raft_consensus.cc:2368] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:11:56.762910 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.763417 29821 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.756367 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:56.716513   665 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:56.731781   611 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:56.738878   457 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.739629   600 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:56.740696   535 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.759895 29715 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.767582 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.684165   550 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.778769   515 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.779397   515 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.781325   608 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.782366 30348 raft_consensus.cc:2368] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:11:56.770038   574 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:56.770224 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.783617   574 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.785046 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.766681   666 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:11:56.777742   670 consensus_queue.cc:1059] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:56.775048   473 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:56.786638   670 raft_consensus.cc:3055] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:56.787032   670 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:56.787156   502 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.787940   670 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.789121   670 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:56.790937 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:56.791597 29819 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:56.793360 29746 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
W20260709 13:11:56.785935   669 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:11:56.794365 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.796301 29746 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:56.799232 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.797465 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.800151 29815 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:11:56.801087 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.802165 29746 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:56.809370 29817 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:56.809633 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.810961 29715 leader_election.cc:400] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:11:56.810854 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 1918) took 1731 ms. Trace:
I20260709 13:11:56.813421 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:56.814872 29715 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:56.816603 29742 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:11:56.817524 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:56.786054   666 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:56.819485   666 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:56.808369   663 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:56.820367   666 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:56.821177   631 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.821566   666 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.822558   610 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:56.807476 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:56.827576 29818 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:11:56.833976 29817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 964) took 1726 ms. Trace:
I20260709 13:11:56.837105 29817 rpcz_store.cc:276] 0709 13:11:55.107982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.819268 (+1711286us) service_pool.cc:224] Handling call
0709 13:11:56.833379 (+ 14111us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.833585 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.833612 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.833657 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:56.833694 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.833750 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.833876 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.811444 29815 rpcz_store.cc:276] 0709 13:11:55.079669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.807960 (+1728291us) service_pool.cc:224] Handling call
0709 13:11:56.810383 (+  2423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.810560 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.810583 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.810622 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:56.810655 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.810710 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.810802 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.842379 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 967) took 1733 ms. Trace:
I20260709 13:11:56.845980 29815 rpcz_store.cc:276] 0709 13:11:55.108751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.841464 (+1732713us) service_pool.cc:224] Handling call
0709 13:11:56.841816 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.842036 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.842062 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.842104 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:56.842141 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.842194 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.842313 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.796614   600 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:56.864319 29818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 965) took 1756 ms. Trace:
I20260709 13:11:56.798058   611 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:56.864740 29818 rpcz_store.cc:276] 0709 13:11:55.108273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.828233 (+1719960us) service_pool.cc:224] Handling call
0709 13:11:56.863785 (+ 35552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.864001 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:56.864024 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:56.864061 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:56.864096 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.864150 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:56.864267 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.806581 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:56.806944   625 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:56.807415   587 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:56.813282   582 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:56.919263 29817 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:56.774435   637 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:56.926321 29817 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 968) took 1813 ms. Trace:
I20260709 13:11:56.928211 29817 rpcz_store.cc:276] 0709 13:11:55.113121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:56.870777 (+1757656us) service_pool.cc:224] Handling call
0709 13:11:56.919082 (+ 48305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:56.926021 (+  6939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:56.926254 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.826467   475 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:56.930421 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.931569 29742 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:56.939543 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 73483us
I20260709 13:11:56.941007 29640 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.942996 29748 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:11:56.945222 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.870402   610 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:56.946625 29667 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:56.943164 29744 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:11:56.948876 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:56.976167 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.977475 29814 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 10: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:56.979175 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:56.979835 29744 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.936144   475 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:56.996271 29822 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:11:56.997612 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:57.004784 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.004961 29639 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.005990 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 969) took 1865 ms. Trace:
I20260709 13:11:57.006453 29822 rpcz_store.cc:276] 0709 13:11:55.140232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.005057 (+1864825us) service_pool.cc:224] Handling call
0709 13:11:57.005427 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.005619 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.005646 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.005688 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:57.005725 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.005777 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.005896 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.007441 29742 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:57.008008 29822 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.008553 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.008714 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 971) took 1845 ms. Trace:
I20260709 13:11:57.009203 29822 rpcz_store.cc:276] 0709 13:11:55.163421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.007516 (+1844095us) service_pool.cc:224] Handling call
0709 13:11:57.007828 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.008475 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.008659 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:56.978363   612 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:56.976533   618 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.021241 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.021451 29746 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:56.980440   531 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:57.021974 29748 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:57.004004   475 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:56.997116   509 raft_consensus.cc:2764] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:11:57.023126 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 208314us
I20260709 13:11:56.996095   667 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:57.024639 29667 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.054971 29819 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:57.030755   637 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.059964   445 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:57.060451   445 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.063581 29742 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.032604   519 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:57.023880   612 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.018668   550 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:57.017971   671 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.038794 30314 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.073524 30314 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.041765 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.042413 29744 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:57.043568 29747 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:57.075115 29749 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:57.044690 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.049536   463 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.053282 29748 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
W20260709 13:11:56.979328 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 271717us
I20260709 13:11:57.056134 29715 leader_election.cc:400] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:11:57.076447 29715 leader_election.cc:403] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:57.076524 29787 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:57.079756 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.079838 29787 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:57.081539 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.082237   567 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.082496   637 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:57.082952   637 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:57.083303   637 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:57.084043   619 consensus_meta.cc:287] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.013s
I20260709 13:11:57.084506   619 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.086396   443 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.086926   606 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.087378   612 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.020812   600 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.089169   606 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.046648   531 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.068965   591 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:11:57.028443   610 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.089727   531 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.061317   445 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.095753   445 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:57.096647   617 consensus_meta.cc:287] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.668s	user 0.017s	sys 0.002s
I20260709 13:11:57.097110   617 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.018389   611 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.082007   571 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:57.069939   519 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.025426 29816 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:11:57.082201 29744 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.101432 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.056038 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.104184 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.106815 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:57.098426 29820 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.110301 29821 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:57.111778 29749 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:11:57.080030 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:11:57.115674   630 consensus_meta.cc:287] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.014s
I20260709 13:11:57.115973   642 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.090045   550 raft_consensus.cc:697] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.117671 29818 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:57.082691   576 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:57.118310   576 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.118654   576 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.119946   618 raft_consensus.cc:2764] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:57.122231 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.122841 29816 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.124882 29744 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:11:57.098116   680 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.113173   623 raft_consensus.cc:2764] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:11:57.129191 29746 raft_consensus.cc:2410] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:11:57.131799 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 985) took 1208 ms. Trace:
I20260709 13:11:57.131984 29823 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.135228 29742 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
W20260709 13:11:57.136866 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 56903.3us
I20260709 13:11:57.117300   550 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.098397   571 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:57.131191   455 consensus_queue.cc:1059] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:57.150631 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:57.154340   602 consensus_meta.cc:287] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.007s
I20260709 13:11:57.144083   617 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.159245   619 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.141955   670 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:57.152365   607 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:57.146114   664 consensus_meta.cc:287] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.631s	user 0.007s	sys 0.005s
I20260709 13:11:57.148496   671 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:57.131749   558 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.159736   457 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.148121   666 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:57.132572 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 2543) took 1169 ms. Trace:
I20260709 13:11:57.203486 29815 rpcz_store.cc:276] 0709 13:11:55.963022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.131866 (+1168844us) service_pool.cc:224] Handling call
0709 13:11:57.132125 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.132289 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.132315 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.132350 (+    35us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:57.132382 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.132430 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.132520 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.116123   630 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.207696   630 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.139334 29818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 984) took 1215 ms. Trace:
I20260709 13:11:57.157963   448 raft_consensus.cc:3055] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.209055   448 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.208720   475 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.209903   448 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.211112   448 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.144680 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:57.132397 29814 rpcz_store.cc:276] 0709 13:11:55.923857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.131016 (+1207159us) service_pool.cc:224] Handling call
0709 13:11:57.131321 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.131501 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.131524 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.131563 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:57.131595 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.131645 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.131738 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.161741 29820 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:57.215095 29814 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:57.215548   457 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.217398   463 raft_consensus.cc:2764] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:57.174302   571 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:57.218448 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 73842.7us
I20260709 13:11:57.219303 29638 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.220866 29815 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:11:57.208616 29818 rpcz_store.cc:276] 0709 13:11:55.923631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.117207 (+1193576us) service_pool.cc:224] Handling call
0709 13:11:57.117516 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.139100 (+ 21584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.139285 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.223443   519 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.224965   680 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:11:57.228438   558 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.230672 29638 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.232626 29638 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.165241 29816 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:57.165934 29787 leader_election.cc:400] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
W20260709 13:11:57.169348 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 153877us
I20260709 13:11:57.170830 29823 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:11:57.233352 29787 leader_election.cc:403] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:11:57.174346 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 169485us
I20260709 13:11:57.176271 29821 raft_consensus.cc:1240] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.234423 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 979) took 1884 ms. Trace:
I20260709 13:11:57.178460 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:11:57.194379 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 442257us
I20260709 13:11:57.234545 29818 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.235211 29744 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:57.235423 29789 leader_election.cc:400] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4.
I20260709 13:11:57.236057 29748 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:57.236282 29789 leader_election.cc:400] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.194432 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 2554) took 1158 ms. Trace:
I20260709 13:11:57.238132 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.238593   617 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.239068 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:57.234771 29821 rpcz_store.cc:276] 0709 13:11:55.350568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.111339 (+1760771us) service_pool.cc:224] Handling call
0709 13:11:57.176048 (+ 64709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.234139 (+ 58091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.234366 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.238050 29819 rpcz_store.cc:276] 0709 13:11:56.036430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.177579 (+1141149us) service_pool.cc:224] Handling call
0709 13:11:57.193833 (+ 16254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.194073 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.194101 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.194145 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:57.194183 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.194237 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.194366 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:57.199888   664 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.239830   619 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:57.240751 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.241320 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.241500 29819 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:57.240751   619 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:57.242096   664 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.242193   619 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:57.191365   670 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.243861   670 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.244524 29789 leader_election.cc:400] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
W20260709 13:11:57.237978 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 103768us
I20260709 13:11:57.245190 29715 leader_election.cc:400] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:11:57.245509 29715 leader_election.cc:403] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:57.247720 29789 leader_election.cc:400] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.240314 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.255133 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.255774 29741 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:57.255890 29669 raft_consensus.cc:2368] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7.
I20260709 13:11:57.256482 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.258422 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.245721   623 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:57.245457 29787 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:57.262341 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.263247 29639 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:57.271385 29639 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.266682 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.275517 29672 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:57.276503 29714 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.277128 29749 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.276610 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:57.279376 29638 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.277719 29639 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.287827 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:11:57.289428 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.258867   463 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:57.284397 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.268062   680 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:11:57.289453 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.259402   535 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:57.281392 29638 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.191692   602 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.293591 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.297955 29714 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.298314 29745 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:57.293807 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.258625   558 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.295877 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.299330 29741 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.238384   665 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.279862   435 raft_consensus.cc:2764] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:11:57.294732 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 191305us
I20260709 13:11:57.267686   618 consensus_queue.cc:1059] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:11:57.296964 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.309976 30348 raft_consensus.cc:2368] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
I20260709 13:11:57.280736   399 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:57.267835   583 consensus_queue.cc:1059] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:11:57.286054   509 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:57.178738   531 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.286048   537 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:57.314591 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 182229us
I20260709 13:11:57.292573   671 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:57.290181   664 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.289897   640 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:57.299633   519 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.300827   607 raft_consensus.cc:2764] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:57.314522 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.315920 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.359114 29822 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 974) took 2151 ms. Trace:
I20260709 13:11:57.359109 29744 raft_consensus.cc:2368] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.359793 29822 rpcz_store.cc:276] 0709 13:11:55.207986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.010079 (+1802093us) service_pool.cc:224] Handling call
0709 13:11:57.010354 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:57.010555 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:57.259026 (+248471us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.358621 (+ 99595us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:57.358712 (+    91us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:57.358781 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.358864 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.359039 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":325705,"threads_started":2}
I20260709 13:11:57.321082 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.324167 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:57.320091 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.336686 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.339121 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.341086 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.343420 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:57.355325 29743 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:57.346964 29746 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:57.306886   606 raft_consensus.cc:2764] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:11:57.365541 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 44553.2us
I20260709 13:11:57.267848   576 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.364338   509 raft_consensus.cc:697] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:57.350375 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:11:57.368403 29558 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 389c080a49494f8fb56c53fa7e6087f3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:11:57.354322   671 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:57.353178 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.347644 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.279208   637 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.281141   676 raft_consensus.cc:2764] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:11:57.365747 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:57.366417 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:57.367594 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:11:57.347142 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 64700.6us
W20260709 13:11:57.367651 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 47901us
I20260709 13:11:57.381462 29787 leader_election.cc:400] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.381711 29787 leader_election.cc:403] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:57.349350 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.382402 30346 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:57.370131 30315 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.352092 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.374480 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.377015 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:57.377790 29749 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:57.378113 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.362717   558 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:57.363540   638 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:57.374253 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.380409 29747 raft_consensus.cc:2393] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:57.370379   611 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:57.387077 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:57.387283 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:57.388007 29816 raft_consensus.cc:2393] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:57.387161 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:57.388624 29815 raft_consensus.cc:2393] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:57.385663 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.389516 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.389680 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:57.390130 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.391328 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.386407 29822 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:57.372392   618 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:57.394205 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.389438 29744 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:57.392999 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.390980 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.396277 29747 raft_consensus.cc:2368] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.375372   623 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:57.395728 30314 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.402866 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.403241   457 raft_consensus.cc:3055] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.403642   457 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.379482   671 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.379298   399 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.408605   509 consensus_queue.cc:237] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.400722   640 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.384382   692 consensus_queue.cc:1059] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:11:57.410297   537 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:57.411036   686 raft_consensus.cc:3055] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:57.391839   611 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:57.384609   630 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.418915 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.400516   489 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.422730 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.428782   612 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:57.429482 29747 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:57.414350   675 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:57.387621   625 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:57.460589 29744 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:57.460860 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 66733.8us
I20260709 13:11:57.546926 29638 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.393790   587 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:57.412873   475 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.413439   619 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.401582   676 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:57.462644   686 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:11:57.420250 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50197.7us
I20260709 13:11:57.391499   519 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:57.531886 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 109256us
I20260709 13:11:57.547168 29819 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:57.550446 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 272799us
I20260709 13:11:57.552057 29787 leader_election.cc:400] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.460386   558 raft_consensus.cc:697] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.584113   531 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.584955   619 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.584753   558 consensus_queue.cc:237] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.558821   697 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:57.586519   697 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.587381   697 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.591325 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.592741 29815 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.595142   574 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:57.596345   574 consensus_queue.cc:1059] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:57.599120   691 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:57.599521   691 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.599586   701 raft_consensus.cc:3055] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.600092   701 raft_consensus.cc:740] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.600463   691 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.600919   701 consensus_queue.cc:260] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.465059   698 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:57.469573 29745 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:57.625528 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.626192 30345 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:57.627527 29815 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:57.628532 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50490 (request call id 308) took 6522 ms. Trace:
I20260709 13:11:57.530834   618 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:57.462380   638 raft_consensus.cc:697] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.530157   611 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:57.460314   445 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:57.561962 29787 leader_election.cc:403] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:11:57.563066 29789 leader_election.cc:400] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
W20260709 13:11:57.570528   687 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:11:57.572952   571 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.574206   640 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.575886   686 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.577324   637 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.429159   623 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.464509   399 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.579629   443 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.582350   665 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.583065   602 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.562207   675 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:57.604506 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46779us
W20260709 13:11:57.623253 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 60723.6us
I20260709 13:11:57.629011 29570 rpcz_store.cc:276] 0709 13:11:51.106241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:51.106408 (+   167us) service_pool.cc:224] Handling call
0709 13:11:57.628430 (+6522022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:56.335602 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:56.362773 (+ 27171us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:56.362821 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:56.362847 (+    26us) tablet.cc:662] Decoding operations
0709 13:11:56.430109 (+ 67262us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:56.433138 (+  3029us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:56.437977 (+  4839us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:11:56.502098 (+ 64121us) tablet.cc:701] Row locks acquired
0709 13:11:56.503199 (+  1101us) write_op.cc:260] PREPARE: finished
0709 13:11:56.514147 (+ 10948us) write_op.cc:270] Start()
0709 13:11:56.535528 (+ 21381us) write_op.cc:276] Timestamp: P: 1783602716514083 usec, L: 0
0709 13:11:56.551913 (+ 16385us) op_driver.cc:348] REPLICATION: starting
0709 13:11:56.643158 (+ 91245us) log.cc:844] Serialized 1686 byte log entry
0709 13:11:57.363169 (+720011us) op_driver.cc:464] REPLICATION: finished
0709 13:11:57.577699 (+214530us) write_op.cc:301] APPLY: starting
0709 13:11:57.577803 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:57.577978 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:57.578110 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:57.578686 (+   576us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:57.578875 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:11:57.578918 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:57.579142 (+   224us) log.cc:844] Serialized 41 byte log entry
0709 13:11:57.579321 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:57.579425 (+   104us) write_op.cc:454] Released schema lock
0709 13:11:57.579472 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:57.579880 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:57.579906 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4442528,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":192783,"apply.run_cpu_time_us":2185,"apply.run_wall_time_us":17780,"num_ops":4,"prepare.queue_time_us":108470,"prepare.run_cpu_time_us":16613,"prepare.run_wall_time_us":613573,"raft.queue_time_us":259408,"raft.run_cpu_time_us":7772,"raft.run_wall_time_us":112888,"replication_time_us":757730,"thread_start_us":442855,"threads_started":4,"wal-append.queue_time_us":342350}]]}
I20260709 13:11:57.601759   691 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:57.639981 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 77048.5us
I20260709 13:11:57.667297 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.640383 30346 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:57.593562   670 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:57.646055 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 97626.6us
I20260709 13:11:57.646701 29569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50500 (request call id 321) took 4246 ms. Trace:
I20260709 13:11:57.622903   576 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.648027   489 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.649200   701 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.470474   457 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.657035 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.658082 30350 raft_consensus.cc:1240] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:57.664938 29639 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.665081 30345 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:11:57.671317 29569 rpcz_store.cc:276] 0709 13:11:53.381257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:54.611087 (+1229830us) service_pool.cc:224] Handling call
0709 13:11:57.627033 (+3015946us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":444712,"reported_tablets":2}
I20260709 13:11:57.671993   618 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:57.675978 29741 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:57.643543   445 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:57.686319   445 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.651628   703 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.692425 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.693220 29744 raft_consensus.cc:2393] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:57.655294   443 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.691290 29638 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.700457   571 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.702838 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:57.656849 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.704419 29814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 1931) took 1443 ms. Trace:
I20260709 13:11:57.715927 29823 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:11:57.715788 29814 rpcz_store.cc:276] 0709 13:11:56.260996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.216061 (+955065us) service_pool.cc:224] Handling call
0709 13:11:57.216355 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:57.231571 (+ 15216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:57.231601 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:57.237316 (+  5715us) log.cc:844] Serialized 26 byte log entry
0709 13:11:57.379637 (+142321us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:57.679836 (+300199us) log.cc:844] Serialized 14 byte log entry
0709 13:11:57.703616 (+ 23780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:57.703687 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:57.704194 (+   507us) raft_consensus.cc:1685] finished
0709 13:11:57.704212 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:57.704355 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48795,"prepare.queue_time_us":80976,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":14923,"raft.queue_time_us":15452,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":31215,"thread_start_us":420307,"threads_started":2,"wal-append.queue_time_us":463456}
I20260709 13:11:57.673658   686 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:57.718706 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 51485.2us
I20260709 13:11:57.719624 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.673265   617 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
I20260709 13:11:57.703783   567 consensus_queue.cc:1059] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:11:57.730516 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:57.725209 29741 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:57.725786 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.726042 29747 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:57.732195 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:57.726882 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:57.724684 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.721907 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.734412 29666 raft_consensus.cc:2368] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4.
I20260709 13:11:57.734925 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.735975 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.737172 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.740654 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.744019 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:57.744885 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.745783 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.718150   697 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:57.746345 29742 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:57.727644   683 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:57.747534 29666 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:57.762310 30342 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:57.762557   683 raft_consensus.cc:697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.763324 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.763532   683 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.764983 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.748544 29714 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.751003   567 raft_consensus.cc:3055] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:57.727681   675 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.751518   665 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:57.775614 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.754141   697 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.776583 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.776937   697 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.778096 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.778795 29672 raft_consensus.cc:2368] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:57.779533 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.755354   623 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:57.759080   519 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.760414   640 consensus_queue.cc:1059] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:57.801316   671 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.747481   684 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:11:57.803635   671 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:57.761489   696 log.cc:927] Time spent T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:57.738420   509 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:57.741868   637 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.769357 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:57.770342   567 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:11:57.814900 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 45596.7us
I20260709 13:11:57.816077 29714 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:57.817425 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.771668 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.772893   537 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:57.774312 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:57.774530 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:57.729796   698 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:57.820084 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:57.782222 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.767055 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:57.748833   618 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:57.784312 29742 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:57.785480 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.788347 30349 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:57.741690   619 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.790464 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.830639 29669 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:57.791129   693 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.189s	user 0.002s	sys 0.000s
I20260709 13:11:57.792040 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.792454 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.833433 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.794287   670 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:57.794416   699 log.cc:927] Time spent T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.224s	user 0.002s	sys 0.001s
I20260709 13:11:57.777549   638 consensus_queue.cc:237] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.834897   671 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.840649   567 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.841886   567 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:57.844759 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:57.746345   558 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:57.795884 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.846752 29745 raft_consensus.cc:2393] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:57.785009   443 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.796553   591 raft_consensus.cc:3055] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.847752   591 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.848641   591 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.772854   463 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:57.786441   602 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.815485   665 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.850400   443 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.852465   698 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.807099   550 raft_consensus.cc:3055] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.808245   684 raft_consensus.cc:3055] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:57.808764   611 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.811967   457 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.704164   531 consensus_queue.cc:1059] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:11:57.828564 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 426124us
I20260709 13:11:57.808091 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:57.765224   445 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.892899   463 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.903754 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:57.904680 29747 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:57.857705   591 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.919306 29669 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:57.921209   602 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:57.954350 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.955350 29670 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:57.913575 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:11:57.957398 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 192472us
W20260709 13:11:57.959467 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48564.6us
I20260709 13:11:57.960873 29638 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:57.964274   443 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:57.965147   537 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:57.959218   701 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:11:57.969551   435 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:57.974545   600 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:57.976585   600 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:57.979372 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.900095   519 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:57.980593   519 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.977002   600 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:57.982982   519 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.982758   600 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:57.914580 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:57.915175   463 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.922014 29669 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:57.924010 29666 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:57.984591   600 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:57.985939 30343 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:57.987079   713 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:57.908957 29744 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:57.926620 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.988139   665 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:57.927330   611 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:57.927847 30341 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:57.857542   550 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.930987 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:57.933019 29819 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:57.990602 29639 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:57.934017 29814 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:57.933575   698 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:57.997440   535 raft_consensus.cc:3055] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:57.997967   535 raft_consensus.cc:740] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.860183   684 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.908315   475 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:57.945183   445 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:57.945840 30348 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:11:57.950456 29665 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:57.911437 29747 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:57.976619   435 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:57.998823   535 consensus_queue.cc:260] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.008394   535 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:58.010646 29740 raft_consensus.cc:1240] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:58.004746   724 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:57.968046   443 raft_consensus.cc:3055] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:57.992933   550 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:57.992100 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:58.017397   686 consensus_queue.cc:1059] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:11:58.018440   686 raft_consensus.cc:3055] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:58.018772   686 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:58.019186   435 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.019574   686 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.020843   686 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:57.913832 29789 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.027724 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:58.028541 29745 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:57.980526   399 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:11:58.033855 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 120109us
I20260709 13:11:58.034601 30315 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:11:58.035102 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.033769 30316 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.037146 29740 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:58.039142 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.040462 29789 leader_election.cc:400] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 3. Current term is 4.
I20260709 13:11:58.041316 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.043267 29747 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:58.046934 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:11:58.047828 29742 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:58.054332 29789 leader_election.cc:400] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:11:58.054512 29715 leader_election.cc:400] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7.
I20260709 13:11:58.054889 29715 leader_election.cc:403] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:58.055307 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.056501 29819 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:58.057618 29815 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:58.060992 29814 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:58.014766   443 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:58.023932   550 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:58.066586 29744 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:58.065842 29640 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:58.072513 29814 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:11:58.063541 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.081117 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:58.062472   537 consensus_queue.cc:1059] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:11:58.023168   697 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:11:58.082628 29816 raft_consensus.cc:1240] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:58.062382   619 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.031502   445 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:11:58.032297   531 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:58.092615 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.093865 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.051220   618 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.051061   670 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.069501 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.102753 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.067099   625 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:58.050849   701 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:58.065192   707 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.063676   637 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.066026   611 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7.
I20260709 13:11:58.076442   571 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.107838   619 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:58.133332 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:58.115929   724 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:58.050585   713 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:11:58.117942   617 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.071141   509 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:58.113595 30341 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:58.066006   399 consensus_queue.cc:1243] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer 121060c6c5b14502957b76fd1dfc7b2d log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:58.086252   665 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:58.127089 30314 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.170958   611 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.188148 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 61173.8us
I20260709 13:11:58.119328   576 consensus_queue.cc:1059] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:58.101414   671 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:58.114593   519 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.076048   457 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:58.135251 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:58.101179   711 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:11:58.137164 29666 raft_consensus.cc:1240] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:58.138615 29669 raft_consensus.cc:1240] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:58.140136 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:58.119964   692 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.234319 29823 raft_consensus.cc:1240] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:11:58.216456 29569 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 8 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.125594   475 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.101567   606 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:11:58.123018   701 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.183063 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:58.237627 29569 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 7, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 7 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.119944   583 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:11:58.186405   509 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:58.187922   611 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.219916   448 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.191671 29816 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:11:58.192507 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.127661   531 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:58.199482 30314 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.219646 29668 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:58.217096   724 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:58.227043   576 raft_consensus.cc:3055] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.228053   684 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.233150 29820 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:58.249248 29673 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 5.
I20260709 13:11:58.250478 29672 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:58.252192   665 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:58.107532 29789 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.131052   443 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:58.270649 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 71277.1us
I20260709 13:11:58.254402 29569 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:58.275902 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 168441us
I20260709 13:11:58.276782 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:11:58.277253 29745 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:58.278230 29789 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
W20260709 13:11:58.278491 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 184693us
I20260709 13:11:58.278132 29569 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 8 to 10, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 10 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.279518 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:58.256256   509 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:11:58.280365 29569 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 7 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 9 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.260233   683 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:11:58.262107   610 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:58.250326   692 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.296298 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:58.266996   576 raft_consensus.cc:740] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:58.271898   448 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.286038   574 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:11:58.286953   637 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.281503   675 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:11:58.310927   611 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:58.311488   531 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:58.315256 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 249481us
I20260709 13:11:58.287200   625 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:11:58.286510   606 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:58.294045   617 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:58.337443 29815 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:58.297351   610 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.301576   619 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:11:58.310158   443 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.282564   665 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.306927   724 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.315959 30341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:11:58.293684   671 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:11:58.299960   463 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:11:58.347437 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.291455   713 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:11:58.366259 29742 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:58.348750   734 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.304491   550 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:11:58.359515 29815 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:58.324704   399 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:11:58.374656 30341 raft_consensus.cc:606] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:58.366722   606 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:58.395244   610 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:58.348752   611 consensus_queue.cc:1059] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:11:58.380245 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 84917us
W20260709 13:11:58.407963 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 111762us
I20260709 13:11:58.409653 29715 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:58.400261 30341 raft_consensus.cc:614] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:58.375666   732 consensus_queue.cc:1059] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:11:58.422266 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.382571   734 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:58.505460 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 96223.5us
I20260709 13:11:58.505141   686 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.526850   619 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.571162   619 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.599568   738 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:58.602767   738 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:58.599424   731 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.177s
I20260709 13:11:58.562791   686 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.599678   742 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:11:58.613534   743 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:58.614245   743 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:58.615171   743 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.615898   619 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:58.610020   686 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:58.561625   665 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:58.562145   732 consensus_queue.cc:1243] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:11:58.619518   475 consensus_queue.cc:1059] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:58.615268   677 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:11:58.622764   611 raft_consensus.cc:3055] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:58.623196   611 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:11:58.616386 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 206803us
I20260709 13:11:58.636754   558 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:58.667017   558 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.668298   611 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.616526   734 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:58.669628   611 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.695601 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:58.696446 30343 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:58.697587 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:58.698354 30341 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
W20260709 13:11:58.734825 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 311605us
I20260709 13:11:58.745071   619 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:58.745676   619 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.753757 29747 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:58.754423 29748 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:58.758091 29742 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:58.758361 29749 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:11:58.760553 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.733204   625 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.736099   686 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:58.768544   576 consensus_queue.cc:260] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.768779   686 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.770876 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:58.762477   619 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:58.773880 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:58.778579   576 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.772588   625 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.809091   731 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:58.811275 30348 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:58.815050   619 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.821328 30348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:11:58.821961 30348 raft_consensus.cc:606] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:58.822309 30348 raft_consensus.cc:614] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:58.787638   737 consensus_queue.cc:1059] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:11:58.822831   619 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.825529   399 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:11:58.835278 30348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:11:58.835919 30348 raft_consensus.cc:606] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:11:58.838414   606 raft_consensus.cc:3055] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:58.838848   606 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:58.839313   619 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:58.839640   606 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.840639   606 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:58.841236   625 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:58.843142 29748 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:11:58.843565 29748 pending_rounds.cc:85] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 5
I20260709 13:11:58.843487   735 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.843896 29748 pending_rounds.cc:107] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:11:58.844267 29748 raft_consensus.cc:2889] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.844265   735 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.846547   735 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:58.835577   686 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:58.853660 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:58.856470 30344 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:58.857894 30348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc29718e51d549e395e72e7bff383425"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:11:58.858563 30348 raft_consensus.cc:606] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:11:58.858915 30348 raft_consensus.cc:614] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:58.861660   704 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:58.862123   704 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:11:58.862924   704 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.864312   704 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:58.868862 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:58.870435 29746 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:58.873780 29640 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:11:58.876174 29787 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:58.864476 30343 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:58.894984 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:58.894917   686 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:58.898368   686 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.898773   686 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:58.901700 30342 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:58.903607 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:58.904467 29741 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:11:58.904915 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:11:58.906796 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:58.896579   683 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:58.896175   571 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.896414   611 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:58.917521 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:58.913395 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 134981us
I20260709 13:11:58.914017   625 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.915966   683 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:58.944275   735 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:11:58.944296 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:58.951601   567 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:58.952783 29817 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:58.954442 29816 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:58.954449   642 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:58.977519 29749 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:58.956881 29746 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:11:58.961549 29740 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:58.970359 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:58.972443   399 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:58.978195 29746 pending_rounds.cc:85] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 3
I20260709 13:11:58.972877 29742 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:58.978756 29746 pending_rounds.cc:107] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:58.978906 29748 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:11:58.979224 29746 raft_consensus.cc:2889] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.981694 29746 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:58.919737   611 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:58.984197 29821 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:58.978560   399 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.986784   399 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:58.989490   600 raft_consensus.cc:993] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:58.990056   600 raft_consensus.cc:1081] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:11:58.990500   611 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:58.999470   399 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:59.000538   701 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:58.991250 29743 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:58.919006   435 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:11:58.919569   571 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.991955   737 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:58.992193 29742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:36354
I20260709 13:11:59.014084 29742 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.014554 29742 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:58.993098   708 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:58.973435   683 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:58.993140 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:59.036228 29742 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:58.972458   625 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:59.049834 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.022325   519 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:59.050380   701 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.055886   606 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.087630 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 104196us
I20260709 13:11:59.088366 29742 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.089995 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:59.090548 30342 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:59.090898 30342 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:59.091684 30342 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:59.093824 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 96697.6us
W20260709 13:11:59.084774   759 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:11:59.080605   519 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:59.023998   708 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.093606   642 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:11:59.092518   640 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:11:59.092893   737 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:11:59.085249   701 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.100095   531 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:11:59.096580   606 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:59.151789 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44328.4us
I20260709 13:11:59.107631   638 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:11:59.159840   606 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:11:59.156742 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.123175   763 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:11:59.161484   571 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.202610 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.208089 29821 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:59.208685 29816 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
W20260709 13:11:59.209388 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.210590 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.211855 29817 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:59.211997 30315 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:11:59.213398 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:59.164096   519 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.193501   571 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:59.216868 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:11:59.218544 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 92816.1us
I20260709 13:11:59.211186   489 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:59.228926   732 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.229615 30315 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
W20260709 13:11:59.237814   771 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:59.238582   701 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.239269   701 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:11:59.240032   772 log.cc:927] Time spent T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:11:59.240729   701 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:59.241233   701 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:11:59.241611   701 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.241945   531 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:59.220319   606 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:59.243333   531 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:11:59.243136   788 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.249571   708 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.250140   788 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.251755   788 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:59.254472   768 log.cc:927] Time spent T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:11:59.256413 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.257135 29816 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:11:59.258071 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.259205 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.259819 29816 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
W20260709 13:11:59.260177   766 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:11:59.260354 29823 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:59.227291   611 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:59.261471   611 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.261826   611 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.262324 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.263530 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.264178 29819 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:11:59.266264 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:59.270428 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.266881 29817 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.271059 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.273391 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:59.227908   625 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:11:59.232960   761 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:11:59.268805 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.277287 29673 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:11:59.296460 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 76406us
W20260709 13:11:59.250887   769 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:11:59.285492 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.340739 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.286266 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:11:59.281749 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 52290.6us
I20260709 13:11:59.342279 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:59.342869 29671 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.343669 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.343804 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.344393 29822 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:59.344563 29819 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:11:59.355038 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.244668   519 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.355871 29817 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:59.222400   571 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.360800 29671 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:11:59.363071 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:59.245556   435 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.363801 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 88949.3us
I20260709 13:11:59.246349   606 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:59.366297 29714 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:59.371274 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.371759 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.294309   475 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:59.368371 30315 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
W20260709 13:11:59.374140 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 274965us
I20260709 13:11:59.377447 29820 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 1003) took 1076 ms. Trace:
I20260709 13:11:59.377821 29820 rpcz_store.cc:276] 0709 13:11:58.294309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.294470 (+   161us) service_pool.cc:224] Handling call
0709 13:11:58.315407 (+ 20937us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:58.326175 (+ 10768us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:58.843838 (+517663us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b180034d140. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cd455 00007fd9ed4b53c7 00007fd9e9ac79a7 00007fd9e9ad70bf 00007fd9e9ad7038
0709 13:11:59.019782 (+175944us) log.cc:844] Serialized 14 byte log entry
0709 13:11:59.161023 (+141241us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:59.161520 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:11:59.161666 (+   146us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:59.161698 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:59.161762 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:59.354174 (+192412us) raft_consensus.cc:1685] finished
0709 13:11:59.370107 (+ 15933us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:59.370301 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11539,"prepare.queue_time_us":761944,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2067,"raft.queue_time_us":247772,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":14675,"spinlock_wait_cycles":22840064,"thread_start_us":315846,"threads_started":3,"wal-append.queue_time_us":150161}
I20260709 13:11:59.233156   489 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.244139   732 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.389074 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.365381 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:59.372562   606 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:59.389484 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.419275 29673 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:11:59.382167 29669 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:11:59.379840 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.420468 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.353667   752 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:11:59.421368 29671 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:11:59.420420 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.426883 29669 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:11:59.428303 29669 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:11:59.417713   704 consensus_meta.cc:287] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.515s	user 0.004s	sys 0.006s
W20260709 13:11:59.431275 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 62976.9us
I20260709 13:11:59.432109 30315 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:59.381201   475 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:11:59.376731   435 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:59.460783 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.470748 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:59.503785 29817 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:59.507511 29818 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:59.509280 29817 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:11:59.518855 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 152606us
I20260709 13:11:59.498349 29674 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:11:59.433495 29673 raft_consensus.cc:1240] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:59.430786   625 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.380499   686 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.526266 29668 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:11:59.533720 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.514056   475 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.519884   708 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:59.539655   792 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.547643   795 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:59.551375   708 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:59.564627 29672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 2561) took 1431 ms (client timeout 1590 ms). Trace:
W20260709 13:11:59.565860 29672 rpcz_store.cc:269] 0709 13:11:58.132959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.133066 (+   107us) service_pool.cc:224] Handling call
0709 13:11:59.564453 (+1431387us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b5400267d54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:59.564570 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126367488}
I20260709 13:11:59.554905   789 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.537750   625 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:11:59.572649 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.578359   571 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:59.559499   792 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.580197   435 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.580869   792 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.581234   701 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.583461   701 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.567426   708 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.592953 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.565430   795 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.571323   711 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:59.591778   435 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.600167 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:11:59.597968   795 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.610630   435 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.613381   435 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:11:59.614403   784 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:11:59.591131   625 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:59.561384   509 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.588928   799 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:59.642460 29789 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.642724 29715 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:11:59.644361 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:59.642088   435 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.598174   711 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:11:59.650408 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:59.657648 30348 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
W20260709 13:11:59.665512 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 144887us
I20260709 13:11:59.639652   732 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.574158   789 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.646198   799 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.648568   781 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.647684   435 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.668004   509 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.677997   642 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.689337 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 257304us
I20260709 13:11:59.685753   810 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.700314   797 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:59.701603   811 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:59.702033   708 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.704095   708 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.704722   788 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.696882 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:11:59.709363   683 consensus_meta.cc:287] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.000s
I20260709 13:11:59.672082   611 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.690771   686 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:59.697153 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.699713   810 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.683898   799 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:59.715132 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:59.684216   732 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:11:59.736545 29816 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.715987   611 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.715468   435 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.713966   803 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.716446   807 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.698856   642 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:11:59.709890   683 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.688509   781 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.693140   711 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:59.737100 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 70454.6us
I20260709 13:11:59.863874 29665 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:11:59.790944 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.801194 29816 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:59.723335 29820 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:11:59.884979 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:11:59.869815 29714 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:11:59.886320 29823 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.887688 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:11:59.895226 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.896497 29672 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:11:59.899065 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:11:59.899674 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.900098 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:59.900089 29819 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:11:59.901015 30315 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:59.901321 30341 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
W20260709 13:11:59.742120 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 178967us
I20260709 13:11:59.903175 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:11:59.904769 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:11:59.905689 30348 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.906976 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:11:59.908218 29819 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:11:59.908716 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:59.910897 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.911005 30315 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:11:59.911985 29672 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:11:59.912413 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.916347 29666 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:59.922456 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:11:59.923341 29666 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:59.923033 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:11:59.931157 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:59.766269   686 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.939627   519 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.940040   794 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:59.835599   795 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.940492   686 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.943308   800 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:59.944309   795 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.944128   800 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.833283   781 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.946280   792 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:59.946457   509 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.946766   792 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:59.834486   642 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.948020   816 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:59.941021   794 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.813499   814 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.950173   801 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:11:59.950325   509 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.939630   732 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:11:59.938997   625 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.959434   625 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.960479   814 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.834957   683 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.836270   810 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.939204   611 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:59.822587   701 consensus_queue.cc:1175] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "389c080a49494f8fb56c53fa7e6087f3" responder_term: 7 status { last_received { term: 7 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 7 index: 9 } }
I20260709 13:11:59.822384   711 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.963918   814 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:59.965279 30344 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:11:59.833686   799 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.966878   625 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:59.968987   799 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.816476   802 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.969034 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.949536   686 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:59.812597   803 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.972147 30342 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:59.973063   683 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.819746   788 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.973683   683 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.939249   619 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.942446   815 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:59.739014   475 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.816237   807 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.981842   732 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.984470   475 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.952620   519 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.947216   792 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.829691   789 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.951433   602 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:59.963227   611 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.823500   606 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.995136   606 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.982688   816 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:11:59.997673   519 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:11:59.997478   816 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:11:59.983529 29745 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:11:59.998697   684 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:59.999806 29745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48026 (request call id 2639) took 1273 ms. Trace:
I20260709 13:12:00.000298 29745 rpcz_store.cc:276] 0709 13:11:58.726575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.726720 (+   145us) service_pool.cc:224] Handling call
0709 13:11:59.600011 (+873291us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:11:59.999465 (+399454us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400362ed4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:11:59.999642 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886647296}
I20260709 13:11:59.973785   803 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.988302 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:11:59.959332 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:00.002305   692 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.002714 29820 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.003861   509 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:11:59.982504   810 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:00.006268   810 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.006909   810 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:59.982165   801 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:11:59.980705   619 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:11:59.990104 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 54314.9us
I20260709 13:12:00.006242 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.011547 29669 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:11:59.970834   802 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.014328 29666 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:00.014941   826 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.015703   611 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.982353   815 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.016825   815 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:59.957104   795 raft_consensus.cc:2804] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:00.020349 30348 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:11:59.984849   807 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:11:59.984920   489 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.027439 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:00.028328 29819 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.028447   738 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:00.029439 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.032006 30316 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.032610 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:00.035665 29823 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:00.033675 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.039280   602 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:00.042732 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 399971us
I20260709 13:12:00.043891 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.046872 29665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57422 (request call id 963) took 1181 ms. Trace:
I20260709 13:12:00.047389 29665 rpcz_store.cc:276] 0709 13:11:58.865307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.865461 (+   154us) service_pool.cc:224] Handling call
0709 13:12:00.046573 (+1181112us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b5400182754. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:00.046780 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2224444160}
I20260709 13:12:00.056968 29816 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:00.059712 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.060863   640 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.061746   611 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:00.062260 30315 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:00.062836   743 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.063902   611 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:00.064929   733 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.061772   640 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.065718 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.066741 30343 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:00.068076   640 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.070902   800 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.071388   801 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.070611   611 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.072250   738 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.069790   732 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.065834   733 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.075860 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:00.078640   683 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.079324 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.131948 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.080245 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.080817   602 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.054538   794 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.090714   770 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:00.091303   814 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.057962   795 raft_consensus.cc:697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:00.018487   826 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:00.088970 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 57151.4us
I20260709 13:12:00.094404 29667 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:00.098155   558 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.099960 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.105393 29819 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:00.122622 29820 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:00.172087 30315 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:00.098323   489 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.152706   814 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.188628 29666 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:00.146021 29816 raft_consensus.cc:2410] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:12:00.190207 29816 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:00.132102 29814 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:00.107714 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.105000 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.191290 29742 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
W20260709 13:12:00.152474 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 76829.7us
I20260709 13:12:00.106314   665 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:00.192929 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 88198.3us
I20260709 13:12:00.192970   665 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.193358   509 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:00.193455   800 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.193667   801 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.193982   509 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.194582   509 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.194279   800 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.194872 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.194321   801 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.197299 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.197340 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.198426 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.198606 29740 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:00.198838 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.199538 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.200333 29740 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 10: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.200870 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.188838   814 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.201644 29746 raft_consensus.cc:3060] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.191351   826 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.169889   815 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.204457   815 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.114200 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.205830 29743 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.206460 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.207120 29744 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.210585 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.211352 29748 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
W20260709 13:12:00.212752 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 139290us
I20260709 13:12:00.212893   800 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:00.100162 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 45007.1us
W20260709 13:12:00.194095 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48826.1us
I20260709 13:12:00.214394 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.227133 29746 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
W20260709 13:12:00.230008 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 58008.7us
I20260709 13:12:00.117933   792 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.230917 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:00.232860 30348 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:12:00.218816   794 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.237574 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.218464   801 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.244418 29742 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:00.248206   457 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:00.248510   711 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:00.249334   711 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.252439   711 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.253602 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.225852   770 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:00.256929 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.258683 29747 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:00.261817 29748 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:00.263073   463 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.263278 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.245875   816 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.269479   803 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.270802 29740 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:00.270792   463 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.271658   817 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.269524 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.275867 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.276386 30342 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:00.276888   826 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:12:00.286104 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.288081   602 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.289348 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.296357 29744 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:00.298130   803 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.298678 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.299700 29746 raft_consensus.cc:2393] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.300825 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.301589 29740 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:12:00.303107 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.303743 29747 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
W20260709 13:12:00.304425 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 90935us
I20260709 13:12:00.304592   583 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.305107   583 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.306375 30316 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.306561 30342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 460) took 1217 ms. Trace:
I20260709 13:12:00.307435   583 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.307196   770 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.308154   571 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.279824   733 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.307000 30342 rpcz_store.cc:276] 0709 13:11:59.089464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:59.089655 (+   191us) service_pool.cc:224] Handling call
0709 13:11:59.971118 (+881463us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b58006011d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a190aa 00007fd9e9a9b447 00007fd9e9ab3fe7 00007fd9e9ab57de 00007fd9e9ac127c 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c
0709 13:12:00.306468 (+335350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449782144}
I20260709 13:12:00.310460 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.308568   571 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.311152   571 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.311784   794 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.312218   794 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.285017   817 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.314533   817 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.300932   803 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.289021   816 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.326364   602 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.326551   665 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.327085   602 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.328346   737 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:12:00.329435   602 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.329955   619 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.334131 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.334769   792 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.334954 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:00.291231   457 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:00.335631 29668 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:00.339263 29748 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:12:00.339263 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:00.259871   489 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.342518 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.342254 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.346318   457 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.348685   509 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.350327 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:00.350592   782 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.017s	sys 0.019s
W20260709 13:12:00.351042   782 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.017s	sys 0.019s
I20260709 13:12:00.351671   782 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.351101 29814 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.360772   509 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.364729   489 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.370191   782 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.371798   800 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:00.372308   800 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:00.372673   800 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.375438 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.375774 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:00.341233   619 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.376621 30342 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:00.376472   619 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:00.390813 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:00.395742   824 log.cc:927] Time spent T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:00.320776   795 consensus_queue.cc:237] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.396931 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.417508 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.418474 29820 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:12:00.418754   801 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.426309   775 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:00.416278   817 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.427798   801 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.428486   817 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.391978   814 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.427691 29787 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.431757   814 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.434976 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.466624 30342 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:00.466833   665 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.467900 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.468523 29744 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.468721 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.469357 29746 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:00.457734 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.472750 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:00.473968 29814 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:00.435268   826 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.435518   816 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.435760   743 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.435415 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.436501   811 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:00.436571   810 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.488363 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.488813   826 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.489308   811 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.437393   732 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.489974 29748 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:00.490612 30341 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:00.490453   732 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.491067   810 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.438202   755 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.438988   602 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.441449   794 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.442087   801 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.443643 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.445008 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:00.446312 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.449452 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.451059 29787 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.454519 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:00.446321 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 128547us
I20260709 13:12:00.455137   509 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.456939 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.457856 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.466509   807 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.435832 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:00.509378 30346 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:00.460227 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.460625   463 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.468076 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.414446   782 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.487095 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.492379 29819 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:00.459549 30315 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:00.506583 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.523308 29745 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.488230   743 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.510608 30343 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:00.510902   732 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.455176   619 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.511154   606 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.511498   602 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:00.525259 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 66052us
W20260709 13:12:00.530004 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 79037us
I20260709 13:12:00.513542   811 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.467374   665 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.506549   509 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.514056 30350 raft_consensus.cc:2393] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
W20260709 13:12:00.513880 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 70426.2us
I20260709 13:12:00.494441 29749 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.513352   800 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.539117 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.525621 30348 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:00.493520   810 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.530431 29815 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:00.513149 29823 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:00.545172 29787 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:00.546792 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 100647us
W20260709 13:12:00.547022 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:00.547580 29787 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.514243   591 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.547880   800 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.548594   800 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:00.548946   800 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.549387   800 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:00.536164   817 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:00.549896   817 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.550299   817 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:00.553766   684 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:00.555299   619 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:00.548990 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.545066 30314 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:00.566757 29744 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:00.568002 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.541884   509 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.511309   755 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.579118   611 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:00.514413   807 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.584069 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.549052   826 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.564937   801 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:00.567132   811 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:00.578563 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.584709 30346 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:00.570365   802 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.580844   619 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:00.581370   591 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:00.582669   611 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.584602   738 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:00.615567 29744 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:12:00.573094   782 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:12:00.603650   811 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:00.628860 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 88045.9us
I20260709 13:12:00.610661   665 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.602630   815 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:00.576450   732 consensus_queue.cc:1059] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:12:00.581069   606 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.582760   810 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.602844   801 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:00.626176 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 44390.5us
I20260709 13:12:00.635535 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.614852   619 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:00.630352 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 82785.6us
I20260709 13:12:00.622162   611 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:00.646873 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.641357 29741 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:00.620426   826 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.653688 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.632220   811 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.657311 29744 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:00.658394   763 raft_consensus.cc:3055] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:00.662395   763 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:00.664492   737 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:00.615715   571 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.670192 30344 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:00.671008   807 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:00.672199   841 log.cc:927] Time spent T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:12:00.670921 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.675973 29569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 198) took 2543 ms. Trace:
I20260709 13:12:00.677304 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.677943 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:00.678902 29665 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:00.678004 29669 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:00.680298   754 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:00.680878   754 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.638350   519 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.682961   754 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.683387   519 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.686462 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:00.687180 29666 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.638998   816 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.689110 29818 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:00.647295   801 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:00.678824 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:00.659416 29740 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:00.690675 29674 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:12:00.690690   796 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:12:00.691807 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 51807.3us
I20260709 13:12:00.651789   619 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:00.692637 30314 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.655648   815 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:00.694463 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.695189 29748 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:00.696066 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.697110 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.697746 29748 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.659598   743 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.714293 29666 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:00.715284 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.709054 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.698163 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.718094   519 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.719833 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.723026 29789 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.725283   810 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.726198   850 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:00.727016   850 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:00.728931   829 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.458s	user 0.000s	sys 0.003s
I20260709 13:12:00.698141 29816 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:12:00.730424 29816 pending_rounds.cc:85] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 7
I20260709 13:12:00.730676 29816 pending_rounds.cc:107] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:12:00.730949 29816 raft_consensus.cc:2889] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:00.741036 29742 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:12:00.699110   591 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:00.699483   606 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.690847   816 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.744510   816 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.745499   763 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.746764   763 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:00.750691 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.699740 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.699980   602 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.701228   755 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.701656   826 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.704872   800 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.705891   794 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.706372 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.753178 29823 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:00.658730   738 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.692067   737 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:00.657311 29741 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
W20260709 13:12:00.755867 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 62205.2us
I20260709 13:12:00.760679 29745 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:00.780212 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:00.783752 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 947) took 2859 ms. Trace:
I20260709 13:12:00.785612 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.786311 29665 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:00.785317 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.782853   782 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:00.792317 29668 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 2.
I20260709 13:12:00.784200 29667 rpcz_store.cc:276] 0709 13:11:57.918919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:57.943498 (+ 24579us) service_pool.cc:224] Handling call
0709 13:11:57.943812 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:00.163772 (+2219960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:00.775902 (+612130us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b54002a99d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:00.778106 (+  2204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4944589568}
I20260709 13:12:00.808048 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.808384 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.812523 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.813210 30346 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:00.813144 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:00.814805 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.785416   850 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:00.817231 29787 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:00.818156 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.822124 30316 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.819583 30350 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:00.819687 29638 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:00.793262   794 raft_consensus.cc:2764] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:00.833683 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:00.782115   509 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.836440 29671 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:00.842188 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.850309 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.836690   733 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:12:00.851200 29741 raft_consensus.cc:2410] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:12:00.851511 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.852232 29749 raft_consensus.cc:2393] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.850524 30343 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:00.854782   509 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.855810   509 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:00.857012 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:00.859048 29819 raft_consensus.cc:1240] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
W20260709 13:12:00.859356 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 50333.9us
I20260709 13:12:00.676378 29569 rpcz_store.cc:276] 0709 13:11:58.132753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.132884 (+   131us) service_pool.cc:224] Handling call
0709 13:12:00.675763 (+2542879us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:58.514685 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:58.515243 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:58.515280 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:11:58.515297 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:58.515925 (+   628us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:58.516002 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:58.516028 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:11:58.516515 (+   487us) tablet.cc:701] Row locks acquired
0709 13:11:58.516529 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:11:58.516680 (+   151us) write_op.cc:270] Start()
0709 13:11:58.516789 (+   109us) write_op.cc:276] Timestamp: P: 1783602718516628 usec, L: 0
0709 13:11:58.516805 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:11:58.517492 (+   687us) log.cc:844] Serialized 2069 byte log entry
0709 13:11:59.067127 (+549635us) op_driver.cc:464] REPLICATION: finished
0709 13:11:59.418266 (+351139us) write_op.cc:301] APPLY: starting
0709 13:11:59.421295 (+  3029us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:59.463014 (+ 41719us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:59.524263 (+ 61249us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:59.591944 (+ 67681us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:59.639580 (+ 47636us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:11:59.646006 (+  6426us) write_op.cc:312] APPLY: finished
0709 13:11:59.679451 (+ 33445us) log.cc:844] Serialized 47 byte log entry
0709 13:11:59.686156 (+  6705us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:59.692134 (+  5978us) write_op.cc:454] Released schema lock
0709 13:11:59.693329 (+  1195us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:59.741901 (+ 48572us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:59.745256 (+  3355us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":50849,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":301198,"apply.run_cpu_time_us":4181,"apply.run_wall_time_us":348973,"num_ops":5,"prepare.queue_time_us":164632,"prepare.run_cpu_time_us":3110,"prepare.run_wall_time_us":3110,"replication_time_us":532480,"thread_start_us":302726,"threads_started":2}]]}
I20260709 13:12:00.861008 29666 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:00.784823   737 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.862120   826 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.863077   737 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.863632   737 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:00.864019   737 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:00.866077   737 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.867987   737 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.868656 29570 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:00.871002 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 104431us
I20260709 13:12:00.852160 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.874363 29741 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.873050 30316 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.847976   755 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:00.890908   600 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:00.848682   591 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.888543 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.823036   782 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.899884 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.896112 29671 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:00.839686   817 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.905239 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.826001   850 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.874526 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.887471   754 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:00.919296 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 44851.5us
W20260709 13:12:00.922578 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 102957us
I20260709 13:12:00.923398 29638 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.918603 29570 catalog_manager.cc:5697] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 7 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:00.925869 29638 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.898010   591 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.929387 30314 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:00.932717 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:00.879280   770 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:12:00.886821   811 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.934197   591 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.918561   802 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:00.943928 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.907763   600 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:00.950685 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.925755   810 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:00.909119   738 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:00.920763   755 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:12:00.891333 29558 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 389c080a49494f8fb56c53fa7e6087f3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:00.949175   619 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.953220 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.936836   684 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.949589 29570 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.969642   611 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.970474 30347 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:00.970069 29570 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 5 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:00.970939   684 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.971382   684 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:00.971940   611 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.972658 29746 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:12:00.973460 29558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 82355.5us
I20260709 13:12:00.921725   754 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:00.974109   816 raft_consensus.cc:2764] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:12:00.974612 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.976017 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.976166 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.976348   782 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:00.976977 30343 raft_consensus.cc:2368] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:12:00.979466   801 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.981292 29822 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 11: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:00.982074 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.981410 29742 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:12:00.988572 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 171408us
I20260709 13:12:00.989373 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.990168   782 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:00.990698   782 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:00.990607   600 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.959554   800 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:00.992367   845 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:12:00.957188 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:00.927482   665 raft_consensus.cc:3055] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:00.992933   665 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:00.993822   665 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:00.962312 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:00.995242 29745 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.962349 29638 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.965365 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:00.958555 29640 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.996124 29638 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:00.938719   457 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:00.939868   814 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:00.991873   782 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:00.996403 29714 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:01.006126 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:01.006285 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 187680us
I20260709 13:12:01.007090 29640 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:00.956979   791 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:00.997718 29747 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:00.998631 29741 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:00.990427   567 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:00.998867 30314 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:01.001891 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:00.994351   619 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:00.964350   810 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.020382 29714 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:00.997061 30348 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:01.006801 29821 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:01.013437 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.016505 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:00.974145   754 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:01.025094   846 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:12:01.026310   811 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.007726   684 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.030638   684 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:01.031011   859 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:01.031942   850 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:01.032375   638 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:01.032806   638 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.033156   638 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.033066 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.034215 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.034403 29789 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:01.034668 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.035243 29814 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:01.035377 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.018937   791 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.036115 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.036255 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.035769 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.037024 29814 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:01.036134 29820 raft_consensus.cc:2393] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:01.038034 29821 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:01.038385 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.039346 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.039937 29742 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.040433   791 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:01.042141 29823 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:01.018350 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.044559 29671 raft_consensus.cc:2410] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:01.014158 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.003072   738 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:01.035290   854 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:01.046119   738 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.046674   738 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.047184 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:01.048870 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:01.049679   619 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:01.050112   619 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.050451   619 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.051358 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.051548 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.052013 29673 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 4.
I20260709 13:12:01.054859   743 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:01.055426   743 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:01.056033   807 raft_consensus.cc:2764] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:12:01.056798   863 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.103s	user 0.001s	sys 0.001s
I20260709 13:12:01.056433   743 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.057088   855 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.058101   801 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:01.058555   861 log.cc:927] Time spent T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:12:01.059579   817 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:01.062229   854 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:01.063176   854 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.039366   810 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.067732 29817 raft_consensus.cc:2393] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 5: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:01.024220 29787 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:01.015723 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.038479   711 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:01.069450 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 62454.3us
I20260709 13:12:01.051995 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:01.072506 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 73753.8us
I20260709 13:12:01.072674 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:01.073771 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 49635.4us
I20260709 13:12:01.120817 30348 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:12:01.074185 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 78152us
I20260709 13:12:01.017267   567 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.078145   801 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:01.073838   463 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:01.080844   850 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:01.046101   864 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:01.087935 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:01.088773 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.023216   814 raft_consensus.cc:697] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:01.094751 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.094791 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.095929 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.097239 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.097810 29673 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:01.099684 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.140802 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.141396 29670 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:01.100318   435 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:12:01.101356 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.144021 30349 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.103938   754 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.104899   708 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:01.146178   708 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.147310   754 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:01.148360   708 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:01.105500   815 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:12:01.107937 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.110373   571 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:01.111618 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.149828 29669 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.113125 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:01.150738 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:01.120678 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 48075.5us
I20260709 13:12:01.126046 29640 leader_election.cc:400] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:12:01.153419 29640 leader_election.cc:403] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:01.151262 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:01.125511   567 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.152999 29714 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:01.125061   811 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:01.161128 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.164536 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:01.168586 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 56788.1us
I20260709 13:12:01.124991   583 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:12:01.155224   815 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:01.179055 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.154706 30341 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.174247 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.155217   463 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:01.153367   850 raft_consensus.cc:697] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:01.180291 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.093770   755 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.182624 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.178828 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:01.159474   811 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.162709   519 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:01.166704   763 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:01.191756 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:01.193897 29822 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 11: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:01.150050   801 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.203647 29744 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:12:01.200225 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.169061   855 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:01.181011   815 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.216832   815 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:01.181948   787 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:01.156535   602 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:12:01.207361 29667 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:01.211318 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.212164 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:01.212360 29668 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:12:01.166472   611 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:12:01.233314 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.214469   850 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.175614   711 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:12:01.225149 30349 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:01.231581 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:01.232790 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.200503   519 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.191773   811 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.233979 29672 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:01.155844   864 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.209331   855 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:01.271840 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.249212 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.274906 29744 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.239859 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:01.280650 30342 raft_consensus.cc:2393] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:01.281015   638 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.283995 29668 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:01.285565 29665 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:01.290241 29742 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:12:01.290846   463 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.293897   619 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.279228   855 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.295840   856 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:01.296554 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:01.297123 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:01.297910 29814 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:01.297050 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.309883 29820 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:01.310804 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.306238 29821 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.314237 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.234390   737 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:01.321421 29817 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:01.302412   519 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:01.325734 29819 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:01.230964   591 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.324229   737 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.238384   763 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:12:01.311856   509 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:01.335677 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.345203 29668 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:01.339363 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.340906 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.341638 30315 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.318602   754 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.348425 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:01.349385 30342 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:01.342875 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.350746 29672 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:01.351723 30341 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:01.354825 30347 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:12:01.355597 30350 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:01.350605   638 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.358393 29822 raft_consensus.cc:1240] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:01.358753 30346 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:12:01.348227 30344 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:01.366364 29668 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:01.237262   814 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.377457 29669 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:12:01.378427 29818 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:01.381959   602 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:01.386480 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.387128 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:01.388499 30346 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:01.388953 30316 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:01.389420 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:12:01.390347 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 49514.8us
I20260709 13:12:01.391306 29715 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.394268 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.321069   708 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:12:01.446938 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 52729.7us
I20260709 13:12:01.447960 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:01.405645 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.485414 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.485710   826 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:01.381636 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.486922 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.487735 30342 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:01.384428   435 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:12:01.492170   738 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.495355   619 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:01.495256   738 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.496702   792 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:01.497181   782 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:01.498690   815 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.407385   816 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.331135   856 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.508654   815 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.509066   856 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.406490   733 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:01.516214   733 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:01.517035   733 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.518368   733 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:01.520691 29744 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:01.521808 29787 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:01.522007 30314 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:01.523125 29787 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:01.524127 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:01.524281   619 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:01.524717   619 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:01.525091   619 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:01.527972 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.528666 29740 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.533705   619 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.534838 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.535513 29741 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.543059 29741 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:01.544166 29821 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:12:01.496544 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.546213 29740 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
W20260709 13:12:01.548147 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 100272us
I20260709 13:12:01.549082 29715 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.549834 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.376915   864 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:01.555321 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.557346 29742 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:01.563474 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.564834 29742 raft_consensus.cc:2368] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:12:01.559754 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.566198 29787 leader_election.cc:400] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:12:01.566573 29787 leader_election.cc:403] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:01.566606 29821 raft_consensus.cc:2368] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:12:01.571100 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:01.572815 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:01.565186 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.576191 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.576792 29674 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.577509 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:01.578177 29742 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.581276 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.408216   509 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:01.581276 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:01.586536 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:01.587513 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.588443 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:01.591089 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.591923 29668 raft_consensus.cc:2393] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:01.585260 29639 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:01.546068   619 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:01.611380 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:01.545970   792 raft_consensus.cc:697] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:01.551497   815 raft_consensus.cc:2764] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:12:01.613165 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.563668   800 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:01.621483 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.622908 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.562357   457 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:01.638954 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.589048   708 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:01.581719   611 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.648099 29742 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:01.554297   810 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.648942 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.655917 29672 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:01.657042 29741 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:01.578622   864 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:12:01.674041   864 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:01.674600   864 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.677636   708 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:01.678706   708 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.625294   509 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:01.581521   567 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.682135   801 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.682752   509 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.683817   567 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:01.684233 29820 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:12:01.685400 29669 raft_consensus.cc:2393] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:01.634887   606 raft_consensus.cc:2764] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:12:01.687440   810 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.625160   856 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.623610   770 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:01.638492 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.657192   800 raft_consensus.cc:697] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:01.697703   800 consensus_queue.cc:237] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.699867 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.640544   457 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:01.701122 29667 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:01.654739   619 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.676589   864 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.704804 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:01.708063 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 86667.6us
I20260709 13:12:01.712604 29672 raft_consensus.cc:2368] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:12:01.713161 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:01.706372   457 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.700630 30342 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:01.712253 29715 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.718793   782 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:01.717126 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.733582 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.655370   855 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.725188 29674 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:01.713969   815 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.736657 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.747658 29672 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:01.734988 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 168927us
I20260709 13:12:01.741346 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:01.743003 29715 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.772619 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.716981   811 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.755983   816 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:01.776306 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 205277us
I20260709 13:12:01.778674 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:01.778741 29715 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.790488 29715 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.791610 29715 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:01.795495 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:01.796904 29668 raft_consensus.cc:2368] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:12:01.776772   611 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:01.731208   792 consensus_queue.cc:237] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.783177   810 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.791008   755 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:01.803161 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:01.811731 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:01.831477 30344 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:01.799139   606 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:01.828132 29672 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:01.828635 29667 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:12:01.792650   826 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.818393 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:01.800331 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:12:01.844367 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44127.8us
I20260709 13:12:01.845595 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.837679   606 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:01.859179 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.860615 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.883949 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.885413 29789 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.861455   606 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:01.846143   602 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.896806 29714 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.847903   889 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:01.889644 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:01.910022   880 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:01.921170 29789 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:01.898685   879 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:12:01.911789   519 consensus_meta.cc:287] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.005s
I20260709 13:12:01.920956   891 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:01.886678   856 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.887249   885 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:01.910640   878 log.cc:927] Time spent T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:01.894164   850 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.909349   864 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:01.881484   884 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:01.925876 29789 leader_election.cc:400] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:12:01.921290   611 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:01.931806 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:01.932832 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 141290us
I20260709 13:12:01.923177   802 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:01.935771 29715 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:01.950608 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:01.951732 29815 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:01.935463   855 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:01.955765 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.974629 30341 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:01.956969 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.958597   815 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:01.958788 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:01.978943 30315 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.979228 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:01.955776 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:01.959707 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:01.955590   811 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:01.950452   611 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:01.966113   816 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:01.966480 30346 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:01.967368   619 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:12:01.968384   770 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:01.971201   877 log.cc:927] Time spent T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
I20260709 13:12:01.927654   519 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:01.949806   810 raft_consensus.cc:2764] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:12:01.982326 29558 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 389c080a49494f8fb56c53fa7e6087f3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:01.963076   606 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:01.949841   826 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:12:02.043684 29558 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 61420.9us
I20260709 13:12:02.043900 29822 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:01.985205   755 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.006975   800 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:01.985066   583 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:12:01.985380   802 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:02.042301   770 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.050791 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:12:02.045763   896 log.cc:927] Time spent T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:12:02.044312   811 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:02.059796 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 75212.4us
I20260709 13:12:01.986508   815 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.048872   509 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:02.041826   791 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:12:02.054527   802 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:02.054507   755 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:12:02.065274   870 log.cc:927] Time spent T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.791s	user 0.005s	sys 0.000s
W20260709 13:12:02.065411   887 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:12:02.083971   611 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.085124 30342 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:02.072543   802 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.058117   788 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:02.090916 29815 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:02.072110   737 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.097826   519 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.098754   755 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.104130   665 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:02.105037 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:02.105708 30342 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.105993   815 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.061753   811 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.125692 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:02.130256   800 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.130280 30341 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:02.131047   800 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.132622 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:02.133263   800 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:02.064265   509 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.141296 29817 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
W20260709 13:12:02.135004 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 549818us
I20260709 13:12:02.131153 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 992) took 1024 ms. Trace:
W20260709 13:12:02.170640 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 374346us
I20260709 13:12:02.171459 29638 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:02.172257 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2213) took 1684 ms. Trace:
I20260709 13:12:02.151744   733 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:02.150682   904 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:02.172709 29748 rpcz_store.cc:276] 0709 13:12:00.485576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.716360 (+230784us) service_pool.cc:224] Handling call
0709 13:12:00.716756 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:00.717541 (+   785us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:00.717573 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.109679 (+392106us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b2c0001c328. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e83b6a11 00007fd9e83c6372 00007fd9e9af8a01 00007fd9e9abd43a 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2
0709 13:12:01.110230 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.152449 (+ 42219us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:01.152489 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:01.152551 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.007193 (+854642us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:12:02.169976 (+162783us) raft_consensus.cc:1685] finished
0709 13:12:02.169996 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.170137 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":143,"spinlock_wait_cycles":102467200,"thread_start_us":41761,"threads_started":1,"wal-append.queue_time_us":77996}
I20260709 13:12:02.175653   751 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.175017 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:02.190235 29638 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:02.186422   904 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:02.178911   684 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:12:02.188717   751 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.188293 30342 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:02.200215 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:02.193681   738 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:02.187906   733 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:12:02.213394   904 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.218418   591 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:02.220271   751 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.221240 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:02.221513   509 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.221833   619 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.222190   800 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.222527   619 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.222906   800 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.224807   619 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:02.222957   815 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.225646   815 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:02.225046   800 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.222568   826 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 13:12:02.230011   901 log.cc:927] Time spent T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:12:02.230279   770 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.231048   811 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.233278   770 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.236421   802 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:02.240160   890 log.cc:927] Time spent T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.287s	user 0.003s	sys 0.000s
I20260709 13:12:02.242301   815 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:02.259207   457 consensus_meta.cc:287] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 13:12:02.259785   457 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.260993 30345 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:02.263213 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:02.265856 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:02.266484 29817 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.266765 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:02.222072   864 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.267699 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:02.268400 30349 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:02.265201   856 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.272018   856 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.281968   457 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.274366   864 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.283015   856 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:02.278177 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:02.283075   802 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.285866   864 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:02.289017   864 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.289577   864 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.290686   811 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:02.146318 29670 rpcz_store.cc:276] 0709 13:12:01.106735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:01.142005 (+ 35270us) service_pool.cc:224] Handling call
0709 13:12:01.142351 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:01.154039 (+ 11688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:01.154070 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:01.173860 (+ 19790us) log.cc:844] Serialized 26 byte log entry
0709 13:12:01.539692 (+365832us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:01.576981 (+ 37289us) log.cc:844] Serialized 14 byte log entry
0709 13:12:02.130602 (+553621us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b180040de00. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e694ac0a 00007fd9f008a219 00007fd9e69d2a40 00007fd9e69cd4e4 00007fd9e69cd455 00007fd9e9ab5060 00007fd9e9ac7716 00007fd9e9ad8287 00007fd9e9ad8208
0709 13:12:02.130783 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.130864 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:02.130902 (+    38us) raft_consensus.cc:1685] finished
0709 13:12:02.130983 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:02.131098 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28123,"prepare.queue_time_us":42164,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":576671,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":10057,"spinlock_wait_cycles":15141632,"thread_start_us":325482,"threads_started":1,"wal-append.queue_time_us":480276}
I20260709 13:12:02.294992   864 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:02.303404 29715 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:02.307997   815 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:02.309648   815 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:02.310623   815 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.311328 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:02.311911 29822 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.314296 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:02.315117 29815 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 10: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:02.317368 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:02.320363 29815 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.334491 29817 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:02.348030   606 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.351255   611 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.355096   611 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:02.360705 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 158848us
I20260709 13:12:02.360819   567 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:02.362663   787 consensus_queue.cc:1059] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:12:02.363322   912 consensus_queue.cc:1059] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:12:02.361908 29639 leader_election.cc:400] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4.
I20260709 13:12:02.371510 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:02.371793 29639 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:02.372270 29821 raft_consensus.cc:2393] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:02.375854 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:02.376714 29668 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:02.365005 29715 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:02.385264   606 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:02.394539 30345 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:02.404738 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:02.405411 29821 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:02.406466   606 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:02.406867 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:02.407656   755 raft_consensus.cc:3055] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.408017   743 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:02.408473   743 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.408849   743 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.410102   463 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:02.410509   463 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:02.411265   463 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.411705 29822 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:02.412503   463 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:02.408025   755 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:02.414915   755 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.416064   755 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.417908 30315 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:02.418764   795 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:02.419430   795 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:02.420337   795 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.427006 29815 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:02.434267   611 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.441792 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:02.442396   811 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.442925   811 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.443895   802 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:02.443120 29787 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:02.448596   602 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.449155   602 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.449487   897 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.450033   897 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.445910 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:02.455165 29748 raft_consensus.cc:1275] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:02.456769 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:02.451328   602 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.456763 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:02.460572 29746 raft_consensus.cc:2393] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:02.462244 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:02.465431 29747 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:02.464953 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:02.452001   864 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:02.454046   611 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.451661   519 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.474789   519 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.474895   743 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.476954   519 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.456496   885 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:02.472587 29746 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:02.472571   897 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.470573   814 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.477680   885 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:02.478118   814 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.471531   811 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:02.459491   795 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:12:02.478735 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.480773 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:02.481019 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:02.481583 29821 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:02.477277 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:02.488978 29816 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:12:02.488662 29815 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:02.476989   743 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.495982 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:02.499603 29746 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:12:02.482622   591 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:02.500748   591 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.503125   591 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:02.508692 29821 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
W20260709 13:12:02.512521 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 322358us
I20260709 13:12:02.478632   885 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.515719   911 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:02.516307   911 raft_consensus.cc:697] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:02.518533 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:02.519804 29789 leader_election.cc:400] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7.
I20260709 13:12:02.521232 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 341) took 3603 ms. Trace:
I20260709 13:12:02.521987   738 raft_consensus.cc:697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:02.522642 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:02.523264 29749 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:02.522957   738 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.523866 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:02.525004 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:02.525547 29747 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:02.526402 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:02.527386 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:02.528008 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:02.533015   787 raft_consensus.cc:3055] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:02.533691   787 raft_consensus.cc:740] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:02.534698   912 raft_consensus.cc:3055] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:02.535272   912 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:12:02.535917 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 164204us
I20260709 13:12:02.538904 29640 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:02.517203   911 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:02.550179 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:02.484484   611 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.545341   864 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:02.552680   910 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:02.536178   912 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.521677 29570 rpcz_store.cc:276] 0709 13:11:58.917359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:58.917515 (+   156us) service_pool.cc:224] Handling call
0709 13:12:02.521169 (+3603654us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:01.299037 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:01.320074 (+ 21037us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:01.332526 (+ 12452us) write_op.cc:435] Acquired schema lock
0709 13:12:01.337552 (+  5026us) tablet.cc:662] Decoding operations
0709 13:12:01.617906 (+280354us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:01.618026 (+   120us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:01.618061 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:12:01.618619 (+   558us) tablet.cc:701] Row locks acquired
0709 13:12:01.618670 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:12:01.618891 (+   221us) write_op.cc:270] Start()
0709 13:12:01.619057 (+   166us) write_op.cc:276] Timestamp: P: 1783602721618813 usec, L: 0
0709 13:12:01.619091 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:12:01.619847 (+   756us) log.cc:844] Serialized 1701 byte log entry
0709 13:12:02.231670 (+611823us) op_driver.cc:464] REPLICATION: finished
0709 13:12:02.300182 (+ 68512us) write_op.cc:301] APPLY: starting
0709 13:12:02.300283 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:02.300466 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:02.300593 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:02.301234 (+   641us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:02.301544 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:12:02.301605 (+    61us) write_op.cc:312] APPLY: finished
0709 13:12:02.302236 (+   631us) log.cc:844] Serialized 41 byte log entry
0709 13:12:02.303123 (+   887us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:02.303221 (+    98us) write_op.cc:454] Released schema lock
0709 13:12:02.303279 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:02.316137 (+ 12858us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:02.316174 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":68216,"apply.run_cpu_time_us":2590,"apply.run_wall_time_us":3510,"num_ops":4,"prepare.queue_time_us":324991,"prepare.run_cpu_time_us":18700,"prepare.run_wall_time_us":554296,"raft.queue_time_us":105935,"raft.run_cpu_time_us":2771,"raft.run_wall_time_us":124032,"replication_time_us":578521,"thread_start_us":545079,"threads_started":4,"wal-append.queue_time_us":303210}]]}
I20260709 13:12:02.563421 29666 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:02.566802 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:02.567713 29668 raft_consensus.cc:2410] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:02.568706 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:02.574304 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:02.575098 29666 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:02.577179 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:02.579211 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:02.579954 29666 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:02.581614 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:02.592917 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:02.593704 29742 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:02.597656 29668 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:02.612519 29639 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:02.639047   567 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:02.646548 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 49235.9us
I20260709 13:12:02.656114 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:02.658960 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:02.659687 29668 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:02.792990 29668 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:02.974666 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:02.982417   567 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:02.983069   567 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.984074 29668 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:02.985224   567 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:02.986012 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:02.993754 29669 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:02.997313 29669 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:12:02.997782 29669 pending_rounds.cc:85] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 3
I20260709 13:12:02.998133 29669 pending_rounds.cc:107] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:12:02.998432 29669 raft_consensus.cc:2889] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:03.001020 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.002445 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:03.004791   937 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.397s	user 0.004s	sys 0.000s
I20260709 13:12:02.657732   940 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:03.071065 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.157912   743 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.158619   743 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.160821   743 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.162129   743 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.186771   941 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.317595   755 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.349907   743 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.352362   743 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.353099   755 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.356135   755 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.373392   558 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.374087   558 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.376386   558 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.385285   737 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.385946   737 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.388240   737 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.430749   743 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.431571   743 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.434037   743 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:03.434710   743 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.435323   743 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.436904   665 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.440743   665 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.443122   665 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:03.576071 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3bc0 after lost signal to thread 28568
W20260709 13:12:03.623813 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6de0 after lost signal to thread 29606
I20260709 13:12:03.613013   755 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.634444 29743 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.021s	sys 0.014s
W20260709 13:12:03.642088 29743 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.021s	sys 0.015s
W20260709 13:12:03.679076 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:03.641080   940 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.624027   665 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.705504   940 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.349932   941 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.700030   737 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:03.710237 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 2673) took 1185 ms. Trace:
I20260709 13:12:03.704113   755 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.707923   665 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.717833   940 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.712491   737 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:03.711654 29743 rpcz_store.cc:276] 0709 13:12:02.520265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.526281 (+  6016us) service_pool.cc:224] Handling call
0709 13:12:02.526593 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.526968 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:02.526996 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.527436 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.620764 (+ 93328us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b48000b2758. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ee9e6aa1 00007fd9ee9ddb37 00007fd9ee9dd9ca 00007fd9eead526f 00007fd9eead4f37 00007fd9eeae955c 00007fd9eeae9508 00007fd9eeae9488 00007fd9eeae9443 00007fd9eeae86ec 00007fd9eda12a96
0709 13:12:03.642604 (+1021840us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:03.642648 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.642721 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.642773 (+    52us) raft_consensus.cc:1685] finished
0709 13:12:03.642784 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.705356 (+ 62572us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18312,"raft.run_cpu_time_us":2595,"raft.run_wall_time_us":72299,"spinlock_wait_cycles":6270336,"thread_start_us":1114811,"threads_started":1,"wal-append.queue_time_us":77164,"wal-append.run_cpu_time_us":2084,"wal-append.run_wall_time_us":1035890}
I20260709 13:12:03.722602   665 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.714628   743 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:03.731272 29745 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:03.739598 29745 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 2676) took 1216 ms. Trace:
I20260709 13:12:03.739969 29745 rpcz_store.cc:276] 0709 13:12:02.523194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.526198 (+  3004us) service_pool.cc:224] Handling call
0709 13:12:03.730755 (+1204557us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:12:03.730950 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.739297 (+  8347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.739537 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4322560}
I20260709 13:12:03.723577   737 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:03.726416   941 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.768714   945 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.769234   945 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.770593   755 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.754338   940 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:03.773032   940 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.771631   737 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:03.773972   910 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.214s	user 0.026s	sys 0.042s
W20260709 13:12:03.775604   910 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.026s	sys 0.042s
I20260709 13:12:03.775880   910 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:03.776755   910 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.774987   945 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.778360   945 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.781327   945 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.785547   945 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:03.786872   945 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.787431   945 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.789382   945 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:03.780647 29746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2244) took 1263 ms. Trace:
I20260709 13:12:03.806118 29666 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:03.789887   737 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.808043 29670 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:03.811766   737 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:03.804107 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.806206 29746 rpcz_store.cc:276] 0709 13:12:02.518298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.779811 (+1261513us) service_pool.cc:224] Handling call
0709 13:12:03.780128 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.780308 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.780335 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:03.780375 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:03.780406 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.780461 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.780590 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:03.802398   940 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.814141   945 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:03.814659   945 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.817986   945 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:03.823442   711 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.825268   711 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.826340 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.836576 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.836789   948 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.837352   948 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.838452 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57422 (request call id 999) took 1634 ms. Trace:
I20260709 13:12:03.827277 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.827790   600 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.838838 29667 rpcz_store.cc:276] 0709 13:12:03.807114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.837680 (+ 30566us) service_pool.cc:224] Handling call
0709 13:12:03.838000 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.838156 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:03.838176 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:03.838215 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:03.838244 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.838293 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.838401 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:03.839814   948 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:03.832485 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.839562   600 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.843343 29665 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:03.843653   600 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:03.843252 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:03.843955 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.824754 30344 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:03.837661 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.847647 29674 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:03.848024 29674 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:03.848726 29674 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.849642 29674 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:03.846314   910 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:03.851763   910 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.852212   910 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.854485 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.846585 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.858330 29714 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:03.861348 30346 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:03.862355   755 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:03.862771   755 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:03.863075   755 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:03.866111   743 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:12:03.863207 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.867345 29672 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:03.869007   910 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.870772 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.874831 29667 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:02.534780   787 consensus_queue.cc:260] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.877978   787 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:03.880823   939 consensus_queue.cc:1175] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "42c443079435463daa8845e244cec9d3" responder_term: 7 status { last_received { term: 7 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 4 } }
W20260709 13:12:03.881780 29787 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.66:46333 timed out after 1.537s (SENT) [suppressed 6 similar messages]
I20260709 13:12:03.883819 30343 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:03.884588   948 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.885185   948 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.888628 29674 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:03.892972 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.897699 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:03.898674 29746 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48026 (request call id 2683) took 1373 ms. Trace:
I20260709 13:12:03.898989 29746 rpcz_store.cc:276] 0709 13:12:03.896509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:03.897367 (+   858us) service_pool.cc:224] Handling call
0709 13:12:03.898608 (+  1241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:03.900393 29745 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:03.900534 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.901192 30344 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:03.901372   945 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.901906   945 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.904287   945 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:03.904762   945 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:03.905158   945 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:03.906395 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.905666   583 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:12:03.907051 29674 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:12:03.901847 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.911530 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.913365   945 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:03.914019 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:03.919399 29746 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:03.919899 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.920598 30348 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:03.914955 29745 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:03.915832 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:03.921984 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.922528 30348 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:03.925432 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.920250 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:03.928746 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.931160 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.934183 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.938768 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:03.939497 29670 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:03.942636 30348 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:03.945343 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:03.946666   949 log.cc:927] Time spent T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.056s	user 0.002s	sys 0.005s
I20260709 13:12:03.947419 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:03.948532 29715 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:12:03.948894 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 65597.1us
I20260709 13:12:03.952090   826 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.952669   826 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:02.521521 29748 raft_consensus.cc:1240] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:03.953773 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:03.954454 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2246) took 1435 ms. Trace:
I20260709 13:12:03.954790 29748 rpcz_store.cc:276] 0709 13:12:02.519039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.520984 (+  1945us) service_pool.cc:224] Handling call
0709 13:12:02.521323 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.954204 (+1432881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:03.954390 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:03.956704   665 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.957268   665 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.941644   945 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:03.958698   945 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:03.962652 30342 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:03.965965 30349 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:03.967803   807 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:03.968245   807 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:03.968628   807 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:03.976001 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 1058) took 1667 ms. Trace:
I20260709 13:12:03.976459 29819 rpcz_store.cc:276] 0709 13:12:02.306919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.309305 (+  2386us) service_pool.cc:224] Handling call
0709 13:12:02.309655 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:02.310086 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:02.310114 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:02.310580 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:12:02.497577 (+186997us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:02.497617 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:02.497681 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:03.973901 (+1476220us) raft_consensus.cc:1685] finished
0709 13:12:03.973943 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:03.974167 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32989,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":186183,"threads_started":1,"wal-append.queue_time_us":247481,"wal-append.run_cpu_time_us":1737,"wal-append.run_wall_time_us":1052174}
W20260709 13:12:03.977949   885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.461s	user 0.011s	sys 0.025s
I20260709 13:12:03.989650 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:03.991077 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
W20260709 13:12:03.996701 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.002000 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.004195 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.006692 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.001325   583 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:04.009543 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:04.003319   885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.486s	user 0.014s	sys 0.025s
I20260709 13:12:04.014338 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.013743   826 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.017026   956 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.017508   826 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.018064   711 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:04.018167   826 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:02.537876   435 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.008471   737 consensus_queue.cc:1059] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:12:04.023000   737 raft_consensus.cc:3055] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:04.023396   737 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:04.024181   737 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.025317   737 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.012270 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.036626   945 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:04.037233   945 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:12:04.039575 29749 consensus_meta.cc:287] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 1.516s	user 0.008s	sys 0.025s
I20260709 13:12:04.040064 29749 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:04.040570 29749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48028 (request call id 2247) took 1521 ms. Trace:
I20260709 13:12:04.040886 29749 rpcz_store.cc:276] 0709 13:12:02.519330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.522387 (+  3057us) service_pool.cc:224] Handling call
0709 13:12:04.040513 (+1518126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:04.017542   956 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.030507   665 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.038321   885 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.044452   885 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.046290   826 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.046622   885 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.047088   665 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.047993   814 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.052466   665 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.052975 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.055594   665 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.051699   885 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.057583   885 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.016840   583 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.060423   684 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.061002   684 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.061556   885 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:04.051560 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 144842us
I20260709 13:12:04.037726   945 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:04.048223 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 57225.6us
I20260709 13:12:04.033949   755 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.086061 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.050024   826 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:04.100069   826 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:04.101051   826 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.106117 30314 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.061489   800 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:12:04.107178 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 110556us
I20260709 13:12:04.107415 30314 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:04.110163 29715 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:04.085103   665 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:04.121524 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 116243us
I20260709 13:12:04.085512   957 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:04.120990 29787 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:04.122218   788 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.120281   953 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.116832   886 consensus_queue.cc:1048] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:04.148633   953 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.135195   956 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.142757   910 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.118717   800 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.134634   665 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.116979   960 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:12:04.157545 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 101824us
I20260709 13:12:04.159885 29789 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.147011   959 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.145578   955 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:12:04.155381   886 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:04.152972   711 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:12:04.170547   970 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:04.165184 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 57899.3us
I20260709 13:12:04.156982   953 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.155092   910 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.183864   968 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:02.529322 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.184553   807 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
W20260709 13:12:04.196453 29744 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48026 (request call id 2674) took 1675 ms (client timeout 1537 ms). Trace:
W20260709 13:12:04.208132 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 95694.5us
W20260709 13:12:04.207288 29744 rpcz_store.cc:269] 0709 13:12:02.520562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.529000 (+  8438us) service_pool.cc:224] Handling call
0709 13:12:04.196363 (+1667363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:04.204072   953 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:12:04.212378 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 93821.9us
I20260709 13:12:04.214550 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.204406   958 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:04.178203   956 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:04.208036   826 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:04.210184   963 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:12:04.220309 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 49874.4us
I20260709 13:12:04.220826 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:04.226310   967 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:04.218998 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:04.227862 29668 raft_consensus.cc:2410] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:12:04.231616   967 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:04.213428   957 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:04.224835   972 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:04.216190   953 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:04.217218   684 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.219580   755 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:04.270118 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.223577   583 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:04.216264   815 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:12:04.305544   962 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:12:04.305740   807 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:12:04.246832   969 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.223555   958 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.306836   969 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.287786   960 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.249042   953 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:04.247246   945 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.296555   972 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:12:04.351145 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 124181us
I20260709 13:12:04.241993   963 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.300616   786 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.362881   971 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:04.375016   971 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:04.376864 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:04.356518 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 196713us
I20260709 13:12:04.564771 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.546339 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.545495 29744 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:12:04.553247 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 338751us
I20260709 13:12:04.545943 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.543787 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.570848 29741 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:04.571007 29749 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:04.568953 29789 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:04.574575 29789 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.575188 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.576936 29789 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:12:04.582259 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 122952us
I20260709 13:12:04.570955 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:04.580036 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.349475   960 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:04.418692   738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.870s	user 0.008s	sys 0.057s
I20260709 13:12:04.708653   982 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:04.709174   982 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.594414 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:04.670081 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 336944us
W20260709 13:12:04.378476   966 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:12:04.709241   738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.166s	user 0.020s	sys 0.068s
W20260709 13:12:04.710055 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 139162us
I20260709 13:12:04.709721   982 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:04.716857 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 140003us
I20260709 13:12:04.414215   807 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:04.414182   955 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.568346   969 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:04.719048 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.436120   967 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:04.364946   945 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.359s
I20260709 13:12:04.377774   971 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.347s
I20260709 13:12:04.739748 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.640154 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.725097   960 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.552821   910 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.664820 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.418782   826 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.641502 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.726964   963 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.722050 29789 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.738394 29571 catalog_manager.cc:5697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.716857   986 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:04.739307   959 consensus_meta.cc:287] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.000s
I20260709 13:12:04.589560   665 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.751268 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.370009   786 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:04.789004 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.790428   786 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.783874   665 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:12:04.354957   800 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.736172   955 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.749073 29571 catalog_manager.cc:5697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 7, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:04.741075 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.797065 29740 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:04.746670   815 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:04.772405   959 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.777398 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:04.734575   807 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.751035   986 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.750344   826 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:04.784188 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.752293 29743 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:04.443120   957 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.785735   611 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.459957   972 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:04.798545 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 46826us
I20260709 13:12:04.808043 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.810803 29715 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:04.812757 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.802177   800 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:04.815032   976 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:04.814071 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:12:04.819510 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 113930us
I20260709 13:12:04.823346 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.824648 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.803579   986 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:04.829520 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.746129   967 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.802313   743 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:12:04.813759   611 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:04.830730 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.831393 29638 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:04.832286 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.833003   807 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.834092   973 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:04.834156   457 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:04.834722   955 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.822381   963 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:12:04.836229   826 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.848067   940 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:04.863555   965 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.864144   965 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.828609   980 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:04.866171 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:04.866820 30343 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:04.868376   965 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.870215 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:04.870651   982 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.871685 29671 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:04.872676   982 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.874665   967 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.842998 30344 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:04.819039   959 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:04.875938   959 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:04.876343   959 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:04.827456   976 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:04.837044   665 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:04.833590   953 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.879998   986 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.880601   953 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:04.849952 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 127989us
I20260709 13:12:04.881939 29747 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:04.852743 30316 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.828305   971 consensus_queue.cc:1243] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:12:04.891618 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.858201 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.849663 29746 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:04.861259   992 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:04.896047 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:04.878217   965 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.883502 30316 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.897992 30344 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:04.901948   457 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:04.847826   945 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:04.890074   969 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:04.883659   953 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:04.896409 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:04.896724 29740 raft_consensus.cc:2410] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:12:04.897405 29695 debug-util.cc:398] Leaking SignalData structure 0x7b080013cf40 after lost signal to thread 29698
I20260709 13:12:04.861986   989 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.910959   992 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.911192   965 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:04.932367 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8c60 after lost signal to thread 29699
I20260709 13:12:04.933720 30344 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:04.910326   971 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:04.936874 29640 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:04.937158   971 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.937779   751 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:04.938232   751 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.938602   751 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:04.941015 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 59517us
I20260709 13:12:04.942617 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:04.943632 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:04.944777 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:04.914788   940 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.931792   957 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:04.931949   972 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.917399   738 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.950129   971 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:04.931993   945 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:04.954906 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.956231  1000 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:12:04.972608   971 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:04.973588   985 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.974188   985 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.976649   965 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:04.977344   965 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:04.980255 30343 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:04.953513   997 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:04.939409   733 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:12:04.939790   989 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.984138   989 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.981418   997 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.962711   738 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.986397   997 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:04.973335   941 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.988927   941 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:04.992761 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.993417 29748 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:04.995028   941 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.995076 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.997978 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:04.963231   957 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.999231 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.000309 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:05.000862 29743 raft_consensus.cc:2376] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8. Re-sending same reply.
I20260709 13:12:05.001735   738 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.976600   985 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:04.956926   972 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:04.940209   953 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.007999 29638 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:05.003906 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.003854   972 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:05.014369 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 113203us
I20260709 13:12:05.014562 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.015168 30316 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:05.015362 29743 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:04.959085   945 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:05.019281   953 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:04.993327   959 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.021405   886 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:05.023275   959 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:05.029357 29823 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:04.973325   971 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.952629   940 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.032636 29819 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:12:05.030865 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.033289 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.008653   965 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.043136 29823 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:05.043308 29821 raft_consensus.cc:2410] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:05.027573 29638 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:05.043965 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.044592 29822 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:12:05.034358 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.000355   957 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.045212 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:05.046357 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.066728   986 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.046093 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.067802 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.068152 29817 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 3.
I20260709 13:12:05.069628 29818 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:05.071878 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.073173 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.073872 29815 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:12:05.069000   992 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.035223   971 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.074481 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.034432   936 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:05.089751 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.089340 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:05.093076 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 148364us
I20260709 13:12:05.033723   953 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.096135 29815 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 12.
I20260709 13:12:05.089035   960 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.099082 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.102663 29748 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:05.099982 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.100734 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.096616 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:05.096704 29816 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:05.106693 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.106837   945 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.107998 29820 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:05.108490 29818 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 4.
I20260709 13:12:05.110620   751 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.112275   948 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:05.112920   751 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.113318   912 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.064004   985 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:05.115551 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:05.116097 30344 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.046118   965 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:05.118106 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.118813 29748 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:05.127410 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.130100 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.098634   940 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.142750 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.143695 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.152130 29668 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:05.117748   985 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.143352 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.146320 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:05.109108   953 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.154359 29671 raft_consensus.cc:2410] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:12:05.109964   936 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:05.157773 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.158037 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.158159 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:05.157795 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.160323 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.124114   965 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.153254   985 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.119210  1010 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:05.158399 29789 connection.cc:256] RPC call timeout handler was delayed by -1.2493404950000695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:12:05.164662 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.164781 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.166857 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.166549   936 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.167726 29815 raft_consensus.cc:2410] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:12:05.168607 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.169539 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.169837 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.170375 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:05.166584 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.170994 29672 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:05.175881 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.176030 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.167748   800 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:05.176748 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.170054   953 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:05.178635 29695 debug-util.cc:398] Leaking SignalData structure 0x7b080034c080 after lost signal to thread 29773
I20260709 13:12:05.175300   958 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:05.177510   800 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:05.182825   800 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.183538 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:05.184305 30350 raft_consensus.cc:2368] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:12:05.185901 30344 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:05.184026   800 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.186626 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.193077 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:05.189828 29640 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:05.187654 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:05.194952 29815 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:05.195863   945 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:05.196879 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.203560 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.205480 29742 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:12:05.206516 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.207383 29745 raft_consensus.cc:2393] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 9: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:05.208709 29745 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:12:05.191990 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.209057 29745 pending_rounds.cc:85] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 6
I20260709 13:12:05.212812 29745 pending_rounds.cc:107] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:12:05.213152 29745 raft_consensus.cc:2889] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.201762 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.213898 30347 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:05.222322   751 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:05.223044   751 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:05.224403   751 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.230511   965 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.239995   965 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:05.242604 29672 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:05.175899   971 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.249907 29670 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:12:05.255116   969 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:05.257367   399 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.257899   399 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.261300   971 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.268540 29715 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:05.268496 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 104218us
I20260709 13:12:05.270483   897 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:05.272462 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.273200 29746 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:05.274022 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.274931 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.277472 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:05.278975 29787 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:05.282795 29746 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:05.283432   945 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:05.283910   953 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:05.285211 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:05.286361 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:05.287074 29789 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:05.287886   953 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:05.279965   811 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:05.278151   965 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.288224 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:12:05.288991   911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.727s	user 0.014s	sys 0.016s
I20260709 13:12:05.290474   965 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.290374 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:05.291615   911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.730s	user 0.015s	sys 0.016s
I20260709 13:12:05.293243 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.293303 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:05.289420   811 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:05.293303   965 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.295929   811 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:05.293762   894 log.cc:927] Time spent T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 3.450s	user 0.013s	sys 0.012s
I20260709 13:12:05.287986 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:05.290618   971 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:12:05.290043 29789 leader_election.cc:400] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:12:05.303750 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.304679 29789 leader_election.cc:403] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:12:05.306774 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:05.307039 29745 raft_consensus.cc:1240] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:05.308307 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.310267 29816 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:12:05.310501 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.310751 29816 pending_rounds.cc:85] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 7
I20260709 13:12:05.311237 29816 pending_rounds.cc:107] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:12:05.311511 29816 raft_consensus.cc:2889] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:05.310289 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.314538 29815 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:05.309324   971 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:05.316653 29820 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:12:05.324121 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:05.322484 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.325089 29816 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:05.327124 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45248 (request call id 2611) took 2351 ms. Trace:
I20260709 13:12:05.327214 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.328826 29816 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:05.327857 29666 rpcz_store.cc:276] 0709 13:12:02.975814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.975929 (+   115us) service_pool.cc:224] Handling call
0709 13:12:02.976212 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:03.806764 (+830552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.326913 (+1520149us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54001a4fd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:05.327073 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908195584}
W20260709 13:12:05.406184 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.414691 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:05.488817 29787 leader_election.cc:336] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Timed out: RequestConsensusVote RPC to 127.27.229.66:46333 timed out after 1.537s (SENT)
I20260709 13:12:05.285507   985 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.500123 29745 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:05.500386 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.509793 29816 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:05.514847 29820 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:05.519398 29665 raft_consensus.cc:2393] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:05.332837 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:05.538089 29695 debug-util.cc:398] Leaking SignalData structure 0x7b0800350300 after lost signal to thread 29847
W20260709 13:12:05.538482 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6100 after lost signal to thread 29848
I20260709 13:12:05.546213 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.546517 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.546759 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.547286 29822 raft_consensus.cc:2393] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:05.547428 29818 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:05.549702 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.550318 29822 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:05.550720 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.551486 29817 raft_consensus.cc:2393] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 11: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:05.547425 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.555681 29816 raft_consensus.cc:2393] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:05.561975 29816 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:12:05.568976 29820 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:05.579804   985 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:05.580892 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:05.581532 29745 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.586386 30342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 499) took 1588 ms. Trace:
I20260709 13:12:05.586856 30342 rpcz_store.cc:276] 0709 13:12:03.998213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.001263 (+  3050us) service_pool.cc:224] Handling call
0709 13:12:05.325736 (+1324473us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:12:05.586304 (+260568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2651520}
I20260709 13:12:05.588464 30342 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:12:05.589533 29745 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:05.564075   945 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.594573   945 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.596882   945 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.549613   802 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.605551 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.554078   965 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.603380 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.629292 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:05.630895 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:05.632546 29639 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:05.633548   738 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:05.635303 29639 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:05.625675   971 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8.
I20260709 13:12:05.639783   738 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.625968   802 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.639623   737 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:05.641770 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.642660 29748 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2255) took 1064 ms. Trace:
I20260709 13:12:05.653353 29818 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:05.642997 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.571456   946 consensus_queue.cc:1059] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:12:05.634806   965 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.642690 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.689132 29821 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:05.646556 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.589700 30342 raft_consensus.cc:3055] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:05.570056   800 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:05.648092 29639 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:05.655416 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.655932 29817 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:12:05.657178 30345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49706 (request call id 563) took 1853 ms (client timeout 1766 ms). Trace:
W20260709 13:12:05.657732 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4d20 after lost signal to thread 30374
W20260709 13:12:05.695698 29695 debug-util.cc:398] Leaking SignalData structure 0x7b08003143a0 after lost signal to thread 30375
I20260709 13:12:05.645242   938 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:05.653254 29748 rpcz_store.cc:276] 0709 13:12:04.577970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.156395 (+578425us) service_pool.cc:224] Handling call
0709 13:12:05.211876 (+ 55481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:05.212028 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:05.301846 (+ 89818us) log.cc:844] Serialized 14 byte log entry
0709 13:12:05.598402 (+296556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:05.598477 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:05.598541 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.598620 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.642506 (+ 43886us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b540035c5d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abc8ad 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:05.642605 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5770,"prepare.queue_time_us":51551,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":4094,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8728,"spinlock_wait_cycles":119293184,"thread_start_us":378879,"threads_started":2}
I20260709 13:12:05.649739   936 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:05.694903 29816 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:05.693673 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.701893 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:05.702054 29638 leader_election.cc:336] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Timed out: RequestConsensusVote RPC to 127.27.229.66:46333 timed out after 1.516s (SENT)
I20260709 13:12:05.652693   738 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:05.695298 30345 rpcz_store.cc:269] 0709 13:12:03.803933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.656988 (+1853055us) service_pool.cc:211] Skipping call since client already timed out
0709 13:12:05.657103 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:12:05.652647   737 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.720672 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:05.717082 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 69028.1us
I20260709 13:12:05.722354 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:05.723562 29639 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:05.726934 29821 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:05.728674   737 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:05.735476 29787 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:05.736794 29787 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:05.728538   971 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.692201 30342 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:05.700352   938 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.754163 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.765216 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.710005   936 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.767055 29820 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:05.727981   946 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:05.739461   911 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:05.739353 30341 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:05.739912   751 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:05.738534   509 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:05.767696   938 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.738566   970 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:05.773018 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.771220   936 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.778900 29821 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:05.738405   971 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.785195 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:05.701288   800 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:05.787724 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:05.788399 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 188324us
I20260709 13:12:05.775079   946 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.774801   911 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.801017   737 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.781530   751 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.781848   509 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.806658 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.808095 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:05.786468   970 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:05.814103 29816 raft_consensus.cc:2376] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11. Re-sending same reply.
I20260709 13:12:05.815886 29821 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:05.803169   946 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:05.804054   911 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:05.809088   751 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:05.812793   509 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.833019   737 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.856168 29742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1036) took 1070 ms. Trace:
I20260709 13:12:05.856675 29742 rpcz_store.cc:276] 0709 13:12:04.785697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.295666 (+509969us) service_pool.cc:224] Handling call
0709 13:12:05.296004 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.296562 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.296595 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.297066 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:12:05.615093 (+318027us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:05.615131 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.615197 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:05.855902 (+240705us) raft_consensus.cc:1685] finished
0709 13:12:05.855922 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:05.856089 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":317635,"threads_started":1,"wal-append.queue_time_us":442440}
I20260709 13:12:05.835199 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.858335   399 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:05.835722 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:05.836802 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:05.837415 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.837749 29747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36354 (request call id 1033) took 1262 ms. Trace:
I20260709 13:12:05.859982 30350 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:05.838639 29743 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:05.861088 30314 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:05.839295 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:05.862458 29741 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48026 (request call id 2692) took 1161 ms (client timeout 1537 ms). Trace:
I20260709 13:12:05.843624 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:05.844228   811 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:05.844904   904 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:05.860975 29747 rpcz_store.cc:276] 0709 13:12:04.575452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.575557 (+   105us) service_pool.cc:224] Handling call
0709 13:12:04.575857 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:04.882315 (+306458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:05.837480 (+955165us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400343ad4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:05.837687 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703294336}
I20260709 13:12:05.845070 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.845517   897 consensus_queue.cc:1059] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:05.795411 30342 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:05.820974   970 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:05.862869 29741 rpcz_store.cc:269] 0709 13:12:04.700760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.725606 (+ 24846us) service_pool.cc:224] Handling call
0709 13:12:05.839135 (+1113529us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:12:05.862394 (+ 23259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19402496}
I20260709 13:12:05.854110 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:05.839088 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:05.873433 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48028 (request call id 2271) took 1025 ms. Trace:
I20260709 13:12:05.885251 30314 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:05.885497 29740 rpcz_store.cc:276] 0709 13:12:04.847763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:04.957697 (+109934us) service_pool.cc:224] Handling call
0709 13:12:05.853826 (+896129us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b58001b2198. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:12:05.873360 (+ 19534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4103552}
I20260709 13:12:05.888151   965 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:05.889565   755 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:05.872957   960 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:05.890066   755 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:05.890486   755 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.896582   960 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:05.897099   960 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:05.906888 29569 catalog_manager.cc:5697] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.908536 29569 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 7 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 8 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.860160   802 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:05.229838 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:05.914842   800 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:05.916214   971 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:05.919605  1033 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
W20260709 13:12:05.937744 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 52575.3us
W20260709 13:12:05.939761 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 384803us
I20260709 13:12:05.940927  1001 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:05.964814 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 239471us
W20260709 13:12:05.970732 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 225744us
I20260709 13:12:05.969801 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:05.960274  1001 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:05.979709   399 consensus_queue.cc:1059] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:12:05.975018   933 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:05.979785  1001 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:05.978921   904 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:12:06.022267   985 raft_consensus.cc:3055] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:06.034600   985 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:06.035446   985 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.041879   711 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:06.044456 29571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50500 (request call id 322) took 5649 ms. Trace:
I20260709 13:12:06.046598 29569 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:06.048175 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 334772us
I20260709 13:12:06.048269 29569 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:06.055076  1034 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:12:05.985100   971 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:12:06.063755   509 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.064661 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.070334   971 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:06.076751   971 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:06.077684   971 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:06.078912   971 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.044915 29571 rpcz_store.cc:276] 0709 13:12:00.395352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:00.407741 (+ 12389us) service_pool.cc:224] Handling call
0709 13:12:06.044362 (+5636621us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:04.899584 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:04.900176 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:04.900210 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:12:04.900228 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:04.900653 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:04.900756 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:04.900788 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:04.901108 (+   320us) tablet.cc:701] Row locks acquired
0709 13:12:04.901129 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:04.901295 (+   166us) write_op.cc:270] Start()
0709 13:12:04.901410 (+   115us) write_op.cc:276] Timestamp: P: 1783602724901238 usec, L: 0
0709 13:12:04.901432 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:04.902204 (+   772us) log.cc:844] Serialized 925 byte log entry
0709 13:12:05.075192 (+172988us) op_driver.cc:464] REPLICATION: finished
0709 13:12:05.154002 (+ 78810us) write_op.cc:301] APPLY: starting
0709 13:12:05.154084 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:05.154197 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:05.154343 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:05.154757 (+   414us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:05.154931 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:12:05.154977 (+    46us) write_op.cc:312] APPLY: finished
0709 13:12:05.155154 (+   177us) log.cc:844] Serialized 29 byte log entry
0709 13:12:05.155317 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.155401 (+    84us) write_op.cc:454] Released schema lock
0709 13:12:05.155439 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:05.155826 (+   387us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:05.155852 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":93763,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":78565,"apply.run_cpu_time_us":1808,"apply.run_wall_time_us":1808,"num_ops":2,"prepare.queue_time_us":81587,"prepare.run_cpu_time_us":25226,"prepare.run_wall_time_us":41996,"raft.queue_time_us":136151,"raft.run_cpu_time_us":35590,"raft.run_wall_time_us":78863,"replication_time_us":173595,"thread_start_us":208825,"threads_started":4,"wal-append.queue_time_us":34667}]]}
I20260709 13:12:06.081137   912 raft_consensus.cc:3055] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:06.081601   912 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:06.082480   912 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.083725   912 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:06.086735 30349 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:06.070940   751 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.071348   755 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.072273   938 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.073336 29569 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:06.073700   911 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.089344 30350 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:06.094236 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:06.095490 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.097354 29674 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:06.095927 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:06.089267 30315 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.099407 29672 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:06.103592 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.104393 29666 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:12:06.092738   711 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:06.108040 29638 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.110802 29819 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:06.114899 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:06.118757 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 275189us
I20260709 13:12:06.076887   738 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.124064 29672 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:12:06.124403 29674 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
W20260709 13:12:06.125325 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 186653us
I20260709 13:12:06.126204 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.127168 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:06.170688 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 296215us
W20260709 13:12:06.171896 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 52665.9us
I20260709 13:12:06.135465 29714 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.179876 29746 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:06.180287 29746 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:06.180408 29740 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:06.181137 29746 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.182065 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:06.182674 29740 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:12:06.117863   795 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:06.115406   711 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:06.091868   955 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:12:06.185305 29746 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:06.186422 29816 raft_consensus.cc:2393] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:12:06.174320 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 199631us
I20260709 13:12:06.175097 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:06.175108   814 consensus_queue.cc:1059] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:06.187839 30315 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:06.196777 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 71177.2us
W20260709 13:12:06.198474 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.199365 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.199528 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:06.200202 29740 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:12:06.200555 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.201344 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:06.201725 29789 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.206957 29741 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:06.194619   711 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.206375 29787 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:06.210052 29746 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:06.210438 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:06.170759  1041 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.212065 29789 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.213131 30315 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.215276 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.119727   960 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.186362   936 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.219529 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:06.218226 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.215268 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.225970 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:06.227718  1036 log.cc:927] Time spent T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:12:06.212831   968 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:06.211784   885 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:06.248210 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 283592us
I20260709 13:12:06.250782 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.214671   975 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:06.214998   953 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:06.214773   993 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:06.216919   800 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.241286   711 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.219117  1039 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:06.269840   975 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.286835   993 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.344475   399 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:06.287050   953 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:06.246243   435 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:12:06.255316   558 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:12:06.294178  1043 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.304324   897 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.297118   970 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.314363   885 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:12:06.366937 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 187368us
W20260709 13:12:06.368939 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 103725us
W20260709 13:12:06.360303 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 147241us
I20260709 13:12:06.363489   751 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:06.330811  1054 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:06.348380   975 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:06.382871 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 157014us
I20260709 13:12:06.354795   953 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.354899   993 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.376361   600 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:06.404168 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:06.405186 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.421175 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 207559us
W20260709 13:12:06.422816 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 225268us
W20260709 13:12:06.427045 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 176326us
I20260709 13:12:06.427821 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:06.428087 29789 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.388173   938 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:06.434046   399 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:06.389983   755 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:06.401005  1054 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.437083 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.441103 29674 raft_consensus.cc:2368] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:06.438452 29672 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:12:06.439747 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.383904   897 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.450536 30342 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.452047 30341 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:06.453274 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:06.454108 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:06.456444 29638 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:06.456779   897 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:06.457310   897 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:06.431644   968 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.458151 29638 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.413201   911 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:06.459511 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:06.464953 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.465837 29674 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:06.465973 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:06.468426 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.433130  1041 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:06.426455  1053 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.472144 29667 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:06.472846 29674 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 13:12:06.473526 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.473786 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:06.471247   938 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:06.517465 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:06.475067 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.469463 29668 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:06.478039 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 50024.4us
I20260709 13:12:06.479674 30345 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:06.483019 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.445755  1054 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:06.471518   737 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:06.474493 29670 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:06.510146 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.511647 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.511957   711 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:06.513350  1049 log.cc:927] Time spent T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:12:06.514130  1046 consensus_queue.cc:1059] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:06.545358 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.491616   936 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:06.549685 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:06.520725 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:06.521351 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:06.513259   795 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:06.483628   800 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:06.535080 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:06.539991 29666 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:06.499022   933 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:06.539886 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:06.514719  1053 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:06.498255   960 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:06.519744 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.528148 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.470160   755 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:12:06.553290 29671 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:06.556169 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:06.556663 29821 raft_consensus.cc:2393] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 9: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:06.559512 29666 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:06.489975   940 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:12:06.592594 29817 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:12:06.576040 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 56362.2us
I20260709 13:12:06.594578 29816 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.594856 29789 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.596031 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.525629   788 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:12:06.597126 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:06.534121   938 raft_consensus.cc:697] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:06.516618   751 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:12:06.621045 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.558386   795 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.632527 29640 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:06.632166 29639 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:06.558612  1043 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:06.597131   945 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:06.623126   751 consensus_queue.cc:1243] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:12:06.626858   980 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:06.598677   885 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.636895   800 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:12:06.694013 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:06.693814 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 269117us
I20260709 13:12:06.599293 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:06.696321 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 160919us
I20260709 13:12:06.707011 29822 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:06.702957 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:06.715907 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:06.686285  1041 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.742271 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:06.603772   933 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.743801 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 2571) took 1554 ms. Trace:
I20260709 13:12:06.686372   970 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:06.682672  1073 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:06.750545 29744 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:06.751411   933 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:06.751600 29673 rpcz_store.cc:276] 0709 13:12:05.158808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.222137 (+ 63329us) service_pool.cc:224] Handling call
0709 13:12:05.222466 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:05.307898 (+ 85432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.307928 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:05.317469 (+  9541us) log.cc:844] Serialized 52 byte log entry
0709 13:12:05.898626 (+581157us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b1800289360. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d0d1 00007fd9e9a78a0f
0709 13:12:06.171403 (+272777us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:12:06.171450 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.171532 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.689047 (+517515us) raft_consensus.cc:1685] finished
0709 13:12:06.689067 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.713191 (+ 24124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26434,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5225,"spinlock_wait_cycles":5148416,"thread_start_us":267548,"threads_started":1,"wal-append.queue_time_us":1019961}
I20260709 13:12:06.753280  1091 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:06.753844  1091 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:06.757122  1078 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:12:06.758366 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:06.687691   980 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:06.598074  1053 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.754711  1037 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:06.762187 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:06.709223 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:06.681445   936 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:12:06.713686   737 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:06.768956 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 53119us
I20260709 13:12:06.777837 29747 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:06.758400  1079 log.cc:927] Time spent T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:12:06.742861   755 raft_consensus.cc:3055] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:06.785843 29816 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:06.649899 30345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:06.801630 30345 raft_consensus.cc:606] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:06.648018  1043 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.791739 30314 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:06.766197   948 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:06.706259  1060 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.077s
W20260709 13:12:06.810459 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 411088us
W20260709 13:12:06.813555 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 192591us
I20260709 13:12:06.779415   980 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:06.823302 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 195959us
I20260709 13:12:06.785532  1052 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:06.830469 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.801049   755 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:06.718106   938 consensus_queue.cc:237] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.841383 29822 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 13.
I20260709 13:12:06.816445   948 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
W20260709 13:12:06.833173   971 consensus_meta.cc:287] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.002s
I20260709 13:12:06.828750  1064 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:06.850204   399 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:06.833293  1052 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:06.866258 29674 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:06.828933  1084 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:12:06.856457   897 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:06.855640  1064 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:06.839450   800 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:06.890823  1077 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:12:06.894531   897 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:06.895108   897 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:06.895980  1080 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:12:06.897224   897 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:06.856115  1069 consensus_queue.cc:1059] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:12:06.855713   457 consensus_queue.cc:1059] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:12:06.865100  1038 log.cc:927] Time spent T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.286s	user 0.001s	sys 0.001s
I20260709 13:12:06.898049   993 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.875867  1083 consensus_queue.cc:1059] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
W20260709 13:12:06.903107   946 consensus_meta.cc:287] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 1.056s	user 0.009s	sys 0.003s
I20260709 13:12:06.905718   946 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.906589 29823 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52208 (request call id 1078) took 1264 ms. Trace:
I20260709 13:12:06.890832  1043 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:06.908073   946 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:06.898684  1069 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:06.910782  1069 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:06.886111  1062 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:12:06.889964   948 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.911629 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:06.906966 29823 rpcz_store.cc:276] 0709 13:12:05.641681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.643421 (+  1740us) service_pool.cc:224] Handling call
0709 13:12:05.643705 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.644109 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.644135 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.644623 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.091714 (+447091us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:06.091766 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.092863 (+  1097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.906374 (+813511us) raft_consensus.cc:1685] finished
0709 13:12:06.906392 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.906525 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":767,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":5720,"thread_start_us":382606,"threads_started":1,"wal-append.queue_time_us":806271}
I20260709 13:12:06.909205 29814 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:06.911634  1069 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.914163  1069 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:06.909832  1083 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:06.900794 30346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49706 (request call id 583) took 1060 ms. Trace:
I20260709 13:12:06.910264   993 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:06.918159  1083 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:06.918602  1053 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:06.919286  1083 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:06.920212  1083 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:06.920632   912 consensus_meta.cc:287] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.000s
I20260709 13:12:06.912360   948 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:06.890090  1064 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:06.921665 30346 rpcz_store.cc:276] 0709 13:12:05.840170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.840447 (+   277us) service_pool.cc:224] Handling call
0709 13:12:05.840781 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:05.841171 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:05.841198 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:05.841672 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.108814 (+267142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:06.108859 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.108936 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.900536 (+791600us) raft_consensus.cc:1685] finished
0709 13:12:06.900554 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.900714 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12405,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8753,"thread_start_us":266526,"threads_started":1,"wal-append.queue_time_us":983784}
W20260709 13:12:06.927484 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 284448us
I20260709 13:12:06.869057  1052 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:06.870962  1100 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:06.933977 29639 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:12:06.929070  1063 log.cc:927] Time spent T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:12:06.935575 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:12:06.945206 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:06.884279 30342 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:12:06.947752  1041 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:06.914011   755 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.918012  1054 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.939735   940 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:06.954663 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 493725us
W20260709 13:12:06.958263 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 141147us
I20260709 13:12:06.954176 30342 pending_rounds.cc:85] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 7
W20260709 13:12:06.948523   953 consensus_meta.cc:287] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.002s
I20260709 13:12:06.961028 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:06.956364 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 160119us
I20260709 13:12:06.962656 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:06.965581 29747 raft_consensus.cc:2393] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 9: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:06.963315 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:06.966554 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:06.964956 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.967362 29667 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:06.971246 29670 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:06.972244 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.971478 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.973635 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:06.974309 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:06.963188 30342 pending_rounds.cc:107] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:12:06.974895 30347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 511) took 1709 ms. Trace:
I20260709 13:12:06.963577   755 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:06.986796  1061 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:06.988073  1086 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:12:06.958869  1091 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:06.960682 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:06.958501  1041 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:06.941697  1100 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.976627 30348 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:06.994900 30347 rpcz_store.cc:276] 0709 13:12:05.265437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.328824 (+ 63387us) service_pool.cc:224] Handling call
0709 13:12:05.941274 (+612450us) spinlock_profiling.cc:243] Waited 8.85 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea96fc0 00007fd9eea81929 00007fd9eea813d2 00007fd9e7ff8bd4
0709 13:12:05.941492 (+   218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:06.172604 (+231112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:06.172635 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:06.195670 (+ 23035us) log.cc:844] Serialized 26 byte log entry
0709 13:12:06.367536 (+171866us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:06.367576 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:06.367651 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:06.969668 (+602017us) raft_consensus.cc:1685] finished
0709 13:12:06.969689 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:06.974833 (+  5144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8435,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":4063,"spinlock_wait_cycles":20346112,"thread_start_us":387153,"threads_started":2,"wal-append.queue_time_us":558585}
I20260709 13:12:06.970504   953 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.984436 30342 raft_consensus.cc:2889] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:07.006453   904 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:07.006889 30342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 519) took 1686 ms. Trace:
I20260709 13:12:07.007131 30343 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:12:07.007452   792 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:12:07.008104  1099 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:06.989051  1109 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:07.008741  1109 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.010424 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:07.011154  1109 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.011363 30348 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:07.012137  1041 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.015106  1054 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:07.016160 29673 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
W20260709 13:12:07.015834   975 consensus_meta.cc:287] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.003s
I20260709 13:12:07.019346   975 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.020377  1100 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:07.020778  1104 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:07.021061  1088 log.cc:927] Time spent T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:07.021476   975 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.021323  1104 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:06.977905   912 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:07.022485   912 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.024003  1104 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:07.024657   912 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.025503 29715 leader_election.cc:400] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:07.025827 29715 leader_election.cc:403] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:07.026751   904 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:07.026989 29715 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:07.028170  1001 consensus_meta.cc:287] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 1.006s	user 0.013s	sys 0.000s
I20260709 13:12:07.028613 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:07.029119  1109 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:07.031544   795 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.032618 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:06.977279  1075 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.027482   904 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:12:07.037494 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.039057 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:06.995474  1084 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.052244 29715 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.056097 29745 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:07.053108  1001 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.063994  1001 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.064656 30350 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:07.059327   953 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.049880   897 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:07.016093 30342 rpcz_store.cc:276] 0709 13:12:05.320444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:05.589288 (+268844us) service_pool.cc:224] Handling call
0709 13:12:05.589578 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.449911 (+860333us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b58000ef6d0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a190aa 00007fd9e9a9b447 00007fd9e9ab3fe7 00007fd9e9ab57de 00007fd9e9abfb49 00007fd9e9ac0416 00007fd9e9abcd8f 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4
0709 13:12:07.006629 (+556718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.006830 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482620288}
I20260709 13:12:07.076417   509 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.080322   980 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.055464  1053 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:07.084085 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:07.084102 29715 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.086480 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.088631   795 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:07.091746 29740 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:07.094992 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.095084 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.095968 29748 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:07.092180   897 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.084749   904 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.093411  1053 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:07.104408   897 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.097626 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.100690 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.104900  1053 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.106051 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.102118  1100 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.096192 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.107340 29741 raft_consensus.cc:2393] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:07.109349  1083 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:07.110095  1083 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.111140 29666 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:07.111414 29667 raft_consensus.cc:1240] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:07.111461 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:07.112119 29715 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.112519 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.113489 29671 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:07.115911 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.116161 29715 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.118265   897 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:07.119001   897 consensus_queue.cc:1059] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:07.117641 29715 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.120766 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.120915 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.121711  1083 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:07.122090   755 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:07.123816   897 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:07.124774   897 consensus_queue.cc:1243] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:07.125238   755 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:07.125595   755 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:07.104573  1075 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:07.126312  1075 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:07.126824  1075 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:07.126381   755 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.127878   755 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:07.130300 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.115703  1100 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:07.134044  1083 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.134573 29748 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:07.141431 29787 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:07.141695 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.133095 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
W20260709 13:12:07.137005 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.122344 29667 raft_consensus.cc:1240] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:07.147754 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:07.138603   955 raft_consensus.cc:3055] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:07.161101 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:07.157145 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.166074 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.166361 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:07.097456   933 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.145604  1083 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:07.167730 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.167326   969 consensus_queue.cc:1059] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 13:12:07.170624 29714 leader_election.cc:336] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.802s (SENT)
I20260709 13:12:07.171023 29714 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.160521   955 raft_consensus.cc:740] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.172058   571 consensus_queue.cc:1059] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:07.172638   904 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:07.172420   955 consensus_queue.cc:260] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.173170 30316 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.173470   955 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:07.173810   795 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:07.170257 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.174876   795 raft_consensus.cc:3055] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:07.175267   795 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.176457   985 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.176124   795 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.177881   795 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:07.181203 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:07.182083  1091 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.167637  1074 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:12:07.182865  1107 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:07.178464   738 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.174947   600 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:07.184326   600 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.184975   948 consensus_queue.cc:1059] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:07.186578   948 raft_consensus.cc:3055] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:07.186887   948 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.187696   948 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.188860   948 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:07.178369   969 raft_consensus.cc:3055] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:07.189673   969 raft_consensus.cc:740] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.178061   904 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:12:07.191098 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 360701us
I20260709 13:12:07.143181  1104 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:12:07.195186 29789 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.162936   980 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.178928   571 raft_consensus.cc:3055] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.191479  1083 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.183363  1107 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:07.193964  1061 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.210397 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.214748 29814 raft_consensus.cc:1240] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:12:07.215590 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.216583 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.217032 29816 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:07.220679 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 79353.3us
I20260709 13:12:07.223932 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:07.225095 29674 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:07.226562 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.226797  1070 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:07.227563 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:07.228255   993 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.205732  1083 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.229012   802 raft_consensus.cc:2804] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:07.229420 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.220191   509 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:07.229955 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:07.226257 29558 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 389c080a49494f8fb56c53fa7e6087f3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:07.230087 29672 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:07.227916 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.204794   571 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.236943 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.237504 29821 raft_consensus.cc:2376] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8. Re-sending same reply.
I20260709 13:12:07.227504 29822 raft_consensus.cc:1240] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:07.232986 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:07.233546 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.234333 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.236945 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.238690 29672 raft_consensus.cc:3060] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:07.234534 29823 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:12:07.229743   802 raft_consensus.cc:697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:07.235273 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.209517   811 raft_consensus.cc:3055] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:07.245862 29818 raft_consensus.cc:2368] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:07.190481   969 consensus_queue.cc:260] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.231956 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.238250 29820 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:12:07.240765 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.241580 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.249691 29823 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:07.250871 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.249166 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.251827 29820 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:07.252576 29816 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:07.253005 29820 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:07.243188 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.254505 29820 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:12:07.255122 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.255931 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.218533   975 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:07.253778 29639 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.257954 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.258129 29823 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:07.259472 29815 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:07.259680   800 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:07.260229   800 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:07.260560   802 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.262660 29821 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:12:07.263322   969 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:07.236330   509 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.266126   975 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.267309 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.268443   975 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.268549   509 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.269234 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.271754 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.272276 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:07.272511 29671 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:07.274252 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.276340 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:07.277031 29748 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:07.226946  1098 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.277362 29672 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:07.280833 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:07.269120   968 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:07.246068   811 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:07.272989   953 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:07.278390   435 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:07.245651  1054 consensus_queue.cc:1059] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:12:07.319967 29674 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:07.283066  1095 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.285706   993 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:07.241498  1107 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.354480   435 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:07.261556   800 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.309784   975 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:07.314627   968 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
W20260709 13:12:07.354220  1113 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:12:07.358990  1083 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:07.370039 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 43940.6us
W20260709 13:12:07.374873 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 50394.5us
I20260709 13:12:07.398283   811 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.434372   811 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:07.435076  1126 log.cc:927] Time spent T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
W20260709 13:12:07.418006  1109 consensus_queue.cc:1175] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "389c080a49494f8fb56c53fa7e6087f3" responder_term: 8 status { last_received { term: 8 index: 4 } last_committed_idx: 3 last_received_current_leader { term: 8 index: 4 } }
I20260709 13:12:07.436789 30345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:07.400913   600 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.441139 30350 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:07.364795   571 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.407059   435 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.392652  1037 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:12:07.456408 29745 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:07.365432  1053 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.457414 29740 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:07.458372 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.459668  1037 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:07.460594 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.443888 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:07.467552 29740 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:07.420531   993 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:07.426484 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:07.427451  1125 log.cc:927] Time spent T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:12:07.397058   975 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:07.432322   933 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:07.441821 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.442705 29741 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:07.443310  1121 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:12:07.443331 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.444283 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.484814 29672 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.444900 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.477751 30314 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.440760  1075 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.444929   968 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.493055   993 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.494127 29667 raft_consensus.cc:2393] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 11: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:07.491915  1074 consensus_queue.cc:1059] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:12:07.449548 29640 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:12:07.496133 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 46674.9us
W20260709 13:12:07.450052  1064 consensus_meta.cc:287] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.007s
I20260709 13:12:07.432107  1083 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:07.454361 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:07.499436 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.478698 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.500233 29823 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:07.440248   600 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:07.480001 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 53629.4us
I20260709 13:12:07.445128  1052 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.487910 30314 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.480620   897 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:07.489471  1066 raft_consensus.cc:3055] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:07.491000 29821 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:07.482779   975 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:07.521453 29740 pending_rounds.cc:85] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 7
I20260709 13:12:07.521835 29740 pending_rounds.cc:107] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:12:07.522140 29740 raft_consensus.cc:2889] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:07.491739  1107 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.491652   792 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.492774  1075 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.494711 29787 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:07.498633 29640 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:07.539587  1111 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:12:07.540141   980 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:07.540714   980 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:07.499603 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:07.503149 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.504667 29672 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:07.360618  1095 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.483145  1098 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:07.507442 30314 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.500506  1064 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.502446   911 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:12:07.551820   911 raft_consensus.cc:3055] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:07.552304  1095 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.552640  1064 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.511377 29749 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:07.553514 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 50464.2us
I20260709 13:12:07.512303  1052 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.529101 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 2719) took 1331 ms. Trace:
I20260709 13:12:07.555265 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:12:07.555970 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48596.9us
I20260709 13:12:07.558277   969 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:07.560060 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:07.511801   897 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:07.560714   897 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:07.554670 29743 rpcz_store.cc:276] 0709 13:12:06.197621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.202616 (+  4995us) service_pool.cc:224] Handling call
0709 13:12:06.202876 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:06.203058 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:12:06.353597 (+150539us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.528288 (+1174691us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b18002ae320. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e96654bc 00007fd9e69b348b 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cd455 00007fd9e9ab5060 00007fd9e9ac7716 00007fd9e9ad8287
0709 13:12:07.528605 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:12:07.528791 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:07.528833 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:07.528880 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:07.528943 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:07.529046 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27574,"prepare.queue_time_us":301032,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":92,"raft.queue_time_us":94337,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":8706,"spinlock_wait_cycles":44031360,"thread_start_us":376744,"threads_started":3,"wal-append.queue_time_us":191602}
I20260709 13:12:07.564994 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:07.548906  1045 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:07.565641  1045 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:07.534108  1066 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.508685  1074 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:07.541550   980 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.551064 29665 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:07.553656  1098 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.567682 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.586603 29672 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:07.569687 30344 raft_consensus.cc:1240] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:07.499819   985 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.533572 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.574033 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:07.574946  1045 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.575536  1001 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:07.596377  1001 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.596556 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.577562 30314 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.600162 30316 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.579286 29714 leader_election.cc:400] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:07.552192   911 raft_consensus.cc:740] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:07.583949 29748 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:07.583880 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.572734 30350 raft_consensus.cc:1240] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:07.612329 29674 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:07.613448   792 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.613797   911 consensus_queue.cc:260] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.561573   897 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.597347  1001 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.614838   795 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:07.589843 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.632745 29669 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:07.553428  1104 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:07.592676 29746 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:07.633591  1104 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:07.593402 29741 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:07.634059  1104 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.602382 29714 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.635159  1046 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:07.617583  1061 consensus_queue.cc:1059] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:12:07.636802 30350 raft_consensus.cc:1240] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:07.637285 30316 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.638448   897 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.640045  1054 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.640573  1054 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.640887  1069 consensus_queue.cc:1059] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:07.641952  1069 raft_consensus.cc:3055] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:07.642578  1054 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:07.644376 29665 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45236 (request call id 2572) took 1545 ms (client timeout 1865 ms). Trace:
W20260709 13:12:07.644788 29665 rpcz_store.cc:269] 0709 13:12:06.092806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:06.092969 (+   163us) service_pool.cc:224] Handling call
0709 13:12:07.637773 (+1544804us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001f4ad4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:07.637877 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3112558848}
I20260709 13:12:07.647419 29741 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:07.648463   814 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:07.649147 29747 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:07.651979 29787 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:07.652456 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50142.7us
I20260709 13:12:07.653270 29714 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.654176   945 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:07.654594   945 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:07.654966   945 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.655623   911 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:07.633174  1066 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.587664 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.660765  1037 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:07.664561 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:07.661723 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 74146.1us
I20260709 13:12:07.671481 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:07.673866 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.665537  1054 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:07.642267  1069 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:07.669592 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.682163 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:07.682313 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:07.683395 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.684155 29714 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.680725   755 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:12:07.675640  1046 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.687227  1084 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:07.687860  1084 raft_consensus.cc:697] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:07.688812  1084 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:07.675746 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.704891 29665 raft_consensus.cc:2368] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7.
W20260709 13:12:07.686801  1129 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:12:07.666005   960 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:07.711771  1096 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:07.713168 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 43646.7us
I20260709 13:12:07.714882 29789 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.716193   800 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:07.706169  1066 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:07.706573  1062 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.692556   904 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.706427  1052 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:07.709311   960 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:07.690603  1083 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:12:07.711090  1053 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:07.735961 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.736228 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:07.736686 29816 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.737519 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.748752 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.750973 29789 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.756650 29816 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:07.729669  1070 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:12:07.773383 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 164998us
I20260709 13:12:07.756012  1096 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.758483   953 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.768045   509 raft_consensus.cc:2764] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:12:07.793495   571 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:07.759187   800 consensus_queue.cc:1059] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:12:07.729271  1069 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.771184  1107 consensus_queue.cc:1059] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:12:07.789583   960 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.809820  1069 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:07.787236   945 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:07.796254  1128 log.cc:927] Time spent T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:12:07.829643  1060 raft_consensus.cc:3055] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:07.830514  1060 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:07.830785   945 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:07.831344  1060 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.832765  1060 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:07.836491 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 151765us
I20260709 13:12:07.840761 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:07.833840   435 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:12:07.843447 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 73311.2us
I20260709 13:12:07.842236   911 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:07.847587   911 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:07.848510   911 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.828099   975 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:07.905054 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 64490.8us
I20260709 13:12:07.843861  1075 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:12:07.913012 29666 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:07.920949 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.909765  1075 consensus_queue.cc:1243] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:12:07.906137   755 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:07.923846 29670 raft_consensus.cc:2393] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
W20260709 13:12:07.924901 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 239524us
I20260709 13:12:07.929141 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:07.925144 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.930019 29666 raft_consensus.cc:2376] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8. Re-sending same reply.
I20260709 13:12:07.931362 29789 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:07.932724 29714 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:07.938210 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:07.941506 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:07.938297  1135 log.cc:927] Time spent T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:12:07.943902   800 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:07.938642  1104 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:07.934494  1084 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.924003   802 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:12:07.939833   904 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:07.955598  1104 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:07.956736 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:07.957629 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:07.958382 30350 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:07.939915   897 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:07.963436 29674 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:07.932044   755 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.968832  1083 raft_consensus.cc:3055] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:07.969281  1083 raft_consensus.cc:740] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:07.964810 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:07.970064  1083 consensus_queue.cc:260] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:07.971061  1083 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:07.973117  1046 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:12:07.973577 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:07.958839   800 raft_consensus.cc:697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:07.974838   800 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:07.967881  1131 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.436s	user 0.002s	sys 0.001s
I20260709 13:12:07.978552   755 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:07.979455 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:07.979795 29667 raft_consensus.cc:1240] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:12:07.984570  1062 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:07.993325 29715 leader_election.cc:400] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7.
I20260709 13:12:07.996171 29715 leader_election.cc:403] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:12:07.998921 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:07.999523 30345 raft_consensus.cc:606] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:07.999884 30345 raft_consensus.cc:614] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:08.003731 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:08.011121 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:08.011287   975 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:08.016583 30350 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:07.999325  1084 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:08.009559  1083 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 6. Current term is 7.
I20260709 13:12:08.022945  1104 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:08.105491 29814 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:08.089164  1084 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:08.113452 29814 raft_consensus.cc:1240] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:08.053972   800 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:12:08.120570  1107 consensus_queue.cc:1059] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:12:08.130427   583 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:08.134949  1109 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:12:08.140141  1084 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.158160 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:08.158794 29740 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:12:08.165518 29741 pending_rounds.cc:85] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 6
I20260709 13:12:08.165839 29741 pending_rounds.cc:107] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:12:08.166091 29741 raft_consensus.cc:2889] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.170663 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:08.179172 29740 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:08.181247 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:08.182382 29749 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:08.182716 29638 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:08.188830 29787 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:08.192094 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:08.192853  1098 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:08.193379  1098 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:08.193678  1100 raft_consensus.cc:3055] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:08.200021 30350 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:08.193681   802 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:12:08.201851  1154 log.cc:927] Time spent T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:12:08.206235 29561 maintenance_manager.cc:419] P fa34c50a94a64ecc89d5a56c3ce9a26a: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033370
I20260709 13:12:08.191422   751 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.214543   953 raft_consensus.cc:3055] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:08.199723  1100 raft_consensus.cc:740] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:08.208158  1096 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.230520  1096 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.232755  1096 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:08.229167  1142 log.cc:927] Time spent T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.312s	user 0.000s	sys 0.010s
I20260709 13:12:08.236327 29816 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:08.239032 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:08.239427 29746 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:08.243913 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:08.237025 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:08.217188  1151 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:12:08.198820   457 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:12:08.234596   751 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.223680   953 raft_consensus.cc:740] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:08.267670   751 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.268231   953 consensus_queue.cc:260] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.260658   509 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.270226   509 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.272472   509 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.276055 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:08.276760 30345 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:08.216315   985 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:08.287565 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:08.288265 29669 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:08.280714   509 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:12:08.286278 29789 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:08.207644  1098 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:08.296648 30342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 531) took 1056 ms. Trace:
I20260709 13:12:08.297015 30345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:08.252449   738 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:12:08.298378 30345 raft_consensus.cc:606] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:08.306059   751 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:08.308040 29666 raft_consensus.cc:1240] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:12:08.312775 29558 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER failed with leader 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:12:08.315062  1074 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.315693  1074 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.289985   985 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.318740   985 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.320334 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:08.297106 30342 rpcz_store.cc:276] 0709 13:12:07.240118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:07.242357 (+  2239us) service_pool.cc:224] Handling call
0709 13:12:07.285640 (+ 43283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:07.554434 (+268794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:07.554469 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.013499 (+459030us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b2c00047828. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e83b6a11 00007fd9e83c6372 00007fd9e9af8a01 00007fd9e9abd43a 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2
0709 13:12:08.013907 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:12:08.121548 (+107641us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:08.124436 (+  2888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:08.296298 (+171862us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54005d52d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:08.296371 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:08.296418 (+    47us) raft_consensus.cc:1685] finished
0709 13:12:08.296435 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:08.296584 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3705,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":627523200,"thread_start_us":84103,"threads_started":1,"wal-append.queue_time_us":125437}
I20260709 13:12:08.323436 29817 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:08.324163   583 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:08.324666   583 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:08.325311 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:08.326087 29817 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:12:08.326934  1074 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:08.332969   751 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:08.337615   993 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:08.338153   993 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:08.339910 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.340162  1074 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:08.234290  1100 consensus_queue.cc:260] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.341696  1100 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.343482 30344 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:08.346321 29665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:08.346585 29667 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:08.349187 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:08.350131   980 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.350435 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:08.351840 29665 raft_consensus.cc:606] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:08.352228 29665 raft_consensus.cc:614] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:08.352778 29815 raft_consensus.cc:1240] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:08.356359 29665 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:08.356551   802 consensus_queue.cc:1059] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:08.357378   802 raft_consensus.cc:3055] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:08.357705   802 raft_consensus.cc:740] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:08.358446 29666 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:08.359081  1045 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.359562   945 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:08.360759   980 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:08.362159  1052 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:08.363818  1066 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:08.364235  1066 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:08.365028  1066 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.369628 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:08.370329 29746 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.358587   802 consensus_queue.cc:260] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:08.386286 29740 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:12:08.388567 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 124509us
I20260709 13:12:08.338505   993 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.389719 29787 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:08.394109 30315 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:08.395095   399 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:08.396699 29740 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:08.395699   435 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:08.402048 29639 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:08.408452 29749 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:12:08.408905 29749 pending_rounds.cc:85] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 8
I20260709 13:12:08.409119 29749 pending_rounds.cc:107] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:12:08.409333 29749 raft_consensus.cc:2889] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:08.414960  1050 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.425496  1050 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.452148 29746 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:08.388883   800 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:12:08.415681   792 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:08.424499   802 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.454981 29638 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:08.427695   985 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:08.405167  1082 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:12:08.438815  1066 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.415870   457 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:12:08.464531  1069 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:08.454272  1046 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.457908   792 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.486001 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:08.486855 29669 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:08.488827 29669 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:08.438704  1140 consensus_queue.cc:1059] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:12:08.480728   792 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.470693 30342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:08.508306 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:08.509055 29746 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:08.480461  1069 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:08.511996 30342 raft_consensus.cc:606] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:08.514564 30342 raft_consensus.cc:614] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:12:08.529127 30314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:08.538172 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.493358  1046 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.554195 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:08.523548   975 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:08.549499   980 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:12:08.577767 30345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc29718e51d549e395e72e7bff383425"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:08.578496 30345 raft_consensus.cc:606] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:08.578868 30345 raft_consensus.cc:614] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:08.584640 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:08.585433 29746 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:08.586679 30314 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:12:08.604537 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.605649  1069 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:08.613911 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:08.614627 29666 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:08.568270   975 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.589854  1050 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:08.577030   800 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:12:08.572810  1098 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:12:08.618559  1162 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:12:08.623106 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:08.604223   457 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:12:08.638439 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 108316us
W20260709 13:12:08.663164 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.634024   945 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:08.670307 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:08.673395 29749 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:08.641942  1051 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.640196  1060 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:08.656805   457 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.685146   792 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.677839  1046 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.699419   457 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.702503   953 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.699034  1060 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.696403  1051 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.717429  1179 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:12:08.723372 29743 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:08.723747  1181 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:08.754078  1181 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.754468  1181 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:08.754578   792 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:08.724685  1165 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:08.755745   795 raft_consensus.cc:993] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:08.756238   795 raft_consensus.cc:1081] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:08.725850   936 raft_consensus.cc:3055] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:08.758747   936 raft_consensus.cc:740] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:08.759598   936 consensus_queue.cc:260] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:08.760792   936 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.738286 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:08.740072  1060 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.741113  1001 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:08.741526  1178 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:08.743714 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:08.775934 29747 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:08.747579 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:08.776473 29665 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.778661 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:08.779461 29821 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.737454   583 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.710037  1098 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:08.772172 29817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:52208
I20260709 13:12:08.794971 29817 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:08.795363 29817 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.770620   795 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.798861   795 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.800990   795 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:08.786918   993 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.810842 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:08.797248  1098 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.811898   985 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.812440   985 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:08.813704  1098 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.814574   985 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:08.816701 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:08.817384 29666 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:12:08.818572   993 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.819339 30316 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:08.820178 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:08.820782 30345 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.821738 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:08.741294   975 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.787459 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:08.820294   792 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:08.826638   792 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.827070   792 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:08.786202  1178 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.811529 29819 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:12:08.833118 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:08.833786 30342 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:12:08.836464 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:08.837316  1098 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:08.837706  1098 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:08.838188  1098 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:08.839540   960 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:08.818500 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:08.846714  1051 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:08.848198 30342 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:08.829671  1178 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.855252 29669 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:08.857074 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:08.858049 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:08.859005 29669 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:12:08.860163 30316 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:08.751667   457 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.871809 30344 raft_consensus.cc:1240] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:08.874529 29665 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:08.874764 30345 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:08.876121 30316 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:08.876974  1064 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:08.877406 29789 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:08.877691  1064 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:08.876401 29817 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.879695 29821 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:08.880050  1178 raft_consensus.cc:2804] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:08.880540  1178 raft_consensus.cc:697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:08.880982 29817 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:08.881453  1178 consensus_queue.cc:237] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.884925 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:08.878952  1064 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.885546 29747 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:08.905838 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:08.906602 30345 raft_consensus.cc:3055] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:08.906886 30345 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:08.907981 30345 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.902107 29747 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:08.913143 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:08.913821 29665 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.865347   953 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:08.921517   457 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:08.921803 29665 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:08.871730  1051 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:08.922986 29787 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:08.925338 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:08.863637  1100 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:12:08.946424  1062 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.951696 29747 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:12:08.955075 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:08.926503  1051 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.927202   711 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.928700  1066 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:08.928386  1179 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:08.947067  1062 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.973794   457 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.974304   457 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.926290   953 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:08.961840  1051 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:08.983548 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:08.957242  1070 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:12:08.956700  1161 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:12:08.973330  1179 raft_consensus.cc:697] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:08.985759 29747 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:08.986444   457 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:08.988296 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:08.988850   583 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:09.008864 29747 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:08.968441   711 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.011842 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.017576 29817 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:08.982991  1066 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:09.023708 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:09.035539 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.034466  1144 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:09.036307 29747 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:08.993681   792 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.044559 30314 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:08.986086  1050 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:12:09.041680 30315 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:09.025309  1045 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:09.038056 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.059631 30347 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:12:09.057950  1158 log.cc:927] Time spent T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.551s	user 0.002s	sys 0.000s
I20260709 13:12:09.039633  1046 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:09.059547 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.062930 29665 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:12:09.057255   711 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.050513  1167 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.054487   814 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:12:09.064253  1187 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:12:09.071671 30316 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.037022  1144 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:09.077461  1189 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:12:09.078718  1170 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:12:09.085776 29740 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
W20260709 13:12:09.086112 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.086222 29740 pending_rounds.cc:85] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 5
W20260709 13:12:09.087086 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 45499.8us
I20260709 13:12:09.087275 29740 pending_rounds.cc:107] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:12:09.087703 29740 raft_consensus.cc:2889] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:09.088709 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.089321 29816 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:12:09.097363 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.098155 29666 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
W20260709 13:12:09.098994  1184 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:12:09.072672   814 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.060819  1045 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.086045  1064 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:09.109751 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.066525  1046 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.110782   936 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.146261   936 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.147421  1046 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.148242 29742 raft_consensus.cc:2368] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11.
I20260709 13:12:09.148399   936 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:09.154594  1166 log.cc:927] Time spent T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.640s	user 0.002s	sys 0.000s
I20260709 13:12:09.155934 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.156936   802 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:09.157496   802 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:09.158424  1159 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.679s	user 0.000s	sys 0.002s
I20260709 13:12:09.159862   802 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.111284   953 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:09.161424 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.112877  1062 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.113896 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.104040   814 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.107987  1181 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:09.172559  1181 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:12:09.122745   792 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.123378 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.174057 29674 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:09.174710 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.175123 30345 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:09.124505  1144 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.125401 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.174243   897 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.179186 29667 raft_consensus.cc:2393] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:09.126775 30350 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:09.130290 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.179543   897 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.130908 29817 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:09.185352 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.186048 29666 raft_consensus.cc:3060] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.157312  1098 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.188076 29819 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:12:09.181824   897 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.192770 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.193455 29817 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:09.196379 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:09.197345 29674 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:09.132656 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.089277  1082 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:09.225123 29673 raft_consensus.cc:2393] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 4: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:09.225064 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.138710 29668 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:09.067322  1179 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.137192 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.227720 29672 raft_consensus.cc:2393] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:09.140139  1064 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.073050  1066 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.142954 30341 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:09.145108 29671 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:09.198107  1176 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:09.231040  1176 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:09.231496  1176 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.142429  1045 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.235484  1111 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.236024  1111 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.204895 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:09.198948 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:09.208423 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 62800.3us
I20260709 13:12:09.212870   911 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:09.240311  1111 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.131745 29665 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:09.215911 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.242352 29820 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:09.243251   435 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.243677   435 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:09.215692  1051 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.219194  1055 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:09.245163 30350 raft_consensus.cc:2368] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:12:09.218065   583 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.246701  1051 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.246301   583 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.248663 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.249313   583 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:09.218016 29639 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.221514 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:09.188031  1098 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.250859 30316 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.222645 29745 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:09.251256 29742 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.253278  1055 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:09.253471 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.225487  1082 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.229558  1064 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.238126   558 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.254714   558 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:09.255671  1082 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.260187 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.260752  1055 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.260946 29672 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:09.261575  1055 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.238075   897 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.250254 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.267114 29665 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.267009   897 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:09.275306 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.276901 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:09.261309   583 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:09.278635   583 raft_consensus.cc:697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:09.279052  1045 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:09.279446  1045 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:09.279860  1045 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:09.279603   583 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.220799   814 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.284940   435 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.285552   814 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.288316   558 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.291961 29569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 199) took 6939 ms. Trace:
I20260709 13:12:09.296367  1098 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:09.299175 29714 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:09.299975  1070 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:09.301157 29714 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:09.301898  1070 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:09.303612 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.304272 29672 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:09.305212 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.303071 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:09.307209  1070 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:09.307660  1070 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.308012  1070 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.261397 29742 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:09.315812   897 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.318542 29740 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:09.319942 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.320571 29740 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:09.321828 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:09.325250  1045 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.327463  1055 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.328478  1064 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.329382 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.388197 29673 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.388546 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:09.389276 30342 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.329618 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.330463 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.396623 29673 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:09.397931 30347 raft_consensus.cc:2368] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:12:09.399853  1181 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:09.403024  1064 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:09.334237 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.404052 30344 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:09.405428 29640 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.296391 29569 rpcz_store.cc:276] 0709 13:12:02.352146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.352939 (+   793us) service_pool.cc:224] Handling call
0709 13:12:09.291890 (+6938951us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:06.447431 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:06.450038 (+  2607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:06.450076 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:12:06.450095 (+    19us) tablet.cc:662] Decoding operations
0709 13:12:06.450780 (+   685us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:06.450844 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:06.450875 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:12:06.451376 (+   501us) tablet.cc:701] Row locks acquired
0709 13:12:06.451395 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:12:06.451537 (+   142us) write_op.cc:270] Start()
0709 13:12:06.451642 (+   105us) write_op.cc:276] Timestamp: P: 1783602726451492 usec, L: 0
0709 13:12:06.451662 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:06.452311 (+   649us) log.cc:844] Serialized 2069 byte log entry
0709 13:12:07.103371 (+651060us) op_driver.cc:464] REPLICATION: finished
0709 13:12:07.246615 (+143244us) write_op.cc:301] APPLY: starting
0709 13:12:07.256902 (+ 10287us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:07.312648 (+ 55746us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:07.326326 (+ 13678us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:07.582794 (+256468us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:07.616431 (+ 33637us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:12:07.620371 (+  3940us) write_op.cc:312] APPLY: finished
0709 13:12:07.648717 (+ 28346us) log.cc:844] Serialized 47 byte log entry
0709 13:12:07.649737 (+  1020us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:07.649842 (+   105us) write_op.cc:454] Released schema lock
0709 13:12:07.649890 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:07.650318 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:07.650350 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":965120,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":117508,"apply.run_cpu_time_us":11849,"apply.run_wall_time_us":418437,"num_ops":5,"prepare.queue_time_us":308040,"prepare.run_cpu_time_us":45359,"prepare.run_wall_time_us":256698,"raft.queue_time_us":114053,"raft.run_cpu_time_us":33390,"raft.run_wall_time_us":65041,"replication_time_us":651577,"thread_start_us":520042,"threads_started":4,"wal-append.queue_time_us":405204,"wal-append.run_cpu_time_us":7529,"wal-append.run_wall_time_us":1784371}]]}
I20260709 13:12:09.338178 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.339718 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:09.407457 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 69365.3us
I20260709 13:12:09.340621  1066 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.346922 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.407752   897 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:09.408223   897 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:09.408599   897 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.408840  1066 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.411278  1100 consensus_queue.cc:1059] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:09.412276  1100 raft_consensus.cc:3055] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:09.412680  1100 raft_consensus.cc:740] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:09.413508  1100 consensus_queue.cc:260] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.414685 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.415551  1100 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.416940   897 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.350188 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.350965 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.351397  1111 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:09.359874 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:09.419093 29674 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:09.419232 30344 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:09.419438 29818 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.420375 30316 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.421140  1169 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.360950 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:09.421682  1169 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:09.422173 29821 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:09.422653   897 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.424302  1169 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:09.425195  1195 log.cc:927] Time spent T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:12:09.361603 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:09.426465 29819 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:12:09.428797  1194 log.cc:927] Time spent T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:09.349045 29665 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:12:09.366132  1098 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:09.430575  1098 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:09.431442  1098 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:09.374293 29572 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 6, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.389333  1045 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.440174 29572 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 9, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 9 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.453465 29572 catalog_manager.cc:5697] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.293361 29666 raft_consensus.cc:2468] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:09.454949 29818 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:09.332312 30345 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:09.417207  1181 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:09.406975 30342 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:09.439098 30316 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.356586  1176 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.448014 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:09.457216  1172 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:09.457638  1172 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.457980  1172 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.458195  1176 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.458885 29821 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
I20260709 13:12:09.408941 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.460381 29673 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:09.385515 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:09.411294  1066 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:09.463431  1066 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.463959  1066 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.379554  1070 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.468035  1070 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.455137 29667 raft_consensus.cc:1275] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:09.470187  1066 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:09.449504 29819 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:09.457373   814 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:09.504360   814 raft_consensus.cc:697] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:09.499768 29572 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.505312   814 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.506229 29572 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 10, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 10 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.507822 29572 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.375149 29638 leader_election.cc:400] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11.
I20260709 13:12:09.476071 30315 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:09.477941 29740 raft_consensus.cc:1240] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:09.479203 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.509939 29742 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:09.479933 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:09.481267 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.510782 29745 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:09.482275 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.511461 29747 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
W20260709 13:12:09.484187 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 98323.6us
I20260709 13:12:09.474261 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 2109) took 1038 ms. Trace:
W20260709 13:12:09.485011 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 79671.6us
I20260709 13:12:09.513017 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.485513   936 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:09.486578 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:09.473655 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 62581.5us
I20260709 13:12:09.525614 29819 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:09.489034  1055 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:09.490646 29666 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:09.449020 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:12:09.526803 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 77859.1us
I20260709 13:12:09.527570 29789 leader_election.cc:400] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:12:09.527845 29789 leader_election.cc:403] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.498070  1172 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.533943 29789 leader_election.cc:400] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:12:09.509472 29638 leader_election.cc:403] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.513782 30345 raft_consensus.cc:2393] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:09.534299 29789 leader_election.cc:403] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.509287 29572 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 5, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:09.536123 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 161121us
I20260709 13:12:09.536285   435 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11.
I20260709 13:12:09.522574 29673 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:12:09.529042 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.536123 29572 catalog_manager.cc:5697] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 6 to 8, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.529305 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.538223 29740 raft_consensus.cc:2410] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:09.538480 29572 catalog_manager.cc:5697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 9 to 11, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 11 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.540169 30316 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.541043   457 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:09.542328 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:09.532126   936 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.543257   509 raft_consensus.cc:3060] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:12:09.543656 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:09.544063   936 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.544256 29818 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:09.539731  1169 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 4. Current term is 5.
I20260709 13:12:09.545578  1181 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:12:09.543008 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:09.550360   509 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6.
I20260709 13:12:09.551164 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:09.551828 29572 catalog_manager.cc:5697] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 3 to 5, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 5 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.553606 29572 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.555419 29745 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:09.554967 29572 catalog_manager.cc:5697] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.556999 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.557763 30342 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:09.540575 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:09.530622 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:09.531242  1176 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.531975 29640 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.523651 29667 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:09.532922 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:09.512578 29815 rpcz_store.cc:276] 0709 13:12:08.436082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.436234 (+   152us) service_pool.cc:224] Handling call
0709 13:12:08.436624 (+   390us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:09.128370 (+691746us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b1800443680. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e96654bc 00007fd9e69b348b 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cd455 00007fd9e9ab5060 00007fd9e9ab5bfb 00007fd9e9ac064b
0709 13:12:09.128498 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.128523 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:09.129105 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 13:12:09.370157 (+241052us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:09.370705 (+   548us) log.cc:844] Serialized 14 byte log entry
0709 13:12:09.469599 (+ 98894us) log.cc:844] Serialized 14 byte log entry
0709 13:12:09.469803 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.469885 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.470038 (+   153us) raft_consensus.cc:1685] finished
0709 13:12:09.470052 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.474201 (+  4149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101777,"prepare.queue_time_us":228,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":173175,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":29611,"spinlock_wait_cycles":3393792,"thread_start_us":322298,"threads_started":2,"wal-append.queue_time_us":240364}
I20260709 13:12:09.535131 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:09.573611 30316 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:09.574347 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.565614 30350 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:09.566323 29740 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:09.566850  1069 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:09.566850 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.590052   792 raft_consensus.cc:2804] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:09.590945   738 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:09.569767  1176 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:09.592387  1176 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.560197   936 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.539592  1066 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:09.577741 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:09.609545 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:09.581493 29821 raft_consensus.cc:2468] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:12:09.582168   897 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.595676 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.596889 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:09.616179 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:09.616982 29674 raft_consensus.cc:2410] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:12:09.570178  1082 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:09.576251 29818 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:09.612164   509 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:09.602556 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:09.618619  1167 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:09.625023  1167 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.625417  1167 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:09.584175  1054 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:09.632910 29666 raft_consensus.cc:2368] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:09.634349 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:09.635869 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:09.636674 30350 raft_consensus.cc:2368] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
W20260709 13:12:09.639014 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 45475.1us
I20260709 13:12:09.622745   975 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:09.657670 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:09.621515  1060 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.642716 29665 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:09.655984 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53537.9us
I20260709 13:12:09.621367  1168 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:09.631004   800 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.632432   792 raft_consensus.cc:697] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:09.676074 29715 leader_election.cc:400] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:09.676446 29715 leader_election.cc:403] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:09.677033   975 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:09.648797  1144 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:09.732512 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:09.810456 30345 raft_consensus.cc:2368] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:09.655097  1066 raft_consensus.cc:697] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:09.635844  1161 consensus_queue.cc:1048] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:12:09.727217  1100 raft_consensus.cc:3060] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:09.663122   795 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:09.631707   897 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:09.727870  1200 log.cc:927] Time spent T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:12:09.708431 29818 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:12:09.822346 29818 pending_rounds.cc:85] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 4
I20260709 13:12:09.822623 29818 pending_rounds.cc:107] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:12:09.822897 29818 raft_consensus.cc:2889] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:09.811523 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:09.671635  1060 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:09.824148 30345 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:09.818543  1158 log.cc:927] Time spent T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:12:09.677554   800 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.756384  1051 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:09.854120 30345 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:09.822108  1144 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:09.826340  1179 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.828469  1054 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:09.833953   738 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:12:09.844610   795 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:12:09.855257  1051 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.942448  1054 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.948114  1082 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:09.834578   792 consensus_queue.cc:237] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:09.945559  1212 log.cc:927] Time spent T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 13:12:09.946231  1213 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:12:09.946954  1211 log.cc:927] Time spent T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:12:09.947764  1209 log.cc:927] Time spent T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:12:09.944856  1208 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:12:09.892186  1179 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:09.951643 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 118098us
I20260709 13:12:09.955279  1062 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:09.918817   936 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:10.066562  1062 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.900413  1066 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.891501   975 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.147249   897 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:10.147897   897 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.954197  1144 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.138774  1216 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.192394  1062 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:10.193456  1172 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:10.196065 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:12:10.203123 29742 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.014s
W20260709 13:12:10.196098 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 148713us
W20260709 13:12:10.203542 29742 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.000s	sys 0.014s
I20260709 13:12:10.189164  1060 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:10.222810 29818 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:12:10.233026 29638 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.006s	sys 0.011s
W20260709 13:12:10.233469 29638 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.006s	sys 0.011s
W20260709 13:12:10.235219 29669 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.012s
W20260709 13:12:10.235642 29669 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.005s	sys 0.012s
I20260709 13:12:10.237357 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:10.148324   897 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:09.976796  1082 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:10.238123 29743 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:10.247052 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:10.230198  1168 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:10.256548 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 422752us
I20260709 13:12:10.255383 29787 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:10.242549   800 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:10.246798  1172 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.203665  1216 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:10.259703  1167 consensus_meta.cc:287] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.630s	user 0.014s	sys 0.008s
I20260709 13:12:10.266749 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:10.268185 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:12:10.250002  1176 consensus_meta.cc:287] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.006s
I20260709 13:12:10.271713 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:10.274936  1082 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:10.277549  1082 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:10.278574  1082 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:10.286330 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:10.262785   993 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:10.286514  1179 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:10.264003  1168 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:10.310307   993 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.312181  1051 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:10.285063  1167 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.283670  1172 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.335902  1168 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:10.290516  1176 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.332814   993 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:10.392756  1227 log.cc:927] Time spent T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:12:10.437212 29572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.000s	sys 0.019s
W20260709 13:12:10.438321 29572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.000s	sys 0.020s
W20260709 13:12:10.470960 29712 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.036s
I20260709 13:12:10.507354 30350 raft_consensus.cc:2368] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
W20260709 13:12:10.448210 29639 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.012s	sys 0.018s
W20260709 13:12:10.528919 29639 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.012s	sys 0.029s
I20260709 13:12:10.519459 29819 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:10.535146 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 634998us
I20260709 13:12:10.536752 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:10.620100 29673 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 12: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:10.523300 29747 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:10.628840 30345 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:10.524000   897 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:10.457767 29640 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.007s	sys 0.004s
I20260709 13:12:10.532433   435 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:12:10.469127 29670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.000s	sys 0.018s
W20260709 13:12:10.642284 29640 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.011s	sys 0.011s
W20260709 13:12:10.646301 29670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.005s	sys 0.022s
I20260709 13:12:10.627897  1172 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:10.649219 29670 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 2625) took 1051 ms. Trace:
I20260709 13:12:10.650801 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:12:10.651567 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 757232us
I20260709 13:12:10.629347  1181 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:10.652364  1246 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:10.625734  1100 consensus_meta.cc:287] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.803s	user 0.033s	sys 0.030s
I20260709 13:12:10.661422  1238 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:10.662789 29673 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:10.663954   993 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.664978 30350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 559) took 1007 ms. Trace:
I20260709 13:12:10.669864  1245 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:10.670569 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:10.670922 29741 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:10.674206 29744 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
W20260709 13:12:10.674634 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 406616us
I20260709 13:12:10.690220  1245 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.693795 29819 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:10.672289 30350 rpcz_store.cc:276] 0709 13:12:09.657195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.657397 (+   202us) service_pool.cc:224] Handling call
0709 13:12:10.664656 (+1007259us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540093e254. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:10.664830 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1950401792}
I20260709 13:12:10.695179 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:10.696693 29740 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:12:10.697671  1228 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:10.691695  1238 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:10.699944 30342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49706 (request call id 604) took 1138 ms. Trace:
I20260709 13:12:10.696638 29741 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:10.732342 29816 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:10.736521 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:10.737542 29820 raft_consensus.cc:2393] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 10: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:10.914219  1176 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:10.921803  1244 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:10.922771  1244 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.925175 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:10.722144   435 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.700395 30342 rpcz_store.cc:276] 0709 13:12:09.561403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.582434 (+ 21031us) service_pool.cc:224] Handling call
0709 13:12:09.587542 (+  5108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.632122 (+ 44580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.643921 (+ 11799us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:09.735008 (+ 91087us) log.cc:844] Serialized 26 byte log entry
0709 13:12:10.283961 (+548953us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:10.290632 (+  6671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.308805 (+ 18173us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:10.699470 (+390665us) raft_consensus.cc:1685] finished
0709 13:12:10.699507 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.699717 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105127,"raft.queue_time_us":44862,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10115,"thread_start_us":440753,"threads_started":1,"wal-append.queue_time_us":877906}
I20260709 13:12:10.723749  1238 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:10.687696  1100 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:10.983512 29820 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:10.979441 29741 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:10.929785  1181 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.025130 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51152 (request call id 2135) took 1496 ms. Trace:
I20260709 13:12:10.979059  1176 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:11.025647 29819 rpcz_store.cc:276] 0709 13:12:09.528544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.530405 (+  1861us) service_pool.cc:224] Handling call
0709 13:12:11.024854 (+1494449us) spinlock_profiling.cc:243] Waited 940 ms on lock 0x7b540041da54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:11.025028 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2161664768}
I20260709 13:12:10.975215  1244 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.053813  1226 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:10.966879  1172 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:12:11.059070   993 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:10.996762  1246 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.066411  1167 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:11.054688  1226 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.064821   975 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:11.165352  1246 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:11.063509  1176 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:11.174256  1231 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:12:11.116875  1216 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.176193  1176 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:11.176381  1181 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:11.166652   435 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.177201   975 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.166790  1245 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.185051  1226 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.195379   975 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.268229 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:11.281045 30345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 563) took 1015 ms. Trace:
I20260709 13:12:11.281526 30345 rpcz_store.cc:276] 0709 13:12:10.265965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.266471 (+   506us) service_pool.cc:224] Handling call
0709 13:12:11.280719 (+1014248us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54004df654. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:11.280971 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541580544}
I20260709 13:12:11.320083   435 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.320850   435 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.322034 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:11.323488  1238 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:11.323899 29638 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:11.324538   435 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:11.332909  1239 log.cc:927] Time spent T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.658s	user 0.003s	sys 0.000s
I20260709 13:12:11.342015  1260 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:11.342836  1260 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.345350  1260 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.368916 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:11.369997 29673 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:11.364547 29638 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:11.374228  1217 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:11.374660  1217 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.375722  1217 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.374702 29665 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 2623) took 1779 ms. Trace:
I20260709 13:12:11.377271 29665 rpcz_store.cc:276] 0709 13:12:09.594684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.595350 (+   666us) service_pool.cc:224] Handling call
0709 13:12:09.595668 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.642567 (+ 46899us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:09.729545 (+ 86978us) log.cc:844] Serialized 14 byte log entry
0709 13:12:09.837243 (+107698us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b48000030d8. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ee9e6aa1 00007fd9ee9ddb37 00007fd9ee9dd9ca 00007fd9eead526f 00007fd9eead4f37 00007fd9eeae955c 00007fd9eeae9508 00007fd9eeae9488 00007fd9eeae9443 00007fd9eeae86ec 00007fd9eda12a96
0709 13:12:10.210957 (+373714us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:10.235418 (+ 24461us) log.cc:844] Serialized 26 byte log entry
0709 13:12:10.235765 (+   347us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:10.627718 (+391953us) log.cc:844] Serialized 14 byte log entry
0709 13:12:10.661537 (+ 33819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.661609 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:11.374282 (+712673us) raft_consensus.cc:1685] finished
0709 13:12:11.374314 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.374515 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51361,"prepare.queue_time_us":818605,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":29891,"raft.queue_time_us":69423,"raft.run_cpu_time_us":2181,"raft.run_wall_time_us":222852,"spinlock_wait_cycles":6041344,"thread_start_us":735838,"threads_started":2,"wal-append.queue_time_us":580524}
I20260709 13:12:11.388878  1245 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:11.388700  1261 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:11.389026  1216 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:11.389624  1245 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.390481  1216 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.391897 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:11.389822  1261 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.393792 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:11.391973  1245 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.392643  1216 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.396606  1261 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.398845  1217 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.401178  1217 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.411481 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:11.837011  1217 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.841378 29748 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 12.
I20260709 13:12:11.835829  1216 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:11.841151  1245 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.849655  1216 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.855474 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:11.856356 29748 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.846287  1217 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.862262  1245 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:11.863551  1217 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.865026  1245 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:12:11.861654  1216 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.865737  1245 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:11.881091  1245 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.882319 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:11.883374 29815 raft_consensus.cc:2393] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 11: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:11.883903 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52208 (request call id 1132) took 1158 ms. Trace:
I20260709 13:12:11.884325 29815 rpcz_store.cc:276] 0709 13:12:10.729604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.909369 (+179765us) service_pool.cc:224] Handling call
0709 13:12:11.883823 (+974454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:11.883519  1245 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.886695 29748 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:11.889580 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:11.890399 29638 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:11.891410 29748 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:11.892887 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:11.893497  1266 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:11.895457  1217 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:11.895903  1217 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.896253  1217 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:11.896922  1266 raft_consensus.cc:697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:11.898183  1266 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.910709  1217 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:11.913254 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 1.64141e+06us
I20260709 13:12:11.915334 29715 leader_election.cc:400] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
W20260709 13:12:11.916034 29669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.255s	user 0.017s	sys 0.022s
W20260709 13:12:11.916550 29669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.017s	sys 0.022s
I20260709 13:12:11.916741 29715 leader_election.cc:400] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:11.924934  1217 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.930403 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:11.931655 29748 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:11.939383 29748 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 12.
I20260709 13:12:11.941092 29748 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:11.942708 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:11.943882  1261 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:11.944473  1261 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:11.944240 29666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 2628) took 1294 ms. Trace:
I20260709 13:12:11.945482  1261 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.945672 29666 rpcz_store.cc:276] 0709 13:12:10.654271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.670493 (+ 16222us) service_pool.cc:224] Handling call
0709 13:12:10.670846 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:11.869094 (+1198248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:11.869133 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:11.869207 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:11.869250 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.943864 (+ 74614us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001a4ad4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:11.943906 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.944071 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2754977152}
I20260709 13:12:11.953054  1217 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:11.953780  1217 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.955935  1217 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.944521 29715 leader_election.cc:400] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:11.962443 29715 leader_election.cc:403] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:12:11.965723  1216 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:11.966495  1216 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:11.967686 29786 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.008s	sys 0.017s
W20260709 13:12:11.968191 29786 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.008s	sys 0.018s
I20260709 13:12:11.968703  1216 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.979629  1216 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:11.980443   435 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:11.982041  1265 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:11.982712  1265 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.984977  1265 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.986385  1245 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:11.987010  1245 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.988787  1265 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:11.989535  1265 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:11.993193  1265 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.991326  1245 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:11.993960  1245 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.994510  1245 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:11.996541  1245 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:11.999625 29742 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2353) took 2402 ms. Trace:
I20260709 13:12:12.003409   509 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.078349   509 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.080765   509 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.005131   980 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.153133 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.006152 29742 rpcz_store.cc:276] 0709 13:12:09.596952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.597382 (+   430us) service_pool.cc:224] Handling call
0709 13:12:09.603392 (+  6010us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:09.645965 (+ 42573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.646000 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:09.649234 (+  3234us) log.cc:844] Serialized 26 byte log entry
0709 13:12:10.203990 (+554756us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:10.204029 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.392065 (+188036us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:12:11.999068 (+1607003us) spinlock_profiling.cc:243] Waited 41.3 ms on lock 0x7b54003ba454. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:11.999148 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:11.999199 (+    51us) raft_consensus.cc:1685] finished
0709 13:12:11.999210 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:11.999428 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":840,"raft.queue_time_us":4639,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":14825,"spinlock_wait_cycles":101986432,"thread_start_us":554429,"threads_started":1,"wal-append.queue_time_us":634087,"wal-append.run_cpu_time_us":21122,"wal-append.run_wall_time_us":1424463}
I20260709 13:12:12.016909  1265 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:12.155475 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.023612   953 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.024740  1270 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.032975  1271 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.036084 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:11.105114 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:12.047879  1260 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.053144  1259 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.048434 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.057860  1266 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.059981  1261 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:12.062958 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.064977 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.068832  1273 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:12.101502  1251 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.994s	user 0.001s	sys 0.000s
I20260709 13:12:12.107183 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.141475  1280 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.147431 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.150934 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.151713 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:12.152942   980 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.001070 29746 raft_consensus.cc:2468] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:12.155633  1265 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.153810 29665 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:12.152637 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:12.200696 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 60526.9us
W20260709 13:12:12.178354 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 106099us
I20260709 13:12:12.179060 29815 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:12.195278  1283 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.198832 29671 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:12.198108 29749 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:12.179239  1274 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.180708 29816 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:12.206883 29817 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:12.221056 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.220793  1280 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:12.222582  1274 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.223150  1284 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.223254   509 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.223943   509 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.224642   980 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.196197  1271 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.225186  1245 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.225983  1277 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.226169  1261 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.227221  1271 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.227007  1277 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.227782  1271 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.228667  1276 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.215775 30342 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 12: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:12.229262  1277 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:12.229512 30342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49712 (request call id 879) took 1543 ms (client timeout 1688 ms). Trace:
W20260709 13:12:12.230073 30342 rpcz_store.cc:269] 0709 13:12:10.989664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:11.031448 (+ 41784us) service_pool.cc:224] Handling call
0709 13:12:12.229422 (+1197974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:12.226382  1245 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.232760  1245 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.232802  1265 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.207304   953 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.234311 29669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 2626) took 1705 ms. Trace:
I20260709 13:12:12.230041  1277 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.207509  1278 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.223959  1284 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.236541  1277 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.234719 29669 rpcz_store.cc:276] 0709 13:12:10.529522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.655342 (+125820us) service_pool.cc:224] Handling call
0709 13:12:10.659402 (+  4060us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:10.660066 (+   664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:10.660115 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:10.660824 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 13:12:11.916967 (+1256143us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:12:11.978797 (+ 61830us) log.cc:844] Serialized 14 byte log entry
0709 13:12:11.979972 (+  1175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:11.983572 (+  3600us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:12.100715 (+117143us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:12:12.233991 (+133276us) raft_consensus.cc:1685] finished
0709 13:12:12.234088 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.234235 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30499,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":1737,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":271,"spinlock_wait_cycles":13588096,"thread_start_us":1316916,"threads_started":2,"wal-append.queue_time_us":399949}
I20260709 13:12:12.225893   509 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.228365  1271 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.220186 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.228436  1261 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.236091   953 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.224642  1280 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.217705  1270 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.261727 29821 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 2142) took 1631 ms. Trace:
I20260709 13:12:12.261647  1282 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.263669  1271 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.267094  1277 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.268045  1275 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:12.268595  1261 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:12.270051  1281 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:12.229187  1266 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.229430  1260 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.217950  1259 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:12.312223 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 70891.5us
I20260709 13:12:12.218080  1273 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.206342  1283 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.271921 29821 rpcz_store.cc:276] 0709 13:12:10.631332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.638122 (+  6790us) service_pool.cc:224] Handling call
0709 13:12:10.648272 (+ 10150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:10.649164 (+   892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:10.649200 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:10.650159 (+   959us) log.cc:844] Serialized 26 byte log entry
0709 13:12:10.725400 (+ 75241us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:12:10.725439 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.725512 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:12.261356 (+1535844us) raft_consensus.cc:1685] finished
0709 13:12:12.261376 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.261544 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5163,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":316,"thread_start_us":73884,"threads_started":1,"wal-append.queue_time_us":452603,"wal-append.run_cpu_time_us":2224,"wal-append.run_wall_time_us":1073926}
I20260709 13:12:12.294145  1281 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.291865   953 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.242688  1276 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.293730  1280 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.237098  1278 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.330929   509 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.336609  1286 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.329383  1281 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:12.336493   509 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.291617  1282 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.346989  1288 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.337230  1286 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.325893  1261 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.364288  1261 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.334676  1280 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.333956   980 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.385465  1289 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.361634 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:12.388104  1245 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:12.388618  1271 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:12:12.390856 29714 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.67:34899 timed out after 1.971s (SENT) [suppressed 18 similar messages]
I20260709 13:12:12.384750 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.379518   953 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.408097 30350 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:12.411854   509 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.413697   509 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.413570 29666 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:12.422976   509 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.426723 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:12.427476 29672 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.427945  1259 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.428229  1291 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.428503  1259 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.442348 29674 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:12:12.427522 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.444633 29671 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
W20260709 13:12:12.449638 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 229500us
I20260709 13:12:12.451325 30345 raft_consensus.cc:2368] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
I20260709 13:12:12.407757  1292 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.407693  1287 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.415382  1265 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.454685 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.459256 29749 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:12.426656  1296 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.423957  1216 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:12.406064  1275 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:12:12.465227  1270 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:12.464251 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 78391.5us
I20260709 13:12:12.466557  1278 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.466866 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:12.470727  1283 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.472101  1273 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.474720   509 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.407454  1288 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.476696 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.464437 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.476325  1265 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.478911 29672 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:12.481537 29673 raft_consensus.cc:1275] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:12:12.469456 29821 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.478912 29742 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:12.411788   980 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.417634  1245 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.453858 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:12.428838  1291 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.496311 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.423767  1271 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.494354   509 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:12.459980  1290 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.459134  1274 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.458935  1284 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.476719  1299 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.497225 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.481132  1217 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.481097  1275 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.414487  1289 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.493571  1278 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.490100  1296 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:10.655556 29670 rpcz_store.cc:276] 0709 13:12:09.597574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.597729 (+   155us) service_pool.cc:224] Handling call
0709 13:12:09.598112 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:09.602722 (+  4610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:09.602759 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:09.603410 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 13:12:09.809429 (+206019us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b18003a3f00. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d0d1 00007fd9e9a78a0f
0709 13:12:10.648324 (+838895us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:10.648466 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:10.648631 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:10.648695 (+    64us) raft_consensus.cc:1685] finished
0709 13:12:10.648712 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:10.649120 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4062,"raft.queue_time_us":33977,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7396,"spinlock_wait_cycles":9935104,"thread_start_us":838310,"threads_started":1,"wal-append.queue_time_us":710647,"wal-append.run_cpu_time_us":1930,"wal-append.run_wall_time_us":1002101}
W20260709 13:12:12.506491 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 146756us
W20260709 13:12:12.523331 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 56625.6us
I20260709 13:12:12.505689 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.506356  1290 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.568915  1275 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.546623  1291 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.525420   953 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.566262 29674 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:12.527304  1288 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.514690  1276 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.568600  1217 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.570549  1245 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.522465 30341 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:12.572654  1290 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.573603  1275 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.571648  1291 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:12:12.602725  1293 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:12.603385  1293 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.604104  1296 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.499172  1292 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.605558  1293 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.571722 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.524461  1302 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.617689  1302 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.618337 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.618997 29818 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
W20260709 13:12:12.619840 29788 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.620031  1302 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.549070 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.621068  1280 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.547096   980 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.575337 30350 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:12.574906 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.498799 30342 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.584899 30345 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:12.502401  1287 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.598244  1276 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:12.587460  1281 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.606634  1292 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.574445 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.610881  1286 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.523311  1265 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.620853 30344 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:12.574542 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.616046  1299 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.588613  1278 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:12.631795 29746 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 1097) took 2436 ms (client timeout 1588 ms). Trace:
I20260709 13:12:12.678905  1096 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:12.679986 29746 rpcz_store.cc:269] 0709 13:12:10.195676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:10.195796 (+   120us) service_pool.cc:224] Handling call
0709 13:12:12.631474 (+2435678us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54002d41d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:12.631662 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918629760}
I20260709 13:12:12.638995  1260 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.639564 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.639810  1300 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.640376 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:12.526672  1282 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.640597  1284 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.495982  1259 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.641114 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:12.704444 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 199254us
I20260709 13:12:12.618304 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.645879 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.638907 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.648200 30349 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:12.697613 29816 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.705888 29815 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:12.711350 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.712018 29815 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:12.714468 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.715104 30345 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:12.725140 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.731011 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.723237  1299 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.733194 29822 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:12.737900 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.716446  1292 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.739619 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.707861  1096 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.744689  1289 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.749264  1278 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.752579 30315 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:12.753806  1276 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:12.754222  1276 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.754583  1276 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.722059  1300 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.730212  1284 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.761761 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.760089 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.761531  1278 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:12:12.765956 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.766589 29822 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:12.770059  1287 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.748726  1292 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.772794 30315 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:12.773931  1287 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:12.774331  1287 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.774420  1300 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.774727  1287 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:12.774998 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 136190us
I20260709 13:12:12.775874   953 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:12.776259   953 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.776620   953 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:12.779374  1259 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.767249  1281 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.779943 29560 maintenance_manager.cc:643] P fa34c50a94a64ecc89d5a56c3ce9a26a: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.493s	user 0.154s	sys 0.073s Metrics: {"bytes_written":30046,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":33094,"dirs.run_cpu_time_us":443,"dirs.run_wall_time_us":3207,"drs_written":1,"lbm_read_time_us":330,"lbm_reads_lt_1ms":4,"lbm_write_time_us":34201,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":78232,"threads_started":2,"update_count":12,"wal-append.queue_time_us":148212}
I20260709 13:12:12.775687 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.782488 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:12.783241  1289 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:12.783638  1289 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.784029  1289 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:12.784840  1270 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:12.784763  1276 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.787721 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.787891  1096 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.788393 29820 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:12:12.789371 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.790407 30315 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:12.793830 29746 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:12.797503  1217 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.798447 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:12.767457 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.800130 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.801795  1292 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.802414 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.804402 29740 raft_consensus.cc:3060] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.802804 30342 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:12.808257  1271 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.802304  1305 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:12.811084 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2366) took 1420 ms. Trace:
I20260709 13:12:12.812747 29749 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:12.775671  1284 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.813246 29819 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:12.834981 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.835573 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.836637 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.837194 29819 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:12.813844 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.814589 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.839489 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.839627 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.840272 29747 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:12:12.841168 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.841768 29742 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:12.842955  1284 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.842842 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.843540  1284 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.844225 29741 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:12.845948  1284 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.848448 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.850046 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.851176 29715 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.852322 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.853770 29561 maintenance_manager.cc:419] P fa34c50a94a64ecc89d5a56c3ce9a26a: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10606 bytes on disk
I20260709 13:12:12.855063  1276 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.856132 30350 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:12.856298 29560 maintenance_manager.cc:643] P fa34c50a94a64ecc89d5a56c3ce9a26a: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":291,"lbm_reads_lt_1ms":4}
I20260709 13:12:12.857051  1305 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:12.857475  1305 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:12.861824  1289 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.862357 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.836817   953 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:12.360512 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:12.866240 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.818231  1266 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.820595 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.826575 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.828104 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:12.829237 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 166527us
I20260709 13:12:12.874675 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.829362  1259 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.831014 29740 raft_consensus.cc:2468] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:12.831766 29816 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:12.832070 29744 rpcz_store.cc:276] 0709 13:12:11.391050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.090020 (+698970us) service_pool.cc:224] Handling call
0709 13:12:12.091297 (+  1277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:12.336489 (+245192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.336525 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:12:12.336589 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:12:12.336618 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.810832 (+474214us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540029b154. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:12.810880 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:12.811001 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558966528}
I20260709 13:12:12.864049  1289 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.843595 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.888195 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:12.864794 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:12.866899 29819 raft_consensus.cc:2468] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:12.867866 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.816915 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50490 (request call id 309) took 10257 ms. Trace:
I20260709 13:12:12.892263 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.876665 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.878769 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.878965 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.894321 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.879477 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.879747 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.873121  1271 raft_consensus.cc:2764] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:12:12.902154 29715 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:12.880688 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.893525 30346 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:12.903950  1314 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:12.904498  1314 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.904850  1314 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.904172 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.907014 29638 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.907891  1292 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:12.908281  1292 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:12.908648  1292 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.912565  1274 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:12.913120  1274 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:12.913520  1274 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:12.912789  1314 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:12.916576  1314 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:12.918455 29638 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.919224  1217 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:12.919344 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.919708  1217 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:12.920279  1217 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:12.927008 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:12.927639 29816 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:12.863988  1287 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.881755 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.882407 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.882961 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.896852 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.931631 29740 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:12.899356 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:12.881181 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:12.902074 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 156500us
I20260709 13:12:12.930612 29820 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:12.931171 29817 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:12.934767 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.936553 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.937996 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:12.938552 29746 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:12:12.938977 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 45989us
I20260709 13:12:12.930413 30316 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.937883 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.939934 29819 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:12.941550 29821 raft_consensus.cc:2368] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:12.942301 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:12.942806 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.943722   457 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:12:12.947487 29741 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:12.948395 30315 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:12.948554 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:12.945787 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 43728.7us
I20260709 13:12:12.955757 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:12.927542  1266 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.959925 29816 raft_consensus.cc:2468] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:12.967931 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.968420 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.970911 30315 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:12.935913  1281 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:12.967113 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.950570 30316 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.974385 29668 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:12.970475 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:12.973238 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.974346 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.977099 29815 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:12.967332  1302 consensus_queue.cc:1048] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:12:12.978170 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:12.978351 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:12.978737 29742 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:12:12.979364 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.980537 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.981065 29820 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
I20260709 13:12:12.934736  1259 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.982066  1096 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:12.982645  1096 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:12.984002  1259 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.984640  1096 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:12.988183  1286 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:12.988517 29787 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:12.989630  1286 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:12.989902  1309 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:12.990296 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.991247 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:12.991429 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.992166 29814 raft_consensus.cc:2393] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:12.992354 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.992931 29818 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:12.993371 29747 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:12.994809 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.994975 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:12.944619  1288 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:12.996477 29817 raft_consensus.cc:2368] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
W20260709 13:12:12.996232 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 63026us
I20260709 13:12:12.979671 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:12.992890 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:13.001333 29742 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:12.996153 29822 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:13.004796 29822 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:12.997334 29787 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:12.996243 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:13.008507  1297 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.009012  1297 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.009333  1297 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:13.010011 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa8e0 after lost signal to thread 28568
W20260709 13:12:13.011052 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb0e0 after lost signal to thread 29606
W20260709 13:12:13.012269 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6160 after lost signal to thread 29698
W20260709 13:12:13.012537 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08003a55a0 after lost signal to thread 29699
W20260709 13:12:13.013523 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef340 after lost signal to thread 29773
I20260709 13:12:13.013000 29569 catalog_manager.cc:5697] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 10 to 12, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.001358 29639 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:13.015038   953 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:12.958343  1265 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.016455 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:13.006011 29743 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:13.003453 30315 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
W20260709 13:12:13.027247 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 50583.3us
I20260709 13:12:13.002313 29814 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:12.974869 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.030109 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.030714 29673 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:12:13.031333 29823 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:13.021490 29746 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 12.
W20260709 13:12:13.013832 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08003eef00 after lost signal to thread 29774
I20260709 13:12:13.032673 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:13.016752 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:13.033864 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08003eeb80 after lost signal to thread 29847
I20260709 13:12:13.000711 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
W20260709 13:12:13.035072 30371 debug-util.cc:398] Leaking SignalData structure 0x7b080030b180 after lost signal to thread 29848
I20260709 13:12:13.018366 29569 catalog_manager.cc:5697] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 10, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:13.036312 30371 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2720 after lost signal to thread 30374
W20260709 13:12:13.036684 30371 debug-util.cc:398] Leaking SignalData structure 0x7b080020b280 after lost signal to thread 30375
I20260709 13:12:12.975236  1291 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:12.972038  1282 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.045868 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.044304 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:13.049975 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 52714.9us
I20260709 13:12:13.042776 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.975070  1281 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:13.016978  1288 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.049221 29674 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:13.045112 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:13.052009 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 101512us
I20260709 13:12:13.045784 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.058743 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.048333 29669 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:13.056034 29639 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.024475  1259 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.033874  1275 raft_consensus.cc:2804] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:13.058589 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.070441 29823 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:13.068624 29670 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:13.025101  1265 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:13.079389   457 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.092972   457 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:13.093382   457 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:13.079313 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 82423.2us
I20260709 13:12:13.073899 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.095810 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.084930 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.078009 29820 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:13.088989 29672 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:13.040663  1261 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.046154  1245 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:12.892557 29572 rpcz_store.cc:276] 0709 13:12:02.559113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:02.559535 (+   422us) service_pool.cc:224] Handling call
0709 13:12:03.894475 (+1334940us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400310010. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e69990b2 00007fd9ef912a89 00007fd9ef8aada6 00007fd9ef87c088 00007fd9ef97a37e 00007fd9ede3b2a4 00007fd9ede3b232 00007fd9ede3b161 00007fd9ede3b0dc
0709 13:12:12.816799 (+8922324us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:11.110046 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:11.114238 (+  4192us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:11.114299 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:12:11.114334 (+    35us) tablet.cc:662] Decoding operations
0709 13:12:11.158024 (+ 43690us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:11.158119 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:11.158139 (+    20us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:12:11.164046 (+  5907us) tablet.cc:701] Row locks acquired
0709 13:12:11.164098 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:12:11.164508 (+   410us) write_op.cc:270] Start()
0709 13:12:11.164697 (+   189us) write_op.cc:276] Timestamp: P: 1783602731164380 usec, L: 0
0709 13:12:11.164732 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:12:11.183963 (+ 19231us) log.cc:844] Serialized 4796 byte log entry
0709 13:12:11.205103 (+ 21140us) op_driver.cc:464] REPLICATION: finished
0709 13:12:11.208188 (+  3085us) write_op.cc:301] APPLY: starting
0709 13:12:11.208319 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:11.209539 (+  1220us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:11.209720 (+   181us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:11.211149 (+  1429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:11.211601 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:12:11.211671 (+    70us) write_op.cc:312] APPLY: finished
0709 13:12:11.212173 (+   502us) log.cc:844] Serialized 89 byte log entry
0709 13:12:11.212407 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.212577 (+   170us) write_op.cc:454] Released schema lock
0709 13:12:11.212673 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:11.213339 (+   666us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:11.213371 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":28,"spinlock_wait_cycles":50003584,"child_traces":[["op",{"apply.queue_time_us":2791,"apply.run_cpu_time_us":5035,"apply.run_wall_time_us":5037,"num_ops":12,"prepare.queue_time_us":1445746,"prepare.run_cpu_time_us":9379,"prepare.run_wall_time_us":157126,"raft.queue_time_us":2826,"raft.run_cpu_time_us":3127,"raft.run_wall_time_us":3164,"replication_time_us":40143,"thread_start_us":892463,"threads_started":4,"wal-append.queue_time_us":10820,"wal-append.run_cpu_time_us":6402,"wal-append.run_wall_time_us":1019885}]]}
I20260709 13:12:13.097272   435 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.104394   435 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:13.104828   435 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.097981 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.052415   980 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:13.100167 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.096758 29639 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:12.999630  1266 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.055401  1291 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.114723 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.078389  1288 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.066939  1294 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:13.067893  1281 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.094393  1282 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:13.070215  1290 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.119304 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.076400  1259 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:13.117269 29667 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:13.124897 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.124907 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.126024 29665 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:13.129691 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.084710  1279 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:13.097343  1265 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:13.134968 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 106976us
I20260709 13:12:13.086081  1293 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.089154  1096 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:12:13.089293  1298 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:12:13.101755 29569 catalog_manager.cc:5697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:13.109726 30341 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:13.189713 30350 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:12:13.227633 30344 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:13.226312 29742 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:13.208796 29638 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:13.138625 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.234226 29789 leader_election.cc:400] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
I20260709 13:12:13.234687 29789 leader_election.cc:403] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:13.228118 29671 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:13.112016  1245 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:13.124975  1238 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:13.127987  1291 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.243175  1286 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10.
I20260709 13:12:13.249318 30316 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:13.246941 29789 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:13.245837  1245 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.230733  1293 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:13.259562  1293 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:13.169772  1260 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:12:13.163128  1278 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:13.131178  1294 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:12:13.228670 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 117257us
I20260709 13:12:13.116298  1217 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.221789  1287 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.135671  1111 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:13.283166 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.194655 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.249624 29569 catalog_manager.cc:5697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.245539  1261 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.245028  1299 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:12:13.236456  1290 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.280273 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.133811  1301 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:13.298314 30345 raft_consensus.cc:2410] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:12:13.228672  1279 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:13.303994 29673 raft_consensus.cc:2368] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:13.289292 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:13.247437  1238 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.220582  1319 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:12:13.274137 30316 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.231693  1259 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.315737 30316 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.262676   953 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:12:13.273066  1294 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.261809  1260 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:13.310544 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:13.272739 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.271817  1278 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:13.342823 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 102636us
W20260709 13:12:13.345597 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 209334us
I20260709 13:12:13.332110  1287 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:13.335433 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.319905 29569 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
W20260709 13:12:13.305728 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 219863us
I20260709 13:12:13.336510 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.324699   457 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.312971  1238 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.357627 30348 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 11: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
W20260709 13:12:13.358422 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 299122us
I20260709 13:12:13.302556  1290 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.330166 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.331636  1276 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:13.348536 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.309540  1279 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.359896   457 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.344456 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.346886 29638 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.292371  1111 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.311332  1301 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.359338 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:13.371189 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:13.339089  1275 raft_consensus.cc:697] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:13.346750  1286 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:13.346308 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.373680   457 consensus_queue.cc:1059] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:12:13.396325 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.355213  1287 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:13.360092 29569 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.403206 30345 raft_consensus.cc:2393] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 12: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:13.373195 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.364550  1276 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:13.408461 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.350662  1274 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.366503  1260 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.415822  1333 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:13.422376 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:13.423194 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:13.423305  1111 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.404706  1266 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.462754  1333 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:13.473489  1333 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:13.337872  1282 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.372952  1271 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:13.432246 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:13.397490  1292 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.415067 29569 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 9, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:13.427927 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58865.7us
I20260709 13:12:13.401021  1287 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:13.484581   435 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:13.462778 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 92724.8us
I20260709 13:12:13.469509  1328 raft_consensus.cc:3055] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:13.398132  1299 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:12:13.471966 29820 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 12: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:13.435005  1217 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.426716   953 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:13.481962 29672 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:13.437152  1276 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.426301  1325 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:13.436156  1286 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:13.483183 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:13.486833 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 90213.6us
I20260709 13:12:13.495568 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:13.496894 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 152511us
W20260709 13:12:13.497824 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 127442us
I20260709 13:12:13.472061  1322 raft_consensus.cc:2804] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:13.501331   435 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.497543 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.435847  1304 consensus_queue.cc:1059] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.208s
I20260709 13:12:13.505350 29569 catalog_manager.cc:5697] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:13.488170  1328 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:13.509569 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:13.513813  1299 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:13.514305  1299 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:13.515189  1299 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:13.516369  1299 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.494670   953 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:13.525156 29569 catalog_manager.cc:5697] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 5, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 5 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.486255  1297 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.485392  1271 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.525202   953 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:13.534163  1332 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:12:13.536404  1328 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.538370 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.508915 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.572847 29569 catalog_manager.cc:5697] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:13.577593 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 80189.4us
W20260709 13:12:13.586577 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 89085us
I20260709 13:12:13.587070 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.587293 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.588517 29569 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 10 to 12, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.591113 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.594580 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:13.595033 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 87873.7us
I20260709 13:12:13.609262  1353 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.608696  1279 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.507936  1275 consensus_queue.cc:237] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.615046 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.615029 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:13.618598 29569 catalog_manager.cc:5697] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.592204  1278 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:13.621583 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:13.626453  1279 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.628311   953 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:13.630342  1305 consensus_meta.cc:287] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.772s	user 0.011s	sys 0.000s
I20260709 13:12:13.630810  1305 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.631843 30349 raft_consensus.cc:1240] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 4. Current term is 5. Ops: []
I20260709 13:12:13.632964  1305 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.636786 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.615813  1353 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:13.643965  1353 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.624486 29569 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:13.668705 29569 catalog_manager.cc:5697] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:13.670423 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 99848.6us
I20260709 13:12:13.645025  1304 consensus_queue.cc:1243] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:13.680022 29569 catalog_manager.cc:5697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:13.654378  1322 raft_consensus.cc:697] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:12:13.692477 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 187884us
I20260709 13:12:13.672580  1274 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.636893  1245 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:13.728369 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 111201us
I20260709 13:12:13.674638  1261 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:13.730863 29569 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:13.740139 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46898.4us
I20260709 13:12:13.740903 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.689690  1260 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.699836  1292 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.699425  1301 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.755883 29638 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:13.756456  1341 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:13.756904  1271 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.738102  1286 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:12:13.757493 30314 connection.cc:256] RPC call timeout handler was delayed by -2.0137521369998694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:12:13.760227  1290 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.761389  1297 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:13.754856 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 60543.2us
I20260709 13:12:13.733393 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:12:13.744501  1265 consensus_meta.cc:287] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
W20260709 13:12:13.769626 30314 connection.cc:256] RPC call timeout handler was delayed by -1.6927370119999523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:12:13.778827 30314 connection.cc:256] RPC call timeout handler was delayed by -1.6038542620000271s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:12:13.773954 29569 catalog_manager.cc:5697] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:13.762760   980 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:13.803782 30315 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:13.805433  1352 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:12:13.800360  1339 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:12:13.806237  1349 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:13.800680  1075 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:13.820690  1075 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:13.821210  1075 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:13.822067  1322 consensus_queue.cc:237] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.801275  1265 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.739871  1261 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.825837 29744 raft_consensus.cc:1240] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:13.809213  1293 consensus_meta.cc:287] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:12:13.815424 29640 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:13.780810  1292 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:13.775441   953 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.852528  1245 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:13.865337  1281 consensus_meta.cc:287] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.676s	user 0.000s	sys 0.007s
I20260709 13:12:13.867762  1292 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:13.868203 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.868865 29673 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:13.868978 30342 raft_consensus.cc:1240] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:13.869784 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.871239 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.805608 30347 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:13.873127 30347 raft_consensus.cc:606] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:13.873509 30347 raft_consensus.cc:614] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:13.873649 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.833541  1265 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.834622  1261 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.818500  1349 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:13.874732  1349 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:13.875483 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.876156 29673 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:13.876986 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.836640  1238 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.839844  1075 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.845218 29640 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:13.778548  1259 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.879108 29640 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:13.879657  1259 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:13.819176  1217 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:12:13.846765  1363 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:13.868880  1292 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.880992  1260 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:13.881147  1293 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.882299  1217 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:13.882670  1217 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:13.877737 29673 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:13.880342 29640 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:13.846062  1348 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:13.820724  1288 consensus_meta.cc:287] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.004s
W20260709 13:12:13.883695 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 54805us
I20260709 13:12:13.803481 29569 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 5 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 7 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.910946 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.912168 29569 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 10 to 11, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 11 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:13.913357 29569 catalog_manager.cc:5697] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 10, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:13.914570 30314 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:13.922621 29569 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 5 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:13.879626  1075 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.880362  1259 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:12:13.925791 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 329911us
I20260709 13:12:13.924901 29569 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:13.930922 29569 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:13.933307 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:13.879583  1238 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.883363  1293 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.887079  1281 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.888475  1266 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:13.942657 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:13.943015 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:13.856560  1353 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.951114 30314 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:13.956462 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.957420 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.942523  1357 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:13.981391  1357 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:13.981834  1357 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:13.962370  1353 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.982163 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.915313  1288 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.983362 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.984041 29674 raft_consensus.cc:2468] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:13.984916 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.985217  1288 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:13.992062  1349 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:13.996763 29666 raft_consensus.cc:2393] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:13.962878 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:13.965291 30346 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:13.966686 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:13.888062  1333 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.974603  1305 raft_consensus.cc:2764] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:12:13.955817  1301 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:12:13.977361 29668 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:13.978694 30349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49712 (request call id 886) took 1158 ms. Trace:
I20260709 13:12:13.979019  1276 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.904567  1217 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:13.917883  1275 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:12:14.064877 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:14.067602 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:14.068529 29670 raft_consensus.cc:2393] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 11: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:14.024953 30346 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
W20260709 13:12:14.046955 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 95919.6us
W20260709 13:12:13.959591  1291 consensus_meta.cc:287] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.000s
W20260709 13:12:13.994298  1294 consensus_meta.cc:287] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 13:12:14.054133 30349 rpcz_store.cc:276] 0709 13:12:12.820584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.821069 (+   485us) service_pool.cc:224] Handling call
0709 13:12:12.821355 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.632207 (+810852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:13.978470 (+346263us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b5400385754. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:13.978631 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863621888}
I20260709 13:12:14.075954 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.076124 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:13.996407  1287 consensus_meta.cc:287] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.005s
I20260709 13:12:14.082727 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.082895 30314 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.083559 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:14.071301 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.073081 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.079114 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:13.977440   980 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:14.083604 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.086616 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.087203 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:14.087930 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.102711 29745 raft_consensus.cc:2368] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11.
I20260709 13:12:14.088557  1333 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:14.088835 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.104007 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.089517 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.090499 29666 raft_consensus.cc:1240] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:12:14.088591 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.092115 29715 leader_election.cc:400] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:14.105026 29715 leader_election.cc:403] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:14.092689 29674 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:14.093304   435 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.093668   980 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.094169 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.094805  1353 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:14.096275 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.097019 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.096994 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.094983 29749 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:14.115468 29820 raft_consensus.cc:2393] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
W20260709 13:12:14.126976 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44423us
I20260709 13:12:14.117242 29674 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.121142 29667 raft_consensus.cc:1240] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.132403 30344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49712 (request call id 892) took 1037 ms. Trace:
I20260709 13:12:14.115497 29746 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
W20260709 13:12:14.133898 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58620.5us
I20260709 13:12:14.131378  1279 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:14.135953  1289 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:14.102095  1287 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.139014  1287 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:14.139269 29715 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.131738  1300 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:14.140242 29670 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.135951 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.132761 30344 rpcz_store.cc:276] 0709 13:12:13.095450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.095570 (+   120us) service_pool.cc:224] Handling call
0709 13:12:14.132223 (+1036653us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54005d52d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:14.132348 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301202176}
I20260709 13:12:14.141170 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.077735  1291 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.143235 29667 raft_consensus.cc:1240] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.143563  1279 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:14.140163  1265 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:14.145108 29715 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:14.145462  1281 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:14.082273  1294 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.148200  1294 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:14.148694 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:14.136466  1349 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:14.150395  1373 log.cc:927] Time spent T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:12:14.153012 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.154954 30349 raft_consensus.cc:1240] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:12:14.127393  1363 raft_consensus.cc:2804] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:14.156550  1363 raft_consensus.cc:697] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:14.157557  1363 consensus_queue.cc:237] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.142285 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.162056 30344 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 11: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:14.172173 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:14.149390 30350 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:12:14.187410 29640 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.189214  1281 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.127904  1353 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.190761 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.196151 29714 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.199986 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:14.203763 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.204428 29749 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:14.209992  1271 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:14.210486  1271 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.210811  1271 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.212481 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:14.213212 30350 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 12.
I20260709 13:12:14.214200 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.215368 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.186769  1265 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:14.217471  1265 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:14.217876  1265 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.218662 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.219100 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:14.189770  1288 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:14.198328  1353 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.220584  1288 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:14.221046  1288 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.221521 30348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49706 (request call id 621) took 1126 ms. Trace:
I20260709 13:12:14.222096  1291 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:14.222690  1297 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.223137  1297 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:14.223249 30345 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:14.196784  1279 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.223875  1279 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.225210 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.228067 29640 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.237910 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.235962 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.255884 29640 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.241755 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:14.256850 29673 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
W20260709 13:12:14.233795 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 640490us
I20260709 13:12:14.236021 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.253561 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.254503 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:14.258931 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.259506 29671 raft_consensus.cc:3060] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.221961 30348 rpcz_store.cc:276] 0709 13:12:13.094892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.095178 (+   286us) service_pool.cc:224] Handling call
0709 13:12:14.221331 (+1126153us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54006ce154. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:14.221467 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289568000}
I20260709 13:12:14.216370 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.258491 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.261268 29741 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:14.258224 29787 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:14.241724 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.261225 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.261703 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.261483 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.262558 29787 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:14.232127  1297 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.222826 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:14.223364  1276 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:14.268911 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.274240 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.275470  1299 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.276057 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.197500  1292 consensus_queue.cc:1059] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:12:14.281981 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.281888 29814 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.257342  1266 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:14.284271 29640 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.202512  1245 consensus_queue.cc:1059] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:12:14.298609 30350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:14.299227 30350 raft_consensus.cc:606] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.300953 29816 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:14.304168 29742 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:14.306340  1320 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:14.306825  1320 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:14.307179  1320 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.310597  1292 raft_consensus.cc:3055] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:14.310999  1292 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:14.311821  1292 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.315312  1261 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:14.313138  1292 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:14.292210  1330 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:14.322332  1377 log.cc:927] Time spent T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
I20260709 13:12:14.261952  1357 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.322402 29671 raft_consensus.cc:2468] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:14.325459 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.335616 30346 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.336907 30346 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.339727 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:14.344907 30344 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.345559 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:14.346885  1357 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:14.346987 29821 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.348313 29821 raft_consensus.cc:1240] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:14.355136 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2398) took 1466 ms. Trace:
I20260709 13:12:14.355643 29744 rpcz_store.cc:276] 0709 13:12:12.888904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.961590 (+ 72686us) service_pool.cc:224] Handling call
0709 13:12:12.961831 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.832613 (+870782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.354813 (+522200us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540031b5d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:14.355030 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986604800}
I20260709 13:12:14.295694 30342 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:14.365592 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:14.365855 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.366576  1279 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:14.366994 29672 raft_consensus.cc:1240] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:14.367157  1279 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.367866  1279 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.368361 29667 raft_consensus.cc:1240] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:14.369995   980 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.371380  1290 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:14.388703 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.391745 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.392580 29667 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:14.393607 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.309399  1353 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.404409  1353 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:14.406579  1337 consensus_queue.cc:1059] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:14.407819  1337 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:14.408938  1305 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.409412  1305 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:14.410272  1305 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.411746 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.412571 29670 raft_consensus.cc:2393] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:14.413496 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.415428 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:14.416630 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51964.4us
I20260709 13:12:14.418381 29673 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:14.419116  1305 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.420372 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:14.421180 29665 raft_consensus.cc:2393] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:14.408872  1366 raft_consensus.cc:3055] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:14.426548  1357 consensus_queue.cc:1059] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:12:14.376878  1365 log.cc:927] Time spent T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.434s	user 0.005s	sys 0.000s
I20260709 13:12:14.427973   457 consensus_queue.cc:1059] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:14.429527  1275 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:14.288367  1266 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:14.430007  1275 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:14.431011  1275 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.432087  1275 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:14.432679 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.433475 29815 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 12: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:14.433380  1357 raft_consensus.cc:3055] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:14.434163  1357 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:14.380278 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.435185 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.435525  1357 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.381522 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.382835  1217 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.383560 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.386685  1328 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:14.426941  1366 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:14.438748  1075 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:14.439204  1366 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.440467  1366 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:14.378795 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:12:14.437731 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 56295.5us
I20260709 13:12:14.442133   953 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:14.442595   953 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:14.442983   953 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.443161  1075 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:14.443483  1266 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:14.426609 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:14.448237 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.450968 29665 raft_consensus.cc:1240] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:14.372392   980 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:14.453449 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 61835.8us
W20260709 13:12:14.441751 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 63045.4us
I20260709 13:12:14.467760 29789 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:14.469369 29814 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:14.469767 30315 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.456941 29749 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
W20260709 13:12:14.462559 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 226654us
I20260709 13:12:14.472616 30344 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:14.521152 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.523236 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:14.524678 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 49594.8us
W20260709 13:12:14.528990 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 68272.5us
I20260709 13:12:14.532799 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.472743 30346 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:12:14.475111 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.539805 29744 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
W20260709 13:12:14.477425 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.497625  1337 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:14.477265 30343 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:14.477780  1286 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:14.541905 30343 raft_consensus.cc:606] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.546711 30343 raft_consensus.cc:614] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.547884 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.548787 30344 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:14.550387 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.478338 29823 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:14.478634 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.553171 30346 pending_rounds.cc:85] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 9
I20260709 13:12:14.521728 30341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49712 (request call id 901) took 1016 ms. Trace:
I20260709 13:12:14.560524 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.441584  1320 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.565215 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.533628 29749 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
W20260709 13:12:14.567746 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 49971us
I20260709 13:12:14.475651  1288 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:14.553543 30346 pending_rounds.cc:107] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:14.572779 30346 raft_consensus.cc:2889] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:14.575924 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.576454 29818 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:14.522409  1287 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:12:14.579157 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.580508 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.577759 30346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49712 (request call id 895) took 1312 ms. Trace:
I20260709 13:12:14.585484   457 consensus_queue.cc:1059] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:14.559605  1349 consensus_queue.cc:1059] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:12:14.619652 30344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:14.623462 30344 raft_consensus.cc:606] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.623879 30344 raft_consensus.cc:614] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.564713  1265 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:14.624773 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.562898  1337 consensus_queue.cc:1059] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 13:12:14.588538  1342 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:12:14.641853 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 66005.6us
I20260709 13:12:14.636817 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.632412  1380 consensus_queue.cc:1059] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:14.626649  1302 raft_consensus.cc:3055] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:14.652192 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:14.640923  1325 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.013s	sys 0.017s
I20260709 13:12:14.665216 30344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:14.665900 30344 raft_consensus.cc:606] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:14.666265 30344 raft_consensus.cc:614] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.667763  1265 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:14.668359  1378 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:12:14.668488  1265 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:14.668989  1265 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:14.673960  1325 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.020s	user 0.013s	sys 0.018s
I20260709 13:12:14.585759 30346 rpcz_store.cc:276] 0709 13:12:13.265721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.265859 (+   138us) service_pool.cc:224] Handling call
0709 13:12:13.289326 (+ 23467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:13.965173 (+675847us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54004770a0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a34dc0 00007fd9e9abf1c0 00007fd9e9ac0231 00007fd9e9abcd8f 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c
0709 13:12:14.335261 (+370088us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54004770a0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9a3b06f 00007fd9e9ab3f60 00007fd9e9ab57de 00007fd9e9abfb49 00007fd9e9ac0416 00007fd9e9abcd8f 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62
0709 13:12:14.577457 (+242196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.577689 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962509952}
I20260709 13:12:14.689430 29748 raft_consensus.cc:1240] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:14.691577 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.572490  1217 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:14.648028  1270 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.696669 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.653007  1287 raft_consensus.cc:3055] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:14.651286  1302 raft_consensus.cc:740] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:14.729746 29746 raft_consensus.cc:1240] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:12:14.731073 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 495108us
I20260709 13:12:14.734959 29714 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.776259 29714 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.776506 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.561298 30341 rpcz_store.cc:276] 0709 13:12:13.502464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.509255 (+  6791us) service_pool.cc:224] Handling call
0709 13:12:14.222655 (+713400us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b5800113798. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e6998b71 00007fd9e6998a22 00007fd9ef8b1c09 00007fd9eea0bee0 00007fd9eead50ab 00007fd9eead5131 00007fd9eea830a0 00007fd9eea82984 00007fd9e7ffd6d4 00007fd9e7ffd662
0709 13:12:14.518494 (+295839us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66845056}
I20260709 13:12:14.780599 29747 raft_consensus.cc:3055] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.784564 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.785454 29746 raft_consensus.cc:2393] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:14.783182 29747 raft_consensus.cc:740] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:14.795361 29714 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.694145  1297 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:14.828939 30314 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:14.778648  1217 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:14.589383  1340 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:14.704085   980 consensus_queue.cc:1059] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:12:14.798941  1288 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:14.790979  1287 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:14.804337  1357 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:14.806704 29816 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:12:14.813382  1296 raft_consensus.cc:993] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:14.814424  1279 raft_consensus.cc:3055] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:14.820019 29747 consensus_queue.cc:260] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.821442  1320 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:14.822834  1265 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:14.822578  1293 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:14.823715 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:14.787437  1271 consensus_meta.cc:287] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 13:12:14.826274 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.826449  1286 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:14.827015 29672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb08df13591747d7bf91993e76665808"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:14.780936  1381 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.785578  1380 raft_consensus.cc:3055] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:14.795714  1245 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.830813 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.830856 29665 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:14.831890 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.832129 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.837447 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.839845 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:14.840430  1363 consensus_queue.cc:1059] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:14.840794 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:14.841154 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 192882us
I20260709 13:12:14.900802 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:12:14.842636 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:14.843333 30314 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.845474 29674 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 5.
W20260709 13:12:14.846575 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 51311.8us
I20260709 13:12:14.903723 29741 raft_consensus.cc:2393] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:12:14.834220  1359 log.cc:927] Time spent T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:14.848264  1288 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:14.852818 29814 raft_consensus.cc:1240] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:14.837946  1305 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:14.853427  1279 raft_consensus.cc:740] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:14.861761 29672 raft_consensus.cc:606] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:14.861773 29746 raft_consensus.cc:2368] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 11. Current term is 12.
I20260709 13:12:14.863909 29638 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:14.906765 29745 raft_consensus.cc:2393] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:14.856989 29747 raft_consensus.cc:3060] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:14.911708 29741 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:14.912715 29672 raft_consensus.cc:614] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:14.851755  1292 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:14.856657  1331 raft_consensus.cc:1081] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:14.867859  1330 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:14.970108 29746 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:14.856521  1294 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:14.913036 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:12:14.913206 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 434627us
I20260709 13:12:14.912717 29744 raft_consensus.cc:1240] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:14.944012 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.921195 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:14.840469  1302 consensus_queue.cc:260] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:14.921682 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:14.864897  1265 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:14.868095  1380 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:14.983794 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:14.908728  1320 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:12:14.984912 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 63814.5us
W20260709 13:12:14.941340  1343 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:15.003701  1395 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.004293  1395 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
W20260709 13:12:14.987886 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 124053us
I20260709 13:12:15.005558 29638 leader_election.cc:400] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11.
I20260709 13:12:15.005968 29638 leader_election.cc:403] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:12:15.005612  1322 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:15.007050  1322 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.010165 29746 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:15.010699 29714 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.940981  1275 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.867467  1271 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.023648 29715 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:15.002410 30346 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:15.004716  1395 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.014710 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:15.020720 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:15.027695 29741 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.031180 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:15.032734 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 189446us
I20260709 13:12:15.034835 30314 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.036455 30314 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:14.980048  1292 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:14.909703   953 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.096061 29744 raft_consensus.cc:1275] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:12:15.095129 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58752us
W20260709 13:12:15.099267 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 68178.4us
I20260709 13:12:15.099535 30314 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.100077 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.100677 30314 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.013327  1332 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:12:15.108431 29742 raft_consensus.cc:1240] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:12:15.109054 29638 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:15.109934 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 207659us
I20260709 13:12:15.030356  1330 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 10. Current term is 11.
I20260709 13:12:15.128100 29820 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:15.128798 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:14.989594  1325 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:12:15.102826  1245 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:15.131004 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 227637us
I20260709 13:12:15.067452  1275 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.067729  1302 raft_consensus.cc:3060] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.130352 29638 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:15.127223 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 71432.2us
I20260709 13:12:15.115115  1274 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:15.012871  1328 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
W20260709 13:12:15.114259  1266 consensus_meta.cc:287] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.004s
I20260709 13:12:14.980973  1217 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:15.131835 29816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:52208
I20260709 13:12:15.147651 29816 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.148051 29816 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.108271  1291 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:14.940655  1287 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.109191  1305 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:12:15.127535 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 95794.1us
I20260709 13:12:15.115319  1293 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.134618  1075 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:12:14.998926  1294 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.134877  1265 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:15.153981  1332 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.154759  1300 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:15.156468 29787 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.131767  1369 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.132774  1260 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:15.159123 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:15.161690 29741 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
W20260709 13:12:15.161948  1366 consensus_meta.cc:287] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.721s	user 0.013s	sys 0.000s
I20260709 13:12:15.184279 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:15.183192 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 172565us
W20260709 13:12:15.162953 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 139396us
I20260709 13:12:15.193751 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.144074  1297 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.197788 29787 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.199105 29787 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.155941  1305 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:15.166610  1265 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:15.139664  1396 consensus_queue.cc:1059] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:12:15.165462  1291 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.258299  1407 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.274824  1075 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:12:15.275904  1386 log.cc:927] Time spent T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.587s	user 0.009s	sys 0.001s
I20260709 13:12:15.280444 30347 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:15.191959  1260 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:12:15.232671 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 130339us
I20260709 13:12:15.169878  1324 consensus_queue.cc:1059] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:12:15.261322 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.293690 30346 raft_consensus.cc:2393] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 11: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:15.260547 29787 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.157845  1266 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.203595  1305 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:15.218094  1265 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.132867  1279 consensus_queue.cc:260] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.307137  1324 raft_consensus.cc:3055] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:12:15.265532 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48430.1us
I20260709 13:12:15.267238  1393 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:15.267705  1391 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.307436  1279 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.295964  1340 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.311269  1335 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:15.311715  1335 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:12:15.268605  1392 log.cc:927] Time spent T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:12:15.220181 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.192921  1331 consensus_queue.cc:1059] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:12:15.253060  1320 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.283267 30314 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.284212  1260 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:15.288223  1294 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.283641 29816 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:15.290341  1400 log.cc:927] Time spent T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:12:15.291806  1409 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.294260 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.203811  1332 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:15.290225  1271 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.300261  1266 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.299911  1380 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.301134 29668 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:12:15.302477  1075 raft_consensus.cc:3055] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:15.341971  1075 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:15.342530  1413 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.302660 29787 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.329190 29816 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:15.339048 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 44869.2us
I20260709 13:12:15.303162  1397 consensus_queue.cc:1059] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:12:15.307179  1245 consensus_queue.cc:1175] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "389c080a49494f8fb56c53fa7e6087f3" responder_term: 11 status { last_received { term: 9 index: 10 } last_committed_idx: 9 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:15.265158  1292 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.255749  1289 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.313172 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.221796  1322 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.318845  1335 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.315265  1324 raft_consensus.cc:740] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:15.323520 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:15.323139 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 103040us
I20260709 13:12:15.355203 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.324496   953 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:15.328405 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 45233.1us
I20260709 13:12:15.365757 29714 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:15.339627  1332 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:15.344425 29787 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.323617  1408 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.341763  1380 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.342960  1075 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.321877  1275 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.347014  1396 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:15.352501  1289 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:15.355113 29819 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:15.370059 29787 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.369602 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.370253 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:15.349593  1357 consensus_meta.cc:287] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 13:12:15.358136 29638 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:15.328271 29747 raft_consensus.cc:1275] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:12:15.348109  1320 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.363132  1389 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:15.339762  1401 log.cc:927] Time spent T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 13:12:15.366672 30314 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.353081  1292 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.369055 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.382133 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.387125  1369 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:15.387974  1369 raft_consensus.cc:697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:15.374195  1271 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:15.379370 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.388928  1369 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.390062 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.390298 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.391057 29821 raft_consensus.cc:2393] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 11: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:15.355809 29715 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:15.391880  1366 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.392594  1366 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:15.394120  1396 raft_consensus.cc:2804] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:15.388190 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.394661  1396 raft_consensus.cc:697] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:15.395532  1396 consensus_queue.cc:237] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.374626 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.398104  1297 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:15.399238  1408 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:15.400149 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:15.405031 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:15.405588 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:15.406059 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:15.407037 29741 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
W20260709 13:12:15.373274 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.362447  1409 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.373766 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.391214 30314 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.409853 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.416996 30314 leader_election.cc:400] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 11. Current term is 12.
I20260709 13:12:15.417299 30314 leader_election.cc:403] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:15.418613   953 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:15.419926 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.369138  1300 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:12:15.422822 30314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.424129 29741 raft_consensus.cc:1275] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:12:15.430977  1297 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.431905 30341 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:15.369467  1410 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:15.371156  1335 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.520695  1410 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:15.434288 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:15.362296  1261 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:12:15.387606  1324 consensus_queue.cc:260] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.521657  1410 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.522917  1324 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:15.445261  1398 log.cc:927] Time spent T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:12:15.388846  1271 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.387215  1265 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.434087  1275 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.370795  1381 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.381143  1289 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:12:15.386204  1332 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.450255  1395 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.450516  1353 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:15.453730  1391 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:15.456650 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.459167 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:15.459487 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:15.529356 29665 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:15.460925 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:15.447831  1366 consensus_queue.cc:1048] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:12:15.441900  1342 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 11. Current term is 12.
I20260709 13:12:15.441615  1413 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.463706  1337 consensus_queue.cc:1048] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:12:15.414369  1349 consensus_queue.cc:1048] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:12:15.464845 29673 raft_consensus.cc:1240] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:15.466207  1288 raft_consensus.cc:3055] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:15.372478  1397 consensus_queue.cc:1059] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:12:15.464747 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:15.445751  1305 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.468986  1340 raft_consensus.cc:3055] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:15.483537 30349 raft_consensus.cc:2468] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:15.510776  1278 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.467936  1260 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.534458 29747 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:15.534349 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 124528us
W20260709 13:12:15.524693  1339 consensus_queue.cc:1175] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "121060c6c5b14502957b76fd1dfc7b2d" responder_term: 8 status { last_received { term: 8 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 8 index: 7 } }
I20260709 13:12:15.538719 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:15.530923 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:15.546612 29748 raft_consensus.cc:2393] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:15.548424 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.552628  1300 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:15.553082  1300 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:15.553439  1300 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.557772  1265 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.560124  1271 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.562177 29714 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.563041 29747 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 13.
I20260709 13:12:15.566823 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.539676  1288 raft_consensus.cc:740] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:15.530671  1353 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.530150  1408 consensus_queue.cc:1059] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:15.572880 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.576913 29744 raft_consensus.cc:1240] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:15.565140  1265 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.598701 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.587107  1278 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:15.544518  1340 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:15.566306  1391 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:15.564940  1290 raft_consensus.cc:3055] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:15.594914 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.569541  1427 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.601534  1278 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.601996  1425 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.602552  1305 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.536424  1413 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.603570  1288 consensus_queue.cc:260] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.688313 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:15.611176 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.671607 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:12:15.672986 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.607376  1396 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:15.617126  1290 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:15.567751  1389 consensus_queue.cc:1059] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:12:15.683321  1413 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:15.607183  1391 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.606204  1282 raft_consensus.cc:3055] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:12:15.707392 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 75968.6us
I20260709 13:12:15.710631 29745 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:15.721519 29674 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57422 (request call id 1124) took 1345 ms. Trace:
W20260709 13:12:15.712487 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 101420us
W20260709 13:12:15.723996 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 104880us
I20260709 13:12:15.722312 29674 rpcz_store.cc:276] 0709 13:12:14.365516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.365639 (+   123us) service_pool.cc:224] Handling call
0709 13:12:15.710543 (+1344904us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400267354. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:15.710691 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019912448}
I20260709 13:12:15.736917 30316 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.711719  1305 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.715420  1280 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:15.720263  1408 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.729741  1288 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.731073  1391 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:15.730031  1282 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:15.752599  1395 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.752362  1280 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.756740 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:15.721330  1396 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.763846  1396 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.766889 30349 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:15.768565  1280 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.769574  1427 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:12:15.771147 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.773114 29814 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:15.773032  1282 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.774469  1282 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.777588 29674 raft_consensus.cc:1240] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:15.778710  1353 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:15.771661  1423 consensus_queue.cc:1059] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:12:15.780979 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:15.781741 29674 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:15.782090 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:15.782889 29814 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:15.781037  1423 raft_consensus.cc:3055] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:15.783865 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:15.783957  1423 raft_consensus.cc:740] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:15.747231  1340 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.782194  1299 raft_consensus.cc:3055] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:12:15.785318 30347 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49706 (request call id 626) took 1841 ms (client timeout 2245 ms). Trace:
I20260709 13:12:15.785692  1299 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:12:15.786330 29713 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.782773   980 raft_consensus.cc:3055] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:15.786787   980 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:15.748292  1305 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.787614   980 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.788702  1305 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.789186   980 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:15.785784 30347 rpcz_store.cc:269] 0709 13:12:13.944113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.944285 (+   172us) service_pool.cc:224] Handling call
0709 13:12:15.785162 (+1840877us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540055fd54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:15.785264 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462955904}
I20260709 13:12:15.791183 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.792941  1300 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.793457 30315 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:15.745931  1366 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:15.790729 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.795779 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 2667) took 1384 ms. Trace:
I20260709 13:12:15.796010  1328 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:15.796435  1328 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.796774  1328 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.797436 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.784433 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.783771 29819 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:15.799252  1302 consensus_queue.cc:1059] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:15.800907 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.801615 30347 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 12: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:15.797595  1366 raft_consensus.cc:697] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:15.806314 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.806238 29741 raft_consensus.cc:1240] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:15.806252 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:15.808502 29745 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:15.807463 29668 rpcz_store.cc:276] 0709 13:12:14.411176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:14.411306 (+   130us) service_pool.cc:224] Handling call
0709 13:12:14.411846 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.341701 (+929855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:15.781776 (+440075us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54001f45d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:15.795718 (+ 13942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044342400}
I20260709 13:12:15.813083 30315 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.814368 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:15.815927 29814 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:12:15.800273  1302 raft_consensus.cc:3055] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:15.830835 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.834862 30315 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:15.821568  1217 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:15.818718  1427 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:15.819463  1289 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:15.834033  1305 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.835996  1302 raft_consensus.cc:740] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:15.786652  1299 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.796846  1290 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.841029  1342 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:15.811604  1396 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:12:15.784852  1423 consensus_queue.cc:260] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:15.857402  1337 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.839036  1325 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:12:15.848107  1217 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.863322  1342 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.868163  1366 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.858219  1289 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:15.896961 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 51694.3us
I20260709 13:12:15.863366  1275 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:12:15.901074 30348 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:15.902825  1287 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.906677  1300 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.867380  1278 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:15.909477 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.909729  1278 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.911617  1289 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.912472 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:15.912729  1340 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:15.886838  1302 consensus_queue.cc:260] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.887207  1299 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:15.918401  1437 log.cc:927] Time spent T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:12:15.920646  1217 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:15.920464  1245 raft_consensus.cc:3055] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:15.923765 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.922657 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:15.925239 30348 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:15.880899  1342 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.928790 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:15.944444 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:15.946692 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:15.947348 29667 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:12:15.944380 30343 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:15.949393 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:15.951948 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:15.954113 29740 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:15.929056 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:15.930500 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:15.931171 29674 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:15.931936 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:15.932289 29789 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
W20260709 13:12:15.932956 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.935351   953 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:15.936316  1424 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:15.938249 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:15.964244 29666 raft_consensus.cc:2393] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 5: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:15.939507  1260 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:15.941460  1279 raft_consensus.cc:3055] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:15.867188  1337 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.889868  1423 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:15.948829 30343 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:15.965468 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:15.966202 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 43629.8us
I20260709 13:12:15.975452 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:15.966895 30342 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:15.962595 29743 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:15.971474 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.966316 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:15.977175 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:15.977460   457 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.977067 29668 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:15.985937 30349 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:15.945343  1302 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:15.979074 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 46868.7us
I20260709 13:12:15.988888 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:15.977478 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:15.989884 30346 raft_consensus.cc:2393] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 11: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:15.945606  1293 consensus_queue.cc:1059] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:12:16.001770  1293 raft_consensus.cc:3055] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:16.002166  1293 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:16.002995  1293 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.966493   980 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:16.004400  1293 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:15.974881  1261 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:15.969712  1279 raft_consensus.cc:740] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:16.006848  1279 consensus_queue.cc:260] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.007952  1279 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:15.925694  1245 raft_consensus.cc:740] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:15.990487 30348 raft_consensus.cc:1240] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:16.007061  1328 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.991747  1336 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:15.992465  1337 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.004498   980 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:15.998318 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:15.990394  1320 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:15.963740  1424 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:12:15.991055  1438 log.cc:927] Time spent T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:12:16.022212   457 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.028416   457 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.021843 30346 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:15.940043  1391 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:15.985994 30343 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.037170 30343 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.000061  1436 raft_consensus.cc:2804] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:16.034181 30344 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:15.965906  1388 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 13:12:16.039594 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 50148.3us
I20260709 13:12:15.968858  1408 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:12:16.045804 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.025743  1287 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.026225  1289 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:16.045849 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:16.029501  1340 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:16.046622 29668 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:16.051785 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.052503   457 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.030325  1371 raft_consensus.cc:3055] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:16.067852  1371 raft_consensus.cc:740] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.068737  1371 consensus_queue.cc:260] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.072257  1338 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:16.077262 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.074497 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.078073 29671 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:16.074788 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.075094 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.029074  1320 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.075536 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.081321  1320 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:16.081664 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.055716  1322 consensus_queue.cc:1059] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 13:12:16.047102 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 66144us
I20260709 13:12:16.084267 29638 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:16.085031  1280 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:12:16.038463  1301 consensus_queue.cc:1175] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "42c443079435463daa8845e244cec9d3" responder_term: 9 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:16.062543 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.085839 29666 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.049510  1261 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.067404  1391 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
I20260709 13:12:16.076134 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.090881 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.092901 29674 raft_consensus.cc:2393] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 6: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:16.093942 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.096954 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.097676 29671 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 13: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:16.108002 29715 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.139559 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:16.142077 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46431.1us
W20260709 13:12:16.143054 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 55541.1us
I20260709 13:12:16.143767 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.145015 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:16.146037 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 167741us
I20260709 13:12:16.052838  1436 raft_consensus.cc:697] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.148694 29715 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.047084  1297 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:12:16.164829 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:16.166540  1436 consensus_queue.cc:237] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.171177   980 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:16.056552  1289 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:16.176517 29670 raft_consensus.cc:1240] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:16.146862 30314 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:16.181120 29715 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.182085 29640 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:16.182888 29715 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.183807 29823 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:16.184316 29715 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:16.190132 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 46439.3us
I20260709 13:12:16.091622  1340 raft_consensus.cc:697] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.199527 30349 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:12:16.160894  1288 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:16.161084  1408 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.160696  1328 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:16.207168 29789 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:16.087598  1287 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.208495 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:16.182011  1289 raft_consensus.cc:3060] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.188488  1396 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.189296  1297 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:16.188292  1265 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:16.217535 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:16.195545  1447 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.220211 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.247125 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.220357 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.096519  1261 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.197527   980 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.161751  1330 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:12:16.068084  1424 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.208202  1279 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:16.251149 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 45892.5us
I20260709 13:12:16.251734 30344 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:16.204557  1259 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.261672 30349 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:12:16.262166 30349 pending_rounds.cc:85] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 8
I20260709 13:12:16.262404 30349 pending_rounds.cc:107] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:12:16.262650 30349 raft_consensus.cc:2889] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:16.240105  1320 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:16.251166  1288 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.254348  1427 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:16.214380  1393 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 13:12:16.269570 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 49300us
W20260709 13:12:16.273483 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.275329 30343 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:16.276734 29789 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:16.280908 29740 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:12:16.283903 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:16.284499 29740 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.272713  1349 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:16.290699 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:16.291363 29747 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:16.292228 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:16.258755  1294 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:12:16.275982  1320 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.337436  1371 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:16.275693  1336 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:12:16.285305  1353 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:16.368672  1332 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:16.370555  1287 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:16.372131 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.372975 29674 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:16.372964 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:16.374101 29712 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.374480 29671 raft_consensus.cc:1240] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: []
W20260709 13:12:16.378037 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.345515  1280 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:16.295128  1424 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.292843 29744 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:16.283294  1397 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:16.384874 29740 raft_consensus.cc:2468] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:16.376221 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:16.387974 29666 raft_consensus.cc:2468] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
W20260709 13:12:16.285550  1305 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:12:16.394071 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.398603 29667 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:12:16.401417  1451 log.cc:927] Time spent T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:12:16.278537  1340 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:16.410089 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.410712  1290 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.378177  1393 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:16.418329  1393 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.420415  1393 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.421238  1447 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:16.421676  1447 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.421764  1261 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:16.422081  1447 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:16.388497 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 105938us
I20260709 13:12:16.391695 29743 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:12:16.430176  1320 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.399930 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:16.440507 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:16.422755  1328 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:16.455538 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.467077 29744 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:16.468969 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:16.429389  1342 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.486148  1454 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:16.486769  1454 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.488991  1454 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:16.489483  1454 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:16.446493  1302 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:16.496739  1302 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.496987  1436 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:16.434109  1397 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.497571  1436 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.498567  1436 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.497113  1302 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.517447  1353 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.527312 29787 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.472580  1328 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.502120  1454 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.523325  1259 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.539960 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.526396   953 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51138 (request call id 94) took 4046 ms. Trace:
I20260709 13:12:16.543149  1455 raft_consensus.cc:2804] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:16.544629  1328 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.541536  1396 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:16.574913  1396 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.577190  1396 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:16.579258 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.580633  1436 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:16.583683 29823 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:16.586042  1410 consensus_queue.cc:1059] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:16.546962  1342 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:16.562639 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:16.564069 30349 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:16.590273  1245 consensus_queue.cc:260] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.591528  1245 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:16.565796 29666 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:12:16.567178 29814 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:16.569293 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.569882  1423 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:16.569491  1397 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.571552 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.554231   953 rpcz_store.cc:276] 0709 13:12:12.466393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.467529 (+  1136us) service_pool.cc:224] Handling call
0709 13:12:12.506453 (+ 38924us) log.cc:844] Serialized 501 byte log entry
0709 13:12:12.773732 (+267279us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b180043d7a0. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e694ac0a 00007fd9f008a219 00007fd9e69d2a40 00007fd9e69cd4e4 00007fd9e69cd455 00007fd9e9a16b0b 00007fd9e9a9bb63 00007fd9e9ac3752 00007fd9e9abb9fa
0709 13:12:16.512822 (+3739090us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43466,"raft.queue_time_us":106870,"raft.run_cpu_time_us":1509,"raft.run_wall_time_us":42027,"spinlock_wait_cycles":18077056,"thread_start_us":91714,"threads_started":1,"wal-append.queue_time_us":189449,"wal-append.run_cpu_time_us":2192,"wal-append.run_wall_time_us":1063919}
I20260709 13:12:16.574260  1455 raft_consensus.cc:697] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.598428   953 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:16.599063  1422 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:16.598695  1455 consensus_queue.cc:237] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:16.598598 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:12:16.598863   953 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.600683   953 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:16.606494 30316 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.607748  1325 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.608222  1325 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.513057  1447 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.562480  1427 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:16.613273   953 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:16.624306 30349 raft_consensus.cc:1240] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:12:16.648283  1338 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:16.651095 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:16.651522  1338 consensus_queue.cc:1059] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:16.654724  1075 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.622586  1289 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.651928 29740 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 12: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:16.658551 30343 raft_consensus.cc:1240] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:16.660653 30316 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:16.656541 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:16.659718 29746 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:16.633999  1325 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:16.663822 30343 raft_consensus.cc:1275] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:16.666098 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.667474 29671 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:16.668215 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.668864 29665 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:16.674243 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.674841 29673 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.666860   980 consensus_queue.cc:1059] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:12:16.676494  1461 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:16.685716 29665 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:16.686395 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.689198 29671 raft_consensus.cc:2410] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:12:16.686903 30316 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:16.691313 30316 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:16.691933  1447 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.691205 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.697599 29715 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.666977  1328 raft_consensus.cc:2804] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:16.702629 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:16.705348 29818 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:16.707084 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.692566  1447 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:16.692451  1454 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.709654 29821 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:16.711329 29823 raft_consensus.cc:1240] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:16.711766 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.712538 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:16.714727 29671 raft_consensus.cc:1275] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:16.715524 29639 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:16.716646 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.724131 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:16.724653 29819 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.725656 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.681959  1299 consensus_queue.cc:1048] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:12:16.703228  1396 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:16.765012  1302 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.767269  1302 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.711344  1447 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.768016  1447 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:16.732883 30346 raft_consensus.cc:1240] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:16.704943  1305 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:16.704457  1427 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.741456 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:16.772228  1427 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.707696  1325 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:12:16.743490 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.774307 29821 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:16.775492  1427 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:16.749078  1294 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:16.776175  1294 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:16.777096  1294 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.778227  1292 raft_consensus.cc:3055] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:16.778652  1292 raft_consensus.cc:740] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:16.779461  1292 consensus_queue.cc:260] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:16.749254  1422 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.780622  1292 raft_consensus.cc:3060] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.780458  1422 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.782807  1422 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:16.737020  1339 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.783993  1289 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:16.783763  1339 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.784436  1391 raft_consensus.cc:3055] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:16.784850  1391 raft_consensus.cc:740] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.786373 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:16.786932  1339 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:16.787501  1339 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:16.787849  1339 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.790087  1360 consensus_queue.cc:1059] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:16.789615  1217 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.790975  1217 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.785648  1391 consensus_queue.cc:260] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.792270  1391 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:16.793012  1217 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:16.794719 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:16.798899 29715 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.794703  1360 raft_consensus.cc:3055] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:16.800228  1360 raft_consensus.cc:740] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:16.800361 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.800984 29822 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:12:16.801108  1360 consensus_queue.cc:260] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:16.752521  1459 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:12:16.757143 30316 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.758389 29789 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.802997 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:16.712198  1328 raft_consensus.cc:697] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:16.803612 29740 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.708731  1349 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:16.804615  1349 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:16.799687  1245 consensus_queue.cc:1048] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:16.804138  1422 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:16.772065  1305 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:16.804148  1328 consensus_queue.cc:237] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.806295 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:12:16.803278 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44994.1us
I20260709 13:12:16.808867 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.806782  1305 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.810662  1349 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:16.813844 29789 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.815429 29789 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.802341  1360 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:16.753342  1464 log.cc:927] Time spent T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:12:16.816649 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:16.835004 29667 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:16.838029 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.817356 29740 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
W20260709 13:12:16.817530 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.635164  1353 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.819619 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.842757 29814 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 5.
W20260709 13:12:16.821447 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 88811.6us
I20260709 13:12:16.821718 29742 raft_consensus.cc:2468] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:16.844347 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.844996 29823 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:16.845971 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.828464 29819 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:16.815984  1454 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:16.822697 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:16.831326 29673 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:16.788157  1339 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:16.847461 29667 raft_consensus.cc:2393] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:16.847183 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:16.850271 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 92881.4us
I20260709 13:12:16.851339 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:16.852856 29816 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:16.841545  1299 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:16.853840 29715 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:16.853515 29639 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:16.855434 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:16.853437 30316 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:16.857678 29673 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.859196 30314 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:16.860149 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:16.861424 29787 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.865532 29673 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:16.867894 30315 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:16.839910  1436 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.867050  1335 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:16.873188  1335 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.873580  1335 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:16.879530  1302 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:16.880141  1302 raft_consensus.cc:697] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:16.880991  1302 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.847244  1462 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:16.866290  1287 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:16.866484  1422 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:16.871352  1245 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:16.901736  1454 raft_consensus.cc:2804] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:16.911764  1349 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.912377  1342 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:16.902233  1462 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:16.918751  1422 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.883590  1305 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.922667  1245 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.888923  1436 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:16.926182  1363 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:16.964144 30347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49706 (request call id 644) took 1035 ms. Trace:
I20260709 13:12:16.927971  1299 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.972088 30347 rpcz_store.cc:276] 0709 13:12:15.928286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:15.928427 (+   141us) service_pool.cc:224] Handling call
0709 13:12:15.932339 (+  3912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:15.948150 (+ 15811us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:12:15.985352 (+ 37202us) log.cc:844] Serialized 14 byte log entry
0709 13:12:16.612523 (+627171us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b180004ce40. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d23a 00007fd9e9ac7a2a
0709 13:12:16.645999 (+ 33476us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:16.646453 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:12:16.646597 (+   144us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:12:16.646634 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:16.646697 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:16.937145 (+290448us) raft_consensus.cc:1685] finished
0709 13:12:16.963865 (+ 26720us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:16.964071 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15393,"prepare.queue_time_us":20570,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":31589,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":7818,"spinlock_wait_cycles":37471488,"thread_start_us":33193,"threads_started":1,"wal-append.queue_time_us":705035}
I20260709 13:12:16.980998 29668 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:16.935755  1462 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:16.963331  1422 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:16.942814  1454 raft_consensus.cc:697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:16.968357  1245 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:16.937270  1349 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:16.983172  1363 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:16.982595  1299 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:17.033375 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 174238us
I20260709 13:12:17.031471  1410 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.046505  1471 log.cc:927] Time spent T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:12:17.047046  1473 log.cc:927] Time spent T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:12:17.052964  1454 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.042254  1259 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:17.058058  1259 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:17.058535  1259 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.040218  1482 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.085069 30343 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:17.094082 30343 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:17.174381 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 244592us
I20260709 13:12:17.069502  1328 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:17.082288  1275 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.092736  1423 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.046531  1410 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.172371  1424 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.175580  1320 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.166769  1287 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.099148  1482 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.219614  1287 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.230647  1480 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.199060  1427 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.078516  1363 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.195190  1328 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.237284  1480 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.239387  1427 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.240953  1462 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.198249  1275 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.225385  1320 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.250432  1427 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.251591  1275 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.243966 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.252457 29743 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:17.253543  1299 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.245563  1328 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.246058  1410 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.248224  1480 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:17.244726  1475 log.cc:927] Time spent T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:12:17.252517  1462 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.281246  1320 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.281694  1482 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.256564 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:17.282426 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 192213us
I20260709 13:12:17.283136  1340 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.262223  1349 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:17.242197  1477 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:12:17.286057 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 237207us
I20260709 13:12:17.278715  1453 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.221938  1424 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.283555  1340 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.293275 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.311071 29743 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:17.293983 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.312112 29741 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:17.202500  1423 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:17.301738 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 394918us
I20260709 13:12:17.317162 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.302680 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.280936  1287 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.308774 29747 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:17.261523  1339 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.318039 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.325278 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.333385 29822 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:12:17.308751  1427 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.274017  1447 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.341626 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.342293 29821 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:17.316926  1340 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.331082 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:17.349524 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.256767  1335 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.350039 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.345660  1305 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:17.338935 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48652us
I20260709 13:12:17.318814  1320 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:17.350392 29745 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:17.349862 29670 raft_consensus.cc:2376] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7. Re-sending same reply.
I20260709 13:12:17.372664 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:17.359706 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:17.349651 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.350589 29746 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:17.351284 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.376058 29742 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:17.350944 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.380406 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.381074 30347 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:17.385413 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.386180 30343 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:17.387105 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:17.388100 29743 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 9: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:17.389426 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.330686  1274 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:17.395247 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.395942 30344 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:17.372364 30314 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.309082  1453 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.401546 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:17.403903 30314 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.341051  1281 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.346705  1462 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:17.412566 30314 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.413439 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.382841  1482 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.372641  1397 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.339452  1245 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.416033  1325 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.407881 30349 raft_consensus.cc:2368] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13.
I20260709 13:12:17.415295  1462 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.379902  1391 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:12:17.372934  1461 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:12:17.444449 29665 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:17.419880  1305 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:17.349272  1427 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.419880  1301 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:17.420019  1275 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.424563  1397 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.393564   980 consensus_queue.cc:1059] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:12:17.412009  1480 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:17.474881 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.483140 29665 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:17.425763  1299 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:17.479465 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:17.397560  1320 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.470182 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.408763  1274 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.406617  1259 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:17.487226 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 109936us
I20260709 13:12:17.485106 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.418174  1281 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.430127  1325 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.492681 29747 raft_consensus.cc:2393] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 12: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:17.475347  1305 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.481650  1301 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.483254  1397 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.474130  1338 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.486567  1299 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.474968  1490 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.519785  1490 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.472190  1462 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:17.498639  1360 consensus_meta.cc:287] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:12:17.500535 29822 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:17.427772  1482 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.504606 29673 raft_consensus.cc:1240] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:17.526145 29670 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
W20260709 13:12:17.490283 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 96213.3us
I20260709 13:12:17.509897  1338 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.510921 29745 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:17.485077  1275 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:17.515132  1484 log.cc:927] Time spent T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:17.516729  1427 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.517306  1424 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.537381  1275 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.538735 30343 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 7.
I20260709 13:12:17.539295  1482 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.540102  1482 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:17.540606  1482 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.546273  1339 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.518172  1335 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:17.518397  1487 log.cc:927] Time spent T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:12:17.519217  1423 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.521554 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.590991 30346 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:17.495963   980 consensus_queue.cc:1243] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer 121060c6c5b14502957b76fd1dfc7b2d log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:12:17.597317 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 224716us
I20260709 13:12:17.532294 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:17.600121 29815 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.533139 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:17.601310 29817 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.534150 29823 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:17.499337  1325 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.502094  1301 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.501802  1305 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.491817  1480 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.498880  1486 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:12:17.619532 30342 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:17.498219  1495 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:12:17.537297  1492 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:12:17.521389  1299 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.596560  1410 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.616045 29668 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:17.621143 29743 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:17.634795  1391 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:17.636929 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.637709 29743 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 7: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
W20260709 13:12:17.598405  1491 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:12:17.634559  1410 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:17.638765  1493 log.cc:927] Time spent T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:12:17.639011  1320 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.640257  1410 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.620604 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:17.661887 29815 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:17.642033  1320 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:17.663993  1320 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.664353  1320 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.666687  1274 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.667290  1423 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:17.663050 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.670183  1453 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.674655 29670 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:17.675806  1292 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.676398  1292 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.676673 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.677294 29665 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:17.678157 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.678792 29667 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:17.682536  1281 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.683149 29789 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:17.684290  1423 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.686316  1490 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.686483  1245 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.597448  1461 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.688653 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.691515 29817 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 13.
I20260709 13:12:17.613997  1259 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.701215 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:17.697939 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.619886  1424 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:17.707839 29665 raft_consensus.cc:2368] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13.
I20260709 13:12:17.710740  1324 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:17.711356  1324 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.713563  1324 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.720551 29639 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:17.720470  1260 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:17.721551  1075 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:17.722177  1075 raft_consensus.cc:697] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:17.723165  1075 consensus_queue.cc:237] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.729461 29789 leader_election.cc:400] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13.
I20260709 13:12:17.729938 29789 leader_election.cc:403] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:12:17.730574  1300 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13.
I20260709 13:12:17.686733  1447 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.745641 29674 raft_consensus.cc:1275] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:17.749904 29639 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:17.750818  1259 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:12:17.767946  1422 consensus_meta.cc:287] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.005s
I20260709 13:12:17.768445  1422 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.770269 29740 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 13: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:17.771588  1338 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.774714  1292 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.660451  1495 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.776851 29667 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:17.778141  1495 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.706354  1461 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.781522  1461 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.781746 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.782933  1422 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.784070  1301 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.752512  1424 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:17.794742  1424 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.795533  1301 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.786870  1480 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.787448  1482 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.790104  1340 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.791580  1462 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.802502 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.811415 29673 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:17.781243  1305 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.804447 29746 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:17.807376 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.819422 29665 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:17.807657 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.808065 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.808314 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:17.820250 29821 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:17.820747 29815 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 13: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:17.809868 30315 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:17.822196 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.822842 30349 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
W20260709 13:12:17.813015 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 63212.1us
I20260709 13:12:17.816512 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.824038 29823 raft_consensus.cc:2393] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 7: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:17.822746 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:17.824566 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:17.825101 29815 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:17.825018 29746 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.826990 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.828500 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:17.829104 30347 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:17.821687 29822 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
I20260709 13:12:17.830210 29789 leader_election.cc:400] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for earlier term 12. Current term is 13.
I20260709 13:12:17.769459  1397 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.832059 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.832691 29822 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:17.838532 29815 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 6.
I20260709 13:12:17.831532 30315 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:17.841094 29819 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 12: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:17.803825  1423 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:17.845108 29823 raft_consensus.cc:2368] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:17.799932  1259 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:17.845800 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.850185 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.848315 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:17.848852 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.851385 29665 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:17.849514 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:17.852046 29789 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:17.852602 29818 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.850638 29821 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
I20260709 13:12:17.854084 29822 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:17.854990 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.857127 29744 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:17.860757 29746 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:17.867966 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.868160 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.867612 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:17.869509 29749 raft_consensus.cc:2393] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 9: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:17.870513 29674 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:17.873255 29817 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:17.873944 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.847092  1480 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:17.885259 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.885843 29744 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:17.842720  1505 raft_consensus.cc:493] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:17.892565 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.913565 29742 raft_consensus.cc:2393] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:17.894178 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.837896  1461 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:12:17.881352  1489 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:17.917037  1489 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.917451  1489 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:17.867496  1488 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:17.918283  1488 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:17.920519  1488 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.894846 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:17.923503  1436 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.924474  1462 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.869473  1245 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.866292  1294 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:12:17.925487  1245 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.926017  1353 raft_consensus.cc:3055] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:17.926430  1353 raft_consensus.cc:740] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:17.890553  1502 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:17.927181  1502 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.927541  1245 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.845892  1322 consensus_queue.cc:1048] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:12:17.928334  1322 consensus_queue.cc:1243] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer a9d8198d0b954886af452e89a8029614 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:12:17.928819  1397 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.847281  1325 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.930809  1320 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.891004  1480 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.932926  1423 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:17.872917  1427 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.896684  1452 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.881224  1349 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:17.882010  1422 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:17.934864  1505 raft_consensus.cc:515] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.962260 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.932580 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:17.837667  1290 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:12:17.934392  1259 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.868396  1287 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:12:17.951069 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:17.927196  1353 consensus_queue.cc:260] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:17.892795 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 390034us
I20260709 13:12:17.954041 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:17.951503 29822 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:17.927479  1305 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:17.963403 29749 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:17.962106 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 362503us
I20260709 13:12:17.927517  1502 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:17.958300  1280 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.962903  1422 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.975394  1280 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.970145 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.978670 29665 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 13: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:17.970619 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.978729 29818 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
I20260709 13:12:17.979250 29673 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:17.980391  1486 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.980924  1486 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:17.961154  1349 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.982158  1349 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:17.983126  1486 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.984527  1353 raft_consensus.cc:3060] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:17.972193 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:17.975463  1422 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:17.988734 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:17.989338 29669 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:17.978197 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.991294 29673 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:12:17.957298  1480 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.990828 30316 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:17.993119 29714 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.995713 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:17.996480 30347 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:17.997409 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:17.998004 29674 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:17.999030  1505 leader_election.cc:290] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:17.964190  1462 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.000802 30316 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:18.001102  1462 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.001526  1486 consensus_queue.cc:1059] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:18.002120 30316 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:18.002362  1482 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:18.002795  1482 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:18.003162  1482 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:17.994520 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:18.006114  1302 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:17.958676  1427 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.006935  1302 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:18.008288  1427 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:17.996436 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:17.960726  1452 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.009156 29666 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:17.995826  1325 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:18.014319  1280 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.009220 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.015399 30344 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 12: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:18.001314  1503 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:18.019014  1503 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:18.019598  1452 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.019932  1503 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.021523  1320 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.023141 29714 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.999630  1299 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.024976 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.025524 29741 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.026526 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:17.073055 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:17.971644 29746 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.025888  1507 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:18.026702  1504 raft_consensus.cc:2804] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:18.034054 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:18.062932 29639 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:18.035015 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.067480 29667 raft_consensus.cc:1240] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:18.048767 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.068450 29822 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:18.037408 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:18.069765 30348 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.048446 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.071681 29714 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.031517 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:18.073545 30344 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.059212 29669 raft_consensus.cc:2468] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:18.080765 29674 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
W20260709 13:12:18.080892 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 45954.3us
I20260709 13:12:18.068639 29749 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
I20260709 13:12:18.085350 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.086220 29818 raft_consensus.cc:2368] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:18.085346 30314 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.073426 29746 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:18.092849 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.079263 30316 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:18.095808 29639 leader_election.cc:400] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:18.096233 29639 leader_election.cc:403] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.100227 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.100831 30342 raft_consensus.cc:1813] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Handling vote request from an unknown peer 42c443079435463daa8845e244cec9d3
I20260709 13:12:18.101356 30342 raft_consensus.cc:2410] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:18.097391 29787 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.104219 29671 raft_consensus.cc:1240] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:18.105263 29741 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:18.107292 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.108032 29674 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
I20260709 13:12:18.025827  1299 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.106873 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:18.111129 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.111470 29787 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.111162 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.113644 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.113934 29669 raft_consensus.cc:3060] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.027040  1396 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:18.120612 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.115782 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.116901 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:18.114280 29816 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:18.080547  1505 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:18.122483 29741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.125041 29741 raft_consensus.cc:3060] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.122874 30344 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:18.079562  1507 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:18.081655  1280 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:18.102613  1452 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:18.099735  1325 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:18.127043 29789 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:18.132144 29669 raft_consensus.cc:2468] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:18.136315 29741 raft_consensus.cc:2468] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:18.080251  1504 raft_consensus.cc:697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:18.106387  1275 raft_consensus.cc:2804] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:18.098728  1427 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:18.138702 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.150748 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.110363  1488 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:18.111958  1494 raft_consensus.cc:3060] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.109477  1424 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:18.098264  1287 consensus_queue.cc:1059] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:12:18.154860 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.158914 29787 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:18.161985 29822 raft_consensus.cc:2410] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:18.025475  1489 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.121045  1396 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.124864  1505 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.125361  1322 raft_consensus.cc:2804] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:18.131721  1455 raft_consensus.cc:2804] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:18.166924  1507 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.167866  1489 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:18.157202 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81b2426a3eab4a3993fe9c9a5eb04e3d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.169231 29819 raft_consensus.cc:2368] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:18.162829  1245 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:18.153896  1488 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.171296 29639 leader_election.cc:400] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:18.189456 29639 leader_election.cc:403] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.149315  1280 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.174257 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.159675  1325 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:18.175325 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.191107 29749 raft_consensus.cc:2393] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 12: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:18.162963  1436 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:18.152953  1427 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.178191  1482 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:18.183322 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 63148.3us
I20260709 13:12:18.171986 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:18.163906  1452 raft_consensus.cc:697] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:18.172521  1396 raft_consensus.cc:3060] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:18.176108  1505 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:18.201140 29639 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:18.165310  1424 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.188935  1486 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:18.185484  1322 raft_consensus.cc:697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:12:18.214601 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 55798.8us
I20260709 13:12:18.192134  1488 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.192159  1280 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.193392  1427 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.216545  1339 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:18.226516  1339 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.226915  1339 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.236758  1339 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.239774 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.242542  1510 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:18.242694 30350 raft_consensus.cc:2368] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:18.243338  1510 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:18.243739 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.245056 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.245774 30350 raft_consensus.cc:2410] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:18.246253 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:18.246930 30342 raft_consensus.cc:2393] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 13: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:18.243724  1339 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.247747 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.248492 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.249171 30345 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:18.249493  1424 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.192380  1245 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.219414  1486 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.265018  1424 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:18.266513  1486 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:18.265583  1424 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.248493 30346 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 7.
I20260709 13:12:18.270362 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:18.270955  1424 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.204180  1455 raft_consensus.cc:697] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:18.275102  1455 consensus_queue.cc:237] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.203564  1259 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.308804 30348 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:18.315830 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.313784  1504 consensus_queue.cc:237] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:18.322292 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 117299us
I20260709 13:12:18.323917 29789 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:18.264150  1245 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:18.345991 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.296625  1320 raft_consensus.cc:2804] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:18.279331  1436 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:12:18.320451  1511 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:12:18.360005 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.354022  1519 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:18.360675 29819 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
W20260709 13:12:18.362214 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 150144us
I20260709 13:12:18.365119 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.365677 29744 raft_consensus.cc:3060] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.372117 29714 leader_election.cc:400] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:18.372483 29714 leader_election.cc:403] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.243819  1510 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.382395 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.358203  1275 raft_consensus.cc:697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:18.355363  1514 raft_consensus.cc:2804] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:18.364312  1320 raft_consensus.cc:697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:18.315986  1322 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.355778  1349 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.422132 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.424433 29670 raft_consensus.cc:2368] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8.
I20260709 13:12:18.432466 30316 leader_election.cc:400] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8.
I20260709 13:12:18.432890 30316 leader_election.cc:403] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.360831  1519 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.353806  1325 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.439663  1275 consensus_queue.cc:237] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.419675  1514 raft_consensus.cc:697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:18.417626  1528 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:18.440582  1510 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.378810  1480 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.442164 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.469760 29817 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:18.444448  1320 consensus_queue.cc:237] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.356599  1452 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.454885 30343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 606) took 1066 ms. Trace:
I20260709 13:12:18.459302 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:18.460188 29819 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:18.404386  1461 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:12:18.471107 29714 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.474167 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.441360  1504 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:18.476293 29817 raft_consensus.cc:1275] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:12:18.481251 29823 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:18.483633 29817 pending_rounds.cc:85] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 8
I20260709 13:12:18.482219 29742 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 13.
I20260709 13:12:18.484081 29817 pending_rounds.cc:107] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:12:18.484427 29817 raft_consensus.cc:2889] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:12:18.484799 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 312899us
I20260709 13:12:18.438226  1486 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.483927 30343 rpcz_store.cc:276] 0709 13:12:17.388666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.389185 (+   519us) service_pool.cc:224] Handling call
0709 13:12:18.454621 (+1065436us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b540087f5d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:18.454805 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341833472}
I20260709 13:12:18.485615 29715 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:18.489540 30347 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 13: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:18.489425 29821 raft_consensus.cc:1240] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:12:18.492643 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:18.493350 29715 leader_election.cc:304] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
W20260709 13:12:18.500651 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 95334.9us
I20260709 13:12:18.475742  1353 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:18.476490  1328 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:18.436808  1502 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.554556 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:18.487322  1504 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:18.490058  1510 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:18.475714  1422 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.477645  1396 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.491782  1482 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:18.558495 29817 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.583359 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:18.584075 29822 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 3.
I20260709 13:12:18.475926  1528 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:18.586012 29668 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57422 (request call id 1158) took 1116 ms. Trace:
W20260709 13:12:18.564067  1521 log.cc:927] Time spent T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:12:18.586398 29668 rpcz_store.cc:276] 0709 13:12:17.469790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.469940 (+   150us) service_pool.cc:224] Handling call
0709 13:12:18.585827 (+1115887us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54001a4fd4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:18.585954 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292420864}
I20260709 13:12:18.561547  1339 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:18.572500  1513 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:12:18.594493 29823 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:18.476081  1436 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.563550  1504 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:18.601794 29748 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:18.602720 29746 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:18.563836  1510 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:18.561473  1538 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:18.601557 29817 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:18.610304 29639 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:18.586397  1424 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.558115  1353 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.562841  1328 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:18.604848  1522 log.cc:927] Time spent T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:12:18.571168  1505 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.592052  1539 raft_consensus.cc:2749] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:18.599220  1489 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.607538  1510 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.621004 29640 leader_election.cc:400] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:18.620203 29744 raft_consensus.cc:2468] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
W20260709 13:12:18.638981 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 145710us
I20260709 13:12:18.639420 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.624799 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
W20260709 13:12:18.630064  1530 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:12:18.630807  1541 raft_consensus.cc:3055] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:18.631631  1349 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:18.631953  1534 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:18.642208 29787 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:18.644541 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.602170  1339 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
W20260709 13:12:18.630811  1529 log.cc:927] Time spent T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:18.654289 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.644837 29640 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:18.613530  1266 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:12:18.660311 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.662161 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.647876 30315 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:18.662384 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:18.617583  1424 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.596143  1514 consensus_queue.cc:237] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.662952 29742 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 12. Current term is 13. Ops: []
W20260709 13:12:18.664465  1533 log.cc:927] Time spent T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:12:18.677470 30315 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:18.645959  1541 raft_consensus.cc:740] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
W20260709 13:12:18.678983  1536 log.cc:927] Time spent T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:18.682493 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 1152) took 1325 ms. Trace:
I20260709 13:12:18.685818 29640 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:18.688122 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:18.642961  1489 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.686764 29740 rpcz_store.cc:276] 0709 13:12:17.348583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.350715 (+  2132us) service_pool.cc:224] Handling call
0709 13:12:18.673771 (+1323056us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54003b8b54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:18.673900 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903777664}
I20260709 13:12:18.694729  1335 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:18.700109  1340 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.702144  1489 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.668972  1454 raft_consensus.cc:2804] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:18.687274  1534 raft_consensus.cc:697] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:18.744200 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.685537  1363 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:18.745050 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.748584 29674 raft_consensus.cc:3060] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:12:18.749421 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.747927 30315 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:18.744894 29669 raft_consensus.cc:3060] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:12:18.683629  1480 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:18.744637 29667 pending_rounds.cc:85] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: Aborting all ops after (but not including) 5
I20260709 13:12:18.739122  1534 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.753001 29667 pending_rounds.cc:107] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:12:18.753336 29667 raft_consensus.cc:2889] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:18.747437 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.747532 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.705159  1543 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:12:18.750308 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 64643.7us
I20260709 13:12:18.685783  1519 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:18.757747 29640 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:18.750867 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.769977 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.735285  1502 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:18.772320 30315 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:12:18.748245  1494 consensus_meta.cc:287] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 13:12:18.702165  1525 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:18.746336  1454 raft_consensus.cc:697] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:18.779776 29638 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:18.750541  1363 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:18.767467  1543 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.794216 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:18.794775 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:18.796208 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.887847 29818 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:18.888356 30348 raft_consensus.cc:2368] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 13. Current term is 14.
W20260709 13:12:18.797597 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:18.797751 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.892681 29715 leader_election.cc:400] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 13. Current term is 14.
I20260709 13:12:18.750258  1547 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:18.793380 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:18.894294  1547 raft_consensus.cc:493] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.883028 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:18.894657  1547 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:18.766407  1266 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:18.893725 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:18.884760 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.897912 30346 raft_consensus.cc:2393] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:18.894572 29817 raft_consensus.cc:2368] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8.
I20260709 13:12:18.755100  1528 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:18.898417  1245 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:18.900367 30315 leader_election.cc:400] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8.
I20260709 13:12:18.901898 29674 raft_consensus.cc:2468] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:18.907166 29823 raft_consensus.cc:2393] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 13: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:18.908375 30315 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:18.921358 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:18.922148 29666 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.923216 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.783812  1494 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:18.890652  1363 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:18.937387  1542 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:18.941959  1532 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.942783  1544 consensus_queue.cc:1048] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
W20260709 13:12:18.943356  1527 log.cc:927] Time spent T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:12:18.946789  1461 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:18.953998  1503 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:12:18.958132  1501 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.884269  1302 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:18.907498  1543 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:18.961344 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:18.974041  1353 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.975185  1505 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:18.916743  1266 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:18.880788  1541 consensus_queue.cc:260] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.020655 29670 raft_consensus.cc:2468] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:18.981282  1302 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:18.974838  1532 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.033806 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:19.016494  1537 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.367s	user 0.001s	sys 0.000s
W20260709 13:12:19.021893  1259 consensus_meta.cc:287] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.707s	user 0.005s	sys 0.005s
I20260709 13:12:19.009786  1339 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.010257  1519 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.051177 29743 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 2865) took 1411 ms. Trace:
I20260709 13:12:19.009785  1410 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.030735  1266 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.969465 29669 raft_consensus.cc:2468] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 12.
I20260709 13:12:18.983111  1461 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:18.986946  1501 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.035480  1328 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.038271  1505 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.068620 29668 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:19.039786  1302 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:19.003367  1454 consensus_queue.cc:237] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.032176  1462 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:19.038694  1353 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.094655  1353 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.096058  1396 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.096861  1353 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:19.101023  1280 consensus_meta.cc:287] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: Time spent flushing consensus metadata: real 0.781s	user 0.003s	sys 0.007s
I20260709 13:12:19.047103  1535 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:19.082036 30316 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.001s	sys 0.013s
W20260709 13:12:19.117537 30316 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.001s	sys 0.013s
I20260709 13:12:19.068369  1266 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:19.082425 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 324731us
W20260709 13:12:19.113870 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 346630us
W20260709 13:12:19.082808 29714 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.011s
W20260709 13:12:19.119712 29714 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.003s	sys 0.011s
W20260709 13:12:19.083313 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 170449us
I20260709 13:12:19.056401 29818 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 14.
I20260709 13:12:19.059877  1259 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 9. Current term is 10.
I20260709 13:12:19.074157 29666 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:19.090816  1501 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:19.047777  1424 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.052163 29743 rpcz_store.cc:276] 0709 13:12:17.640137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.640619 (+   482us) service_pool.cc:224] Handling call
0709 13:12:17.640933 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:17.641229 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:17.641258 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.254882 (+613624us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b2c0001c328. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e83b6a11 00007fd9e83c6372 00007fd9e9af8a01 00007fd9e9abd43a 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2
0709 13:12:18.255360 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:12:18.421880 (+166520us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:12:18.421933 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.421995 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.043992 (+621997us) raft_consensus.cc:1685] finished
0709 13:12:19.044014 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.051096 (+  7082us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":65057,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":28486,"spinlock_wait_cycles":3034496,"thread_start_us":166153,"threads_started":1,"wal-append.queue_time_us":234764}
I20260709 13:12:19.067436  1461 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.129884 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.130193 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.130878 29822 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.132771 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:19.125830 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 346081us
I20260709 13:12:19.134690 29814 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:19.136446 29821 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:19.139812 29749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48026 (request call id 2877) took 1124 ms. Trace:
W20260709 13:12:19.126893  1427 consensus_meta.cc:287] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.813s	user 0.002s	sys 0.008s
I20260709 13:12:19.068986  1519 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.068017  1410 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:19.165684 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.158979 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.155493 29714 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.177821 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:19.152841 29822 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:19.140271 29749 rpcz_store.cc:276] 0709 13:12:18.014990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.204678 (+189688us) service_pool.cc:224] Handling call
0709 13:12:18.220497 (+ 15819us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.365093 (+144596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.365127 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.380259 (+ 15132us) log.cc:844] Serialized 26 byte log entry
0709 13:12:18.485690 (+105431us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:18.485725 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:18.486781 (+  1056us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:19.139581 (+652800us) raft_consensus.cc:1685] finished
0709 13:12:19.139605 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:19.139748 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29274,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":209625,"threads_started":2,"wal-append.queue_time_us":186128}
I20260709 13:12:19.180147 29714 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.047235  1552 consensus_queue.cc:1059] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:12:19.180931  1495 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.188462  1495 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.118400  1280 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:19.166185  1555 log.cc:927] Time spent T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:12:19.183879  1538 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:19.185510 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 46049.5us
I20260709 13:12:19.196871 29672 raft_consensus.cc:2368] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:19.088413  1505 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.182772  1564 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:19.134631  1396 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:19.166599  1551 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:12:19.191102  1528 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.193910 29673 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:19.158812 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:19.197067 29638 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:19.172571  1532 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.190626  1495 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:19.154119  1504 consensus_meta.cc:287] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
I20260709 13:12:19.191139  1424 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.180064  1427 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.218550  1280 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.220258  1505 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.214361  1259 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:19.227298 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.230268  1519 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.231755  1538 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.210551  1396 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:19.243711  1510 consensus_meta.cc:287] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:12:19.263449  1547 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.268067 30344 raft_consensus.cc:2368] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:12:19.269188  1547 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.270262 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.270880 29820 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.273272  1541 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:19.277210 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:19.283355  1302 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.288475 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.288476 29670 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:19.288681 29665 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:19.225631  1266 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.291709 29671 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:19.292737 30348 raft_consensus.cc:1275] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:12:19.293327 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.294739 29820 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:19.233249  1504 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:19.296530 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 111824us
I20260709 13:12:19.301496 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.302613 29714 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:19.303107 30316 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.27.229.65:35503 timed out after 1.840s (SENT) [suppressed 13 similar messages]
I20260709 13:12:19.261009  1538 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.306273  1538 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.292073  1525 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:19.309463 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.284387  1543 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.301096  1427 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.311124  1322 consensus_queue.cc:1048] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:19.315186  1266 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.316798 29744 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:19.317198 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:19.317548 30314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.311447  1302 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.262508  1510 raft_consensus.cc:515] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.323324  1396 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.324245  1410 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.324448  1510 leader_election.cc:290] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.326929 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:19.333981 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:19.334789 30346 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.335603 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:19.336458 30348 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:19.309618  1525 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.339644  1504 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:19.340524  1486 consensus_meta.cc:287] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.000s
I20260709 13:12:19.342731  1543 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:19.337415  1488 consensus_meta.cc:287] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 1.023s	user 0.011s	sys 0.000s
I20260709 13:12:19.348775  1363 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.350456 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.351447  1422 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.354787 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:19.355163 29671 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:12:19.355540 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.357508 30346 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:19.357724 29744 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 14.
I20260709 13:12:19.359046 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:19.360351 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.384696 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:19.361429 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 58925us
I20260709 13:12:19.362735 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:19.363207 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:19.385694 29666 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.365144 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.386073 29669 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:19.364035 29640 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:19.380194 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:19.387351 29640 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:19.385161 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:19.385816 29668 raft_consensus.cc:2393] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 11: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:19.385771 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:19.377661 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.381495 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:19.383958 29823 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 8: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:19.390975 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.365837  1525 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:19.392076 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:19.366377  1519 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:19.378894  1486 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 7. Current term is 8.
I20260709 13:12:19.393199 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.379896 30341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:19.396463 30350 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 10: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:19.394243 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.393221 30348 raft_consensus.cc:2368] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 13. Current term is 14.
I20260709 13:12:19.398291 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.398759 29740 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:19.399165 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:19.399729 29746 raft_consensus.cc:3060] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:19.395619  1422 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.399788 30341 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:19.406502  1519 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:19.407502 29746 raft_consensus.cc:2468] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:19.417413  1519 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.418581  1573 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.407564  1422 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.392072  1259 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:19.420903 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.389392  1504 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.418426 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:19.389854  1266 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:19.421964 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:19.405894 29666 raft_consensus.cc:2468] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
I20260709 13:12:19.408588 29789 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:19.396637  1320 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.383697  1488 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.439409  1455 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:19.439666  1423 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:19.410450  1396 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.443622 30347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 611) took 1337 ms. Trace:
I20260709 13:12:19.443666 29789 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.454720 30347 rpcz_store.cc:276] 0709 13:12:18.106484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.106611 (+   127us) service_pool.cc:224] Handling call
0709 13:12:19.443429 (+1336818us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54006216d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:19.443562 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864534400}
I20260709 13:12:19.456807 29714 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.451540 30343 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:19.458567 29714 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.461989 30350 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:19.466109 30350 raft_consensus.cc:1275] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:19.466401 29747 raft_consensus.cc:1240] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:12:19.466310 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.467870 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.468833 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c959a6f0c6345c9b312b54d4090ba28" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.428160  1266 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.469744 29822 raft_consensus.cc:2368] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:12:19.468755 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.470821 29714 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.429665  1259 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:19.474336 29821 raft_consensus.cc:2368] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 13. Current term is 14.
I20260709 13:12:19.452647  1454 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:19.460348 30341 raft_consensus.cc:1275] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:12:19.480930 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.425390  1424 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:12:19.482302 29714 leader_election.cc:400] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:12:19.442885  1561 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:12:19.464428  1410 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:19.464507  1507 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.489295 29714 leader_election.cc:403] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:12:19.460748  1320 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:19.474468  1266 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:19.419111  1573 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.487079 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.475871  1510 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:19.429643  1504 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.470283  1245 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:19.563133  1444 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:19.564733 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:19.565543 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 88360.5us
I20260709 13:12:19.566094  1427 raft_consensus.cc:2749] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:12:19.566629  1575 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:19.569520  1259 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.488458  1410 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.596823  1410 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:19.597878 30350 raft_consensus.cc:1240] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 3. Current term is 4. Ops: []
I20260709 13:12:19.461092  1396 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.599576  1075 consensus_queue.cc:1059] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:19.600647  1075 raft_consensus.cc:3055] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:19.601020  1075 raft_consensus.cc:740] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:19.582906 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.479629  1397 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:12:19.495522  1454 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:19.669464 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:19.670284 29749 raft_consensus.cc:2393] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 12: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:19.670704 30350 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:19.680305 29571 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.683276 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:19.684194 29749 raft_consensus.cc:2393] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 10: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:19.685153  1422 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.686627  1488 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.687801  1504 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.561050  1507 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.658768  1444 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.689211 30341 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:19.707567 29819 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51156 (request call id 2776) took 1267 ms. Trace:
I20260709 13:12:19.714581 29819 rpcz_store.cc:276] 0709 13:12:18.440607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.440961 (+   354us) service_pool.cc:224] Handling call
0709 13:12:18.441269 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:18.481617 (+ 40348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.707328 (+1225711us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b540041df54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:19.707510 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43032960}
I20260709 13:12:19.715773 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:19.729741 29749 raft_consensus.cc:1275] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:19.703066  1363 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.725673  1541 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.722579  1293 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:19.725484  1524 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:19.741535 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.743358 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.731962  1532 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:19.747357 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:19.708578  1545 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:12:19.750993 29672 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45248 (request call id 2742) took 1634 ms (client timeout 2066 ms). Trace:
W20260709 13:12:19.751466 29672 rpcz_store.cc:269] 0709 13:12:18.116582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.116718 (+   136us) service_pool.cc:224] Handling call
0709 13:12:19.750770 (+1634052us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540030eb54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:19.750926 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404332288}
I20260709 13:12:19.757280  1397 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.757822  1397 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.759905  1397 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:19.760390  1532 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.762581  1532 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.766987 30315 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:19.768160 30315 leader_election.cc:304] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:19.724221  1075 consensus_queue.cc:260] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.769169  1301 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:19.807564 29749 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:19.733839  1454 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.745738  1293 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.780351  1504 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.745055  1541 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.815954 30314 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:19.782001  1363 raft_consensus.cc:2804] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:19.746062  1524 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.780691  1507 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:19.827059 29748 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 1156) took 1932 ms (client timeout 1978 ms). Trace:
I20260709 13:12:19.814296  1573 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.833228 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:19.843502 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:19.830438 30314 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:19.839215 29748 rpcz_store.cc:269] 0709 13:12:17.894448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:17.894580 (+   132us) service_pool.cc:224] Handling call
0709 13:12:19.826845 (+1932265us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54001662d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:19.826989 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561140608}
I20260709 13:12:19.822129  1301 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:19.850258  1301 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.854465  1287 consensus_queue.cc:1059] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:19.855619  1502 raft_consensus.cc:3055] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:19.856000  1502 raft_consensus.cc:740] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:19.856838  1502 consensus_queue.cc:260] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.858556  1330 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:19.859342  1290 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:12:19.860088 30314 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.814530  1547 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:12:19.845752  1075 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:19.860276  1581 log.cc:927] Time spent T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:12:19.829351  1504 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.845894  1363 raft_consensus.cc:697] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:19.839468  1543 raft_consensus.cc:2749] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:19.898823  1524 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:19.914871  1583 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:19.884833  1444 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:19.920100  1525 consensus_meta.cc:287] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: Time spent flushing consensus metadata: real 0.514s	user 0.002s	sys 0.006s
I20260709 13:12:19.920576  1525 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.922295  1541 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.923152  1547 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.923683  1547 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.929617  1363 consensus_queue.cc:237] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.905772  1504 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:19.937228  1568 log.cc:927] Time spent T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.779s	user 0.006s	sys 0.004s
I20260709 13:12:19.940138  1502 raft_consensus.cc:3060] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:19.935075  1410 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.945072 29746 raft_consensus.cc:2393] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:19.946561 29714 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.948052 29714 leader_election.cc:400] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 13. Current term is 14.
I20260709 13:12:19.948390 29714 leader_election.cc:403] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:12:19.950917 30344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43540 (request call id 617) took 1068 ms. Trace:
I20260709 13:12:19.951380 30344 rpcz_store.cc:276] 0709 13:12:18.882503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.882643 (+   140us) service_pool.cc:224] Handling call
0709 13:12:19.950678 (+1068035us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400475c54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:19.950847 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791206144}
I20260709 13:12:19.925748  1547 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:19.962611 29743 raft_consensus.cc:2410] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:12:19.966814 29747 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48028 (request call id 2507) took 1593 ms. Trace:
I20260709 13:12:19.967242 29747 rpcz_store.cc:276] 0709 13:12:18.373380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.499991 (+126611us) service_pool.cc:224] Handling call
0709 13:12:18.500302 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.471343 (+971041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.966528 (+495185us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400224054. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9abde01 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:19.966743 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221309696}
I20260709 13:12:19.969714 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.971060 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.973341 29670 raft_consensus.cc:1240] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 12. Current term is 13. Ops: []
I20260709 13:12:19.974749 29670 raft_consensus.cc:1240] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:19.970520  1266 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.976377 29674 raft_consensus.cc:2393] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 9: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:19.978101  1266 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.979538  1410 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.983711 29744 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36354 (request call id 1168) took 1324 ms. Trace:
I20260709 13:12:19.984133 29744 rpcz_store.cc:276] 0709 13:12:18.659584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.662173 (+  2589us) service_pool.cc:224] Handling call
0709 13:12:19.983558 (+1321385us) spinlock_profiling.cc:243] Waited 646 ms on lock 0x7b54003ffa54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:19.983655 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1486293760}
I20260709 13:12:19.985849 29715 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:19.946625  1353 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.986868  1353 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:19.987234 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.988341 29569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50500 (request call id 323) took 10482 ms. Trace:
I20260709 13:12:19.988929  1353 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:19.990347 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.992137 29571 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 11, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 11 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:19.994684 29749 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:19.994508 29571 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 8, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:19.995369  1561 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:19.995879  1561 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:19.996165 29571 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:19.997845  1561 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:19.999130 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:19.999411 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.000203 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:19.998672 29571 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:20.000782 29749 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:20.002214  1507 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.004328  1528 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 13. Current term is 14.
I20260709 13:12:19.988705 29569 rpcz_store.cc:276] 0709 13:12:09.506211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.531600 (+ 25389us) service_pool.cc:224] Handling call
0709 13:12:19.988271 (+10456671us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:14.689401 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:14.689965 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:14.689999 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:12:14.690017 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:14.826576 (+136559us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:14.826632 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:14.826659 (+    27us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:12:14.828228 (+  1569us) tablet.cc:701] Row locks acquired
0709 13:12:14.828249 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:14.828407 (+   158us) write_op.cc:270] Start()
0709 13:12:14.828521 (+   114us) write_op.cc:276] Timestamp: P: 1783602734828352 usec, L: 0
0709 13:12:14.828543 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:12:14.838439 (+  9896us) log.cc:844] Serialized 9097 byte log entry
0709 13:12:15.526979 (+688540us) op_driver.cc:464] REPLICATION: finished
0709 13:12:15.752071 (+225092us) write_op.cc:301] APPLY: starting
0709 13:12:15.752181 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:15.940477 (+188296us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:15.940594 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:16.512996 (+572402us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:16.567575 (+ 54579us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:12:16.567620 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:16.568033 (+   413us) log.cc:844] Serialized 204 byte log entry
0709 13:12:16.640515 (+ 72482us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:16.660690 (+ 20175us) write_op.cc:454] Released schema lock
0709 13:12:16.668037 (+  7347us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:16.692932 (+ 24895us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:16.692976 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5520,"reported_tablets":36,"spinlock_wait_cycles":4352,"child_traces":[["op",{"apply.queue_time_us":212300,"apply.run_cpu_time_us":41747,"apply.run_wall_time_us":943316,"cfile_cache_hit":90,"cfile_cache_hit_bytes":94005,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":33864,"lbm_reads_1-10_ms":3,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":8,"num_ops":23,"prepare.queue_time_us":400522,"prepare.run_cpu_time_us":70515,"prepare.run_wall_time_us":329987,"raft.queue_time_us":130429,"raft.run_cpu_time_us":37674,"raft.run_wall_time_us":147232,"replication_time_us":698260,"thread_start_us":686619,"threads_started":5,"wal-append.queue_time_us":425621,"wal-append.run_cpu_time_us":29045,"wal-append.run_wall_time_us":2431852}]]}
I20260709 13:12:20.005064  1573 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:20.006254  1573 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.007961 29666 raft_consensus.cc:1275] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:20.002012 29571 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 8 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:20.008440  1573 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.009434 29714 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.004446  1507 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:20.011252  1507 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.009243 29571 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 11, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 11 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.013309 29815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51152 (request call id 2292) took 1256 ms. Trace:
I20260709 13:12:20.013511  1504 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:20.013199 29571 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 5 to 7, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:20.015199  1488 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:20.016705 29715 leader_election.cc:400] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 13. Current term is 14.
I20260709 13:12:19.986166 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:19.977653 29670 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:20.023245 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.023538 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.026420 29822 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:12:20.013720 29815 rpcz_store.cc:276] 0709 13:12:18.756890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.758099 (+  1209us) service_pool.cc:224] Handling call
0709 13:12:18.758379 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:18.758679 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.758705 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:18.759101 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:12:20.012787 (+1253686us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b540033ff20. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a27090 00007fd9e9a346b8 00007fd9e9abd92b 00007fd9e9abc83e 00007fd9eea81419 00007fd9e7ff8bd4 00007fd9e7ff8b62 00007fd9e7ff8a91 00007fd9e7ff8a0c 00007fd9e7ff7cc2 00007fd9e7df848c
0709 13:12:20.012846 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:20.012906 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.012974 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.013014 (+    40us) raft_consensus.cc:1685] finished
0709 13:12:20.013026 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.013238 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4224,"raft.queue_time_us":9914,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6458,"spinlock_wait_cycles":240830464,"thread_start_us":175818,"threads_started":1,"wal-append.queue_time_us":297407}
I20260709 13:12:20.020648 29787 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.046761 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.048240 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.048858 29670 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:20.049553 29571 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 8, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:20.050406 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.050863 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:20.051620 29670 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d in current term 13: Already voted for candidate a9d8198d0b954886af452e89a8029614 in this term.
I20260709 13:12:20.053090 29787 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:20.053797 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.054171 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.057040 29715 leader_election.cc:400] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 9. Current term is 10.
I20260709 13:12:20.048768  1525 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.058068 29715 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:20.058544  1525 consensus_queue.cc:1048] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:20.059597 29715 leader_election.cc:400] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12.
I20260709 13:12:20.059971  1525 raft_consensus.cc:2804] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:20.060513  1525 raft_consensus.cc:697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:20.049165  1302 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.077641 29742 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:12:20.013316  1507 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.085243 29817 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:20.049486  1510 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:20.068221  1353 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:20.068075  1302 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.052445  1300 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.054597  1561 consensus_queue.cc:1048] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:12:20.098282 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.107577 29815 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:12:20.068737  1545 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:20.126811 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 283367us
I20260709 13:12:20.128997 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:20.037671 29818 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
I20260709 13:12:20.140645 30315 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:20.134966 30316 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.056778  1541 consensus_queue.cc:1048] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:12:20.056957  1547 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:12:20.156020 29672 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:12:20.177062 30316 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:20.127681  1300 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:20.061367  1525 consensus_queue.cc:237] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.124239  1275 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:12:20.196656 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 143645us
I20260709 13:12:20.220937 29787 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.151955  1444 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:12:20.229051 29816 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:20.159487  1454 consensus_queue.cc:1048] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:12:20.185521  1453 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:12:20.230075 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 150639us
I20260709 13:12:20.244364 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:20.249437 30343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49712 (request call id 959) took 1626 ms (client timeout 1762 ms). Trace:
W20260709 13:12:20.249874 30343 rpcz_store.cc:269] 0709 13:12:18.623452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.624516 (+  1064us) service_pool.cc:224] Handling call
0709 13:12:20.249275 (+1624759us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540093b7d4. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:20.249379 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764244608}
W20260709 13:12:20.250358 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 109441us
I20260709 13:12:20.189605  1300 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:20.252271 30315 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.257773 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.235446  1543 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:20.239542  1519 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:12:20.236166  1302 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.245944  1561 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.272131 29787 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:20.231051  1266 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:12:20.247610  1541 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.277729 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.271152  1507 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.306437 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:20.267508  1605 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:20.313895 30346 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.266666  1342 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:20.314474 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 144384us
I20260709 13:12:20.278472  1519 consensus_queue.cc:1243] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 389c080a49494f8fb56c53fa7e6087f3 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:12:20.319041 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.274559  1543 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:20.271173  1353 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:12:20.325845 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 151373us
I20260709 13:12:20.286311  1532 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:20.315742  1605 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.351406  1605 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.352584  1545 consensus_queue.cc:1059] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:20.353624  1534 raft_consensus.cc:3055] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:20.354115  1534 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:20.354905  1534 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:20.330336  1589 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.200s	user 0.001s	sys 0.001s
I20260709 13:12:20.327684 30350 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:20.331982  1532 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.290217  1292 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:12:20.332545  1300 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.321822  1507 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.323302  1342 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.319322  1604 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:20.331086  1519 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:12:20.375662  1596 log.cc:927] Time spent T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:12:20.381582 29673 raft_consensus.cc:2468] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 4.
I20260709 13:12:20.319758  1363 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:20.328338  1320 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:20.323792  1594 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:12:20.375679  1597 log.cc:927] Time spent T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:12:20.379997  1604 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.361727 30346 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:20.402222 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.383193  1396 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.388944 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.389031 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.386188  1532 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.405249 29817 raft_consensus.cc:1813] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Handling vote request from an unknown peer 42c443079435463daa8845e244cec9d3
I20260709 13:12:20.385633  1507 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.393493 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.388944 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.415534 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:20.398391 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.375451  1293 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.381984 30341 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:20.403330 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.420135 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.421347 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.392102 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:20.422317 29749 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:20.383306  1342 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:20.426889 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.406419 29640 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:20.407677 29817 raft_consensus.cc:2410] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:20.416378 30350 raft_consensus.cc:2368] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:20.359942 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:20.428247 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:20.430510 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:20.429981 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 70127.4us
I20260709 13:12:20.403828  1604 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:20.433349 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:20.435325 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:20.435906 29743 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.437003 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
W20260709 13:12:20.437307 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 146086us
I20260709 13:12:20.437296 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.439260 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.440251 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.441044 29669 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
I20260709 13:12:20.442325 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.443260 29715 leader_election.cc:400] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:20.443626 29715 leader_election.cc:403] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:12:20.444617 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 267658us
I20260709 13:12:20.445179 29749 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:20.446067 30316 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.400957  1320 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.457201 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.450140 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:20.382800  1543 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.429627  1507 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:20.451776 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:20.452065 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.464574 29665 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:20.452457 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.453125 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.465381 29666 raft_consensus.cc:1275] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:20.456086 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:20.399977  1363 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.458096 29671 raft_consensus.cc:2368] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:20.457531 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:12:20.451030 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 44691.4us
I20260709 13:12:20.468175 29640 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:20.461433 30314 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:20.469192  1590 log.cc:927] Time spent T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.573s	user 0.003s	sys 0.001s
I20260709 13:12:20.433528  1396 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:20.442265  1594 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:20.471025 29667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45236 (request call id 2719) took 1727 ms. Trace:
I20260709 13:12:20.471385 29667 rpcz_store.cc:276] 0709 13:12:18.744054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.744155 (+   101us) service_pool.cc:224] Handling call
0709 13:12:18.744443 (+   288us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:12:18.774991 (+ 30548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:18.775026 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:12:18.780592 (+  5566us) log.cc:844] Serialized 52 byte log entry
0709 13:12:19.747602 (+967010us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b180033a480. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9ef898de1 00007fd9ef8a55b1 00007fd9e69b2e07 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b 00007fd9e965cd23 00007fd9e965d0d1 00007fd9e9a78a0f
0709 13:12:19.839537 (+ 91935us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:12:19.842463 (+  2926us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.065638 (+223175us) log.cc:844] Serialized 14 byte log entry
0709 13:12:20.065877 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:20.065972 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.468623 (+402651us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:12:20.470816 (+  2193us) raft_consensus.cc:1685] finished
0709 13:12:20.470837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.470970 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23496,"prepare.queue_time_us":5009,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":100,"raft.queue_time_us":39813,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":115745,"spinlock_wait_cycles":25863808,"thread_start_us":314475,"threads_started":2,"wal-append.queue_time_us":1110334}
I20260709 13:12:20.472782  1507 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.473790 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.461294  1615 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:20.465935 29670 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
I20260709 13:12:20.476657 29715 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.479003 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:20.480165 29715 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:20.480568 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 47930.4us
W20260709 13:12:20.482511 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 44066.1us
I20260709 13:12:20.486224 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:20.486927 29745 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 5.
I20260709 13:12:20.495589 29640 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:20.496730 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.497014 29749 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:20.497426 29668 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 13.
I20260709 13:12:20.457780  1556 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:20.499622 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.463088  1502 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:20.480216  1528 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:20.505016 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44006.6us
W20260709 13:12:20.508450 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 47157.5us
I20260709 13:12:20.491154  1575 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:20.511312 29640 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:20.495041  1510 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:20.513156  1510 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.509150 30316 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.510803 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:20.501390  1495 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:20.501268  1524 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:20.520684 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.507321  1525 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:20.525384  1363 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.526098  1563 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:20.507563  1603 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:20.509362  1588 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:20.516657  1552 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:20.515763  1510 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:20.534904  1617 log.cc:927] Time spent T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:12:20.508386  1396 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:20.514904  1290 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:20.532665  1613 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:12:20.546420  1290 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:20.508139  1502 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.541749  1563 raft_consensus.cc:697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:20.530607  1532 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:12:20.553982  1290 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:20.586032 29740 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:20.582294 29668 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:20.585074 29787 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:20.586081 29749 raft_consensus.cc:3055] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:20.587913 29749 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:12:20.583359 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 70976us
I20260709 13:12:20.543519  1588 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.589807 29638 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:20.588620 29749 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.551191  1396 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.601194 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.607359 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.595902  1561 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:12:20.613821 29743 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:20.593180  1507 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:20.620476 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 138650us
I20260709 13:12:20.624068 29816 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:20.627822 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:20.593549  1605 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.602670  1535 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:12:20.606627  1632 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:20.648449 29714 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.618395  1561 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:20.649209  1561 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:20.651011  1588 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.654862  1502 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.655252  1290 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.657581  1290 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:20.617187 30316 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:20.630733 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:20.646415 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:20.638945  1594 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:20.620577  1519 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165) with higher term. Message: Invalid argument: T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:20.631320  1320 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:20.660653  1618 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:20.628417  1634 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:20.675712 29673 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57422 (request call id 1184) took 1114 ms. Trace:
I20260709 13:12:20.625463  1563 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.629968 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:20.694540 30343 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:12:20.697584 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 80486us
I20260709 13:12:20.699564 29673 rpcz_store.cc:276] 0709 13:12:19.561032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.715519 (+154487us) service_pool.cc:224] Handling call
0709 13:12:20.660016 (+944497us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b5400342454. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9ac12fa 00007fd9eea82b17 00007fd9e7ffd6d4 00007fd9e7ffd662 00007fd9e7ffd591 00007fd9e7ffd50c 00007fd9e7ffc7c2 00007fd9e7df848c 00007fd9e7df78c6 00007fd9e7df726f
0709 13:12:20.675645 (+ 15629us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1455899008}
I20260709 13:12:20.700402 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.710677 30316 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:20.693503  1424 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:20.719851 29669 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:20.697151  1541 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:20.726871 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:20.728152 29640 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:20.722792  1320 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:20.730433  1320 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.730792  1320 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:20.725891 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 96010.8us
I20260709 13:12:20.722282  1502 raft_consensus.cc:2804] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:20.726349  1396 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.704509  1634 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.724956  1424 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:20.817603  1637 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:12:20.808043  1641 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:20.831452  1605 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:20.832090  1633 log.cc:927] Time spent T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:12:20.818337  1629 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:12:20.838657  1424 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:20.844511  1604 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.846045 29817 raft_consensus.cc:1240] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:12:20.848284  1604 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:20.850378  1561 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.852667  1634 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.853796  1561 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:20.859995  1641 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:20.862686  1641 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:20.871584  1320 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.892047  1320 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.875934  1534 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:20.903993 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.879930  1510 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:20.880354  1586 log.cc:927] Time spent T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.987s	user 0.004s	sys 0.000s
I20260709 13:12:20.917769 30347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49706 (request call id 690) took 1459 ms. Trace:
I20260709 13:12:20.918198 30347 rpcz_store.cc:276] 0709 13:12:19.458033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:19.458416 (+   383us) service_pool.cc:224] Handling call
0709 13:12:19.458704 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:19.459145 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:19.459171 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:19.475437 (+ 16266us) log.cc:844] Serialized 26 byte log entry
0709 13:12:19.823780 (+348343us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:12:19.834522 (+ 10742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:19.834815 (+   293us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:20.879627 (+1044812us) spinlock_profiling.cc:243] Waited 8.99 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:12:20.917437 (+ 37810us) raft_consensus.cc:1685] finished
0709 13:12:20.917460 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:20.917701 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":20674304,"thread_start_us":236847,"threads_started":1,"wal-append.queue_time_us":313175}
I20260709 13:12:20.926900  1510 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:20.936410  1502 raft_consensus.cc:697] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:20.937516  1502 consensus_queue.cc:237] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:20.943320 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:20.957412 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:20.975724  1543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.006s	sys 0.004s
W20260709 13:12:20.976637  1543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.006s	sys 0.004s
I20260709 13:12:20.976838 30344 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:12:21.026829 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:21.027690 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:21.028882 29667 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.036259 29666 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:21.042119 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:21.058779 29674 raft_consensus.cc:2410] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:12:21.061867  1245 raft_consensus.cc:493] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:21.062881  1245 raft_consensus.cc:515] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.067476 29749 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.068452 30344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:21.069546 30344 raft_consensus.cc:606] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
W20260709 13:12:21.070935 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 336345us
I20260709 13:12:21.074115 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:21.076601 29740 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:21.078743 30350 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:12:21.079286 30350 pending_rounds.cc:85] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 9
I20260709 13:12:21.079698 30350 pending_rounds.cc:107] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:12:21.080058 30350 raft_consensus.cc:2889] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:21.081771 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:21.083751  1410 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:21.092231  1545 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:21.093104  1545 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.097193  1619 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.098409 29666 raft_consensus.cc:1275] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:12:21.098196  1619 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.101266  1619 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:21.058815 29673 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:21.105165  1300 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:21.106088  1300 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:21.107036 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 73403.9us
I20260709 13:12:21.108572  1612 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.109404  1612 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.061045 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:21.110208  1339 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.079330 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.112215 29742 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:21.112381 29817 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:21.113718  1575 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:21.114568  1575 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.114879 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "955eae6c53474f8a9c1673dbd294937e" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.118970  1575 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.121528 30344 raft_consensus.cc:614] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:21.121903 29789 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:21.125038  1300 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:21.125990  1635 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:21.138511 29667 raft_consensus.cc:2468] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
W20260709 13:12:21.127983 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 60127.8us
I20260709 13:12:21.154417  1610 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:21.156548  1287 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:21.157055  1287 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:21.157459  1266 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:21.158469  1266 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.158756  1287 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.160930  1287 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.174340 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:21.147356  1280 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:21.176542  1280 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.151625  1612 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:21.189646  1245 leader_election.cc:290] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:21.204104 29747 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:21.204116 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.208215 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:21.210593 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:21.211374 29740 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:12:21.211863  1545 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:21.212409 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 58290us
I20260709 13:12:21.221205  1339 consensus_queue.cc:1059] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:21.222867 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:21.234082  1410 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:21.236344  1339 raft_consensus.cc:3055] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:21.236904  1339 raft_consensus.cc:740] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:21.238161  1339 consensus_queue.cc:260] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.241254 29748 raft_consensus.cc:1240] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260709 13:12:21.242635 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 69462.2us
I20260709 13:12:21.153612  1575 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:12:21.245112  1266 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:21.239832  1339 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:21.263689 29817 raft_consensus.cc:1275] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:21.264142 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:21.265167  1610 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:21.265100  1543 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:21.267453  1619 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.268210  1619 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.270710  1619 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:21.276787 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.277261 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:21.278035 30349 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:21.276777 30316 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:21.285429 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.286475 29748 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 13.
I20260709 13:12:21.291105 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:21.293471 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:21.294559 29715 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:21.295071 30343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:21.296072  1410 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:12:21.302495 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 114194us
I20260709 13:12:21.304062  1502 raft_consensus.cc:2804] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:21.309288 29740 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 6.
I20260709 13:12:21.296413 29715 leader_election.cc:400] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9.
I20260709 13:12:21.330302 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:21.332041 29749 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:12:21.341850  1663 log.cc:927] Time spent T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:12:21.322788  1280 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.257827 29572 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:21.354550 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 58408.9us
I20260709 13:12:21.355647 29715 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:21.356711  1245 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:12:21.357766  1275 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:21.360268  1525 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:12:21.361716 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.364859 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:21.365891 29665 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:21.366760  1280 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.366986 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.367376  1280 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.369681 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:21.371456 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:21.369726  1280 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.372902  1502 raft_consensus.cc:697] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:21.374130  1502 consensus_queue.cc:237] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.332487 29749 pending_rounds.cc:85] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 4
I20260709 13:12:21.377703 29749 pending_rounds.cc:107] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:12:21.378125 29749 raft_consensus.cc:2889] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:21.353186 29572 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.381994 29743 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 14.
I20260709 13:12:21.397235 29673 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:21.414012  1280 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.435353 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:21.440981 29823 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.442147 29817 raft_consensus.cc:3060] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:21.442507 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.446009 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.447347 29572 catalog_manager.cc:5697] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.450237  1519 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:21.451049  1519 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.451499 29572 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.453372  1519 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.454056  1486 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:12:21.456596 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.458472 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:21.459343 29669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:21.434757  1410 consensus_queue.cc:1048] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:12:21.460377 29667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:21.434293 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
W20260709 13:12:21.458133  1505 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:12:21.469242 29672 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:21.460420 29673 raft_consensus.cc:1275] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:21.465653  1280 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.480754 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.481069  1280 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.481863 29670 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:12:21.481943 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 54059.9us
W20260709 13:12:21.477084 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 53235.8us
I20260709 13:12:21.486085 29744 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 5. Current term is 6. Ops: []
I20260709 13:12:21.486167 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:21.493561 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.472462  1543 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.495623 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.473670  1486 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:12:21.501210 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307badafd0e64a4c87993caa003f0e2a" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.499567 29572 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.522179 29787 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:21.523849 29787 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:21.525228  1609 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:21.503470 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c538253e68554f7b82c0f993198e47d3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.525704  1609 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:21.526856  1543 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.536755 29669 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:21.540819 30314 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:21.526904  1397 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:12:21.551976  1618 consensus_queue.cc:1059] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:12:21.553133  1618 raft_consensus.cc:3055] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:21.553539  1618 raft_consensus.cc:740] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:21.554006  1562 consensus_queue.cc:1048] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:12:21.554724 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 94814.8us
I20260709 13:12:21.556121 30314 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:21.535230  1609 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:12:21.546293  1668 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:12:21.559229  1608 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.579484 29672 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 14.
I20260709 13:12:21.535991 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:21.572732 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:21.586395 29674 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 13. Current term is 14. Ops: [12.10-13.11]
I20260709 13:12:21.566304 29572 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:21.607610 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:21.589361 29638 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:21.594429  1245 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:21.610819  1245 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.598763 29572 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:21.634194  1275 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:21.640612  1275 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:21.641036  1275 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.611378 29817 raft_consensus.cc:1275] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:12:21.650463 29572 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 8 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:21.653378 29789 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:21.611918  1266 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:21.654867  1629 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:21.655316 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:21.654896  1618 consensus_queue.cc:260] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.656775  1618 raft_consensus.cc:3060] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:21.657171  1302 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:21.659564  1562 consensus_queue.cc:1059] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:12:21.660570  1562 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:21.660919  1562 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:21.663692  1608 consensus_queue.cc:1048] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:12:21.615801 29571 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 342) took 12026 ms (client timeout 15000 ms). Trace:
I20260709 13:12:21.615967 29715 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:21.613114  1245 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.612339  1545 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:21.747573 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.749869 29638 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:21.778823 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:21.661762  1562 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.759375  1519 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:21.741294  1609 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:21.783171 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f35983a3f0f340da8a2b9daae61af306" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:21.786034 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 196642us
I20260709 13:12:21.787840  1280 consensus_queue.cc:1059] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:12:21.792555  1610 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:21.792956  1588 consensus_queue.cc:1059] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:21.793196  1610 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.814661  1610 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.815795  1543 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:21.791328  1423 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:21.791075 30342 raft_consensus.cc:1240] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:21.781811  1545 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:21.792505  1280 raft_consensus.cc:3055] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:12:21.828045 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.803778  1609 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:21.804967 29715 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:21.806424 29816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.806999  1259 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:21.809695 29818 pending_rounds.cc:85] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 9
I20260709 13:12:21.831022 29818 pending_rounds.cc:107] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:12:21.831352 29818 raft_consensus.cc:2889] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:21.810071  1603 consensus_queue.cc:1059] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:12:21.811973 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:21.790144  1519 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:21.820406 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.803617 29668 raft_consensus.cc:2410] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:12:21.690663 29571 rpcz_store.cc:269] 0709 13:12:09.588882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:09.593854 (+  4972us) service_pool.cc:224] Handling call
0709 13:12:21.615569 (+12021715us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:20.354389 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:20.354916 (+   527us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:20.354945 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:12:20.354962 (+    17us) tablet.cc:662] Decoding operations
0709 13:12:20.420113 (+ 65151us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:20.429807 (+  9694us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:20.431963 (+  2156us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:12:20.462365 (+ 30402us) tablet.cc:701] Row locks acquired
0709 13:12:20.462385 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:12:20.462534 (+   149us) write_op.cc:270] Start()
0709 13:12:20.462650 (+   116us) write_op.cc:276] Timestamp: P: 1783602740462484 usec, L: 0
0709 13:12:20.462674 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:12:20.463288 (+   614us) log.cc:844] Serialized 3606 byte log entry
0709 13:12:20.954929 (+491641us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e69b30ac 00007fd9ef80dab9 00007fd9e69cf69b 00007fd9e69cd93f 00007fd9e69cfc02 00007fd9e965720b
0709 13:12:20.966995 (+ 12066us) op_driver.cc:464] REPLICATION: finished
0709 13:12:20.979202 (+ 12207us) write_op.cc:301] APPLY: starting
0709 13:12:20.979284 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:20.984671 (+  5387us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:20.984689 (+    18us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:20.988767 (+  4078us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:20.988981 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:12:20.989029 (+    48us) write_op.cc:312] APPLY: finished
0709 13:12:21.208284 (+219255us) log.cc:844] Serialized 89 byte log entry
0709 13:12:21.232422 (+ 24138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:21.232665 (+   243us) write_op.cc:454] Released schema lock
0709 13:12:21.232789 (+   124us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:21.233453 (+   664us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:21.233490 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1869560,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":11946,"apply.run_cpu_time_us":11577,"apply.run_wall_time_us":254146,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41729,"num_ops":9,"prepare.queue_time_us":183818,"prepare.run_cpu_time_us":7519,"prepare.run_wall_time_us":601352,"raft.queue_time_us":8829,"raft.run_cpu_time_us":2774,"raft.run_wall_time_us":11162,"replication_time_us":504144,"spinlock_wait_cycles":4423808,"thread_start_us":614346,"threads_started":4,"wal-append.queue_time_us":492311}]]}
I20260709 13:12:21.830579 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.828295  1280 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
W20260709 13:12:21.850395 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 45574.8us
I20260709 13:12:21.835896  1519 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:21.847853  1635 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:21.872306  1410 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:12:21.882742 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 102076us
I20260709 13:12:21.877378 29823 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:21.883793 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.881116 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:21.891099 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.891755 29745 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
W20260709 13:12:21.910501 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 131767us
I20260709 13:12:21.911662 29639 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:21.876005  1397 raft_consensus.cc:697] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:21.907063  1629 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:21.908239  1502 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:21.898453  1410 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:21.919934 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:21.921568 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 385169us
I20260709 13:12:21.913372  1245 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:21.883666  1635 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:21.951644 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 80821.7us
W20260709 13:12:21.953483  1677 log.cc:927] Time spent T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:12:21.955515 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:21.958775 29714 leader_election.cc:304] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:21.960103 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:21.962044 30345 raft_consensus.cc:1240] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:12:21.962985  1604 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:21.963517  1604 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:21.967408  1674 log.cc:927] Time spent T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:12:21.968370  1410 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.961850 29746 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:21.909732  1275 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:21.965672  1604 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:21.939442  1502 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:21.936226  1612 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:21.920823  1280 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:22.023219 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 90806.4us
I20260709 13:12:22.033654 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.039777 29639 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:21.984817  1525 raft_consensus.cc:2749] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.045764  1427 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.054442 29715 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.063203 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.063800 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:21.997794  1609 consensus_queue.cc:1048] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:12:22.069669 29639 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.055831  1543 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:12:22.068339 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 70171.3us
I20260709 13:12:22.077582 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.065097  1525 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:22.085101 29787 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.086638 29672 raft_consensus.cc:1275] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:12:22.086828 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 46508.9us
I20260709 13:12:22.088655 29674 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:22.091517 29674 raft_consensus.cc:606] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
W20260709 13:12:22.095875 29715 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.081759  1259 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:22.103485  1610 consensus_queue.cc:1048] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:12:22.106709  1575 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:22.107209  1690 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:22.107435  1575 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.107777  1690 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:22.110518  1685 log.cc:927] Time spent T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:12:22.098395  1502 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.111713  1689 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.112085  1502 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.109689  1575 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:22.110780  1635 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:22.119621 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.120175 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.112255  1689 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.122392  1427 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:22.123208  1689 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.123014  1427 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:22.106945  1679 log.cc:927] Time spent T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:12:22.128121 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.128914 29749 raft_consensus.cc:2393] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:22.101444  1280 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:12:22.176867 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 56793.7us
I20260709 13:12:22.131080 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.132889  1575 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:12:22.181135  1692 log.cc:927] Time spent T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:12:22.182762 29748 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:22.101573  1543 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:22.185367  1693 log.cc:927] Time spent T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:12:22.185828  1543 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.186393 29666 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:22.186805  1423 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:22.130352  1690 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.080056  1397 consensus_queue.cc:237] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.195219 30350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:22.195907 30350 raft_consensus.cc:606] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.196250 30350 raft_consensus.cc:614] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:22.187292  1423 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:22.179715  1427 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.205132  1695 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.205693  1695 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.207388  1519 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.207962  1695 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.210572  1423 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.219236 29638 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:22.223316 29742 raft_consensus.cc:1240] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:22.232483 29715 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.234890  1629 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:22.234766  1427 consensus_queue.cc:1048] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:22.235555  1525 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:22.239725  1690 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:22.240366  1690 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.242329  1519 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.243897  1266 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:22.244369  1266 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.244745  1266 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.245386  1423 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:22.246289 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.246754  1497 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:22.247727 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.248360 29744 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:22.249305 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.250277  1534 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:22.244439  1690 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.250892  1534 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.253110  1534 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:22.254297 29674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.258723 29749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:22.251292  1669 log.cc:927] Time spent T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.654s	user 0.004s	sys 0.000s
I20260709 13:12:22.265029 30344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43540 (request call id 647) took 1017 ms. Trace:
I20260709 13:12:22.265451 30344 rpcz_store.cc:276] 0709 13:12:21.247170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:21.247311 (+   141us) service_pool.cc:224] Handling call
0709 13:12:21.248897 (+  1586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:21.249432 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:21.249475 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:21.250178 (+   703us) log.cc:844] Serialized 26 byte log entry
0709 13:12:21.388075 (+137897us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:12:21.388120 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:21.388197 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:22.250621 (+862424us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e6858db1 00007fd9e68f6c85 00007fd9e68f76a2 00007fd9e96691db 00007fd9e9664aaf 00007fd9e965886e 00007fd9e9657bb6 00007fd9e96577d8 00007fd9e9661221 00007fd9e96611d9 00007fd9e9661169
0709 13:12:22.264699 (+ 14078us) raft_consensus.cc:1685] finished
0709 13:12:22.264720 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:22.264940 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1622,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"spinlock_wait_cycles":3909632,"thread_start_us":137394,"threads_started":1,"wal-append.queue_time_us":262928}
I20260709 13:12:22.274387 30345 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:22.235396  1629 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.278893  1275 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:22.282616 30313 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.283998  1562 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.286752 29715 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.288780  1519 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.290262 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.294476  1543 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:22.297708 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.299284 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:22.300954 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.301450  1339 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:22.302958  1588 raft_consensus.cc:993] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:22.303136  1339 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.303465  1588 raft_consensus.cc:1081] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:22.303539  1339 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.288388 29715 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.311300  1519 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:22.311820  1519 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:22.312325  1519 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:22.315450 29786 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:22.320478 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.324579 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.325301 29818 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 8.
I20260709 13:12:22.330917 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.333740 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.336678 30345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:22.337387 30345 raft_consensus.cc:606] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:22.338263 30345 raft_consensus.cc:614] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:12:22.351610 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.112414  1652 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.239s
I20260709 13:12:22.352687  1604 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:22.352087 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.353129 29823 raft_consensus.cc:1240] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:22.353458 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.360351 29820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.361122 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.362694 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.364490 29740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
W20260709 13:12:22.364876 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 71674.6us
I20260709 13:12:22.365427 29740 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:22.365622 30315 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.365899 29740 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.364562 29818 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 13. Current term is 14. Ops: []
I20260709 13:12:22.379223  1339 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.381652  1339 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:22.382663 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 282880us
I20260709 13:12:22.432140 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.432932  1619 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.434130 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:22.434937  1300 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:22.383538  1629 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.385210 29666 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:22.436704 29814 raft_consensus.cc:1240] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Rejecting Update request from peer a9d8198d0b954886af452e89a8029614 for earlier term 8. Current term is 9. Ops: []
I20260709 13:12:22.437800  1629 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:22.395831 30315 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
W20260709 13:12:22.440045 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 44686us
I20260709 13:12:22.403116  1707 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:22.442134 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.407248  1301 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:22.443488  1275 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.410109 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.444088  1301 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.446353  1301 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.412806 29639 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.390031 29740 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.448695 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.449199  1707 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.449339 29671 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:22.419302  1502 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:22.419423  1562 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:22.450596  1562 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.428504 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:22.451013 30316 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.451601 29814 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Rejecting Update request from peer 121060c6c5b14502957b76fd1dfc7b2d for earlier term 14. Current term is 15. Ops: []
I20260709 13:12:22.430045 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.396183 30345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca"
dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:50558
I20260709 13:12:22.451133  1502 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:22.452894 30345 raft_consensus.cc:606] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:22.453238  1562 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:22.452889  1502 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.453855  1562 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:22.451537 29742 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.417846  1266 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.456139  1562 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:22.456647  1266 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.456681  1562 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.440575  1287 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:22.458254 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
W20260709 13:12:22.408012 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 170670us
I20260709 13:12:22.452306 29740 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.458945 29744 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.461212  1280 consensus_queue.cc:1059] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:22.462107  1695 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:22.462581  1699 raft_consensus.cc:3055] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:22.463020  1699 raft_consensus.cc:740] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:22.463838  1699 consensus_queue.cc:260] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.458268 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.465420  1699 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.466889 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:22.467733 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:22.459177 29818 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.469252 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:22.470080 29671 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:22.471892 30316 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.473898 29744 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 9.
I20260709 13:12:22.474921  1275 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:22.477015  1275 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:22.477494  1275 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.482772 29638 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.483053 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.487013  1275 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.488267  1699 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:22.487026 29742 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:22.441251  1519 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.490432 29638 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.491585  1519 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.493466 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.493642 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.494208 29671 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.494325  1699 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:22.495438  1699 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.498545  1339 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:22.499132  1339 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:22.500002  1339 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.508090 29671 raft_consensus.cc:2468] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:22.508554  1275 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:22.510355 30316 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.510201  1502 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.511543  1275 raft_consensus.cc:2804] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:22.511730  1339 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.512127  1275 raft_consensus.cc:697] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:22.512491  1707 consensus_queue.cc:1059] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:22.513540  1339 raft_consensus.cc:3055] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:22.514001  1339 raft_consensus.cc:740] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:22.514909  1339 consensus_queue.cc:260] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.515616  1502 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.514056 29639 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.516389  1339 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.513144  1275 consensus_queue.cc:237] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.518589  1707 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.522142  1707 consensus_queue.cc:1059] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:22.517912  1562 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:22.523609 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 87559.9us
I20260709 13:12:22.524109 30344 raft_consensus.cc:2393] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 12: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:22.528119 29789 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.528308  1695 raft_consensus.cc:3055] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:22.528772  1695 raft_consensus.cc:740] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:22.530088  1619 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:12:22.523204  1300 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:22.531912  1300 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.532233 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.533269  1519 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:22.533674  1519 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:22.529696 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.534242  1519 raft_consensus.cc:3060] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.532446  1562 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.537386 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.550273 29670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.550908 29670 raft_consensus.cc:3055] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:22.529726  1695 consensus_queue.cc:260] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.551203 29670 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:22.543006 29669 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:22.551909 29670 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.553258 29670 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.543139 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:22.548755 29666 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:22.550303 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.538620  1619 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:12:22.538892 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.551872  1695 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.552067  1525 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:22.535127 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.559957 30345 raft_consensus.cc:1240] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:22.523326  1397 consensus_queue.cc:1059] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:12:22.563862  1619 raft_consensus.cc:3055] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:22.565653  1619 raft_consensus.cc:740] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:22.566632  1619 consensus_queue.cc:260] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.568059  1619 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.570235 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:22.578547 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:22.582038 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:22.585016 29670 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:22.586278 29715 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.587872 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:22.589342 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.589542 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:22.523141 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 87693.8us
I20260709 13:12:22.594924 29817 raft_consensus.cc:2393] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:22.596556 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.597276 29742 raft_consensus.cc:1240] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:12:22.598834 29818 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 10.
I20260709 13:12:22.604257 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:22.610183 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:22.610348 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.611070 29822 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:22.613521 29571 catalog_manager.cc:5697] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:22.616254 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27ef48e8ba554972a5c426adeff23599" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.611685 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.616151 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:22.618652 29746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:22.635560 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.621481 29571 catalog_manager.cc:5697] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:22.641880 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.612948  1575 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:22.641052 29571 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 11 to 13, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 13 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:22.647151 29571 catalog_manager.cc:5697] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 9 to 11, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 11 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:22.642551 29640 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:22.648861 29571 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:22.595065  1525 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:12:22.655077 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 200) took 8909 ms. Trace:
I20260709 13:12:22.643360  1245 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:22.656294 29571 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 9, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:22.665539 29819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:22.666154  1497 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:22.661433 29572 rpcz_store.cc:276] 0709 13:12:13.758073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:13.762060 (+  3987us) service_pool.cc:224] Handling call
0709 13:12:22.647199 (+8885139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:22.050348 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:22.051038 (+   690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:22.051091 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:12:22.051104 (+    13us) tablet.cc:662] Decoding operations
0709 13:12:22.052007 (+   903us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:22.052094 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:22.052123 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:12:22.052871 (+   748us) tablet.cc:701] Row locks acquired
0709 13:12:22.052921 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:12:22.053119 (+   198us) write_op.cc:270] Start()
0709 13:12:22.053274 (+   155us) write_op.cc:276] Timestamp: P: 1783602742053050 usec, L: 0
0709 13:12:22.053293 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:12:22.089019 (+ 35726us) log.cc:844] Serialized 3218 byte log entry
0709 13:12:22.372546 (+283527us) op_driver.cc:464] REPLICATION: finished
0709 13:12:22.478190 (+105644us) write_op.cc:301] APPLY: starting
0709 13:12:22.478284 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:22.515354 (+ 37070us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:22.518885 (+  3531us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:22.559447 (+ 40562us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:22.559733 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:12:22.559803 (+    70us) write_op.cc:312] APPLY: finished
0709 13:12:22.560083 (+   280us) log.cc:844] Serialized 81 byte log entry
0709 13:12:22.560263 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:22.562897 (+  2634us) write_op.cc:454] Released schema lock
0709 13:12:22.562942 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:22.563388 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:22.563415 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60096,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":105393,"apply.run_cpu_time_us":12362,"apply.run_wall_time_us":85140,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37551,"num_ops":8,"prepare.queue_time_us":204873,"prepare.run_cpu_time_us":4792,"prepare.run_wall_time_us":60757,"replication_time_us":277049,"thread_start_us":219667,"threads_started":2}]]}
I20260709 13:12:22.708889 29571 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 11 to 12, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 12 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:22.718667 30315 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.654379  1619 consensus_queue.cc:1059] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:12:22.720412 30315 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.654335  1519 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:22.713845  1725 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 13:12:22.793861 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 118525us
W20260709 13:12:22.826351 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 110020us
I20260709 13:12:22.890825 29668 raft_consensus.cc:2468] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:22.891041 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:22.892719  1746 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:12:22.905551  1608 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:12:22.906752 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 186409us
I20260709 13:12:22.908972  1603 raft_consensus.cc:2749] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:12:22.914265 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:22.869685 29571 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:22.916754  1609 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:12:22.871891 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 236424us
I20260709 13:12:22.917855 29571 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 11 to 13, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 13 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:22.924083 29671 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:12:22.924127 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:22.927811 29823 raft_consensus.cc:2468] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:22.928213  1743 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:22.889725  1519 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:22.948228 29673 raft_consensus.cc:2468] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:22.875682 29822 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
I20260709 13:12:22.704725  1683 consensus_queue.cc:1059] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:12:22.952593  1683 raft_consensus.cc:3055] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:22.953007 30342 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:12:22.878095 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 155573us
W20260709 13:12:22.878841  1724 log.cc:927] Time spent T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.376s	user 0.000s	sys 0.006s
I20260709 13:12:22.712762  1543 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:12:22.957715  1543 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:22.958174  1543 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:22.959036  1543 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.961073  1690 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:22.950663 29715 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.723042 30345 raft_consensus.cc:1240] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:22.952975  1683 raft_consensus.cc:740] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:22.961694  1690 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.962975  1683 consensus_queue.cc:260] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.964157  1690 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:22.965713  1543 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:22.966012  1683 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:22.882385  1497 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:22.974597 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:22.975487 29740 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 14: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:22.977139 29745 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:12:22.981364  1525 raft_consensus.cc:2804] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:22.982107  1525 raft_consensus.cc:697] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:22.982954  1738 consensus_queue.cc:1059] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:22.983937  1738 raft_consensus.cc:3055] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:22.984310  1738 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:22.983052  1525 consensus_queue.cc:237] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:22.985165  1738 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:22.986478  1738 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:22.995174 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:22.995872 30350 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 14.
I20260709 13:12:22.997026 29640 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:22.995986  1746 consensus_queue.cc:1059] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:12:22.997856  1746 consensus_queue.cc:1243] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer 121060c6c5b14502957b76fd1dfc7b2d log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:22.998615  1453 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:22.999158  1453 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:22.999600  1453 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:22.985183 29571 catalog_manager.cc:5697] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 12, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 12 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:23.004112 29571 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 11, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 11 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:23.005975 29571 catalog_manager.cc:5697] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.014068 29740 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:23.019367  1742 raft_consensus.cc:3055] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:12:23.019815  1742 raft_consensus.cc:740] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:23.020648  1742 consensus_queue.cc:260] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.023025  1742 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:23.016417 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 310175us
I20260709 13:12:23.026407 29789 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:23.029500 29571 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.028334 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:23.031224  1740 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:23.034790 29571 catalog_manager.cc:5697] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 7 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:23.030480  1677 log.cc:927] Time spent T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.096s	user 0.005s	sys 0.007s
I20260709 13:12:23.037896 29571 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.040923  1547 raft_consensus.cc:993] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
W20260709 13:12:23.062166  1729 log.cc:927] Time spent T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.134s	user 0.005s	sys 0.005s
W20260709 13:12:23.036761  1688 log.cc:927] Time spent T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.131s	user 0.015s	sys 0.003s
I20260709 13:12:23.051069  1427 raft_consensus.cc:3055] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.063140  1427 raft_consensus.cc:740] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
W20260709 13:12:23.051532  1728 log.cc:927] Time spent T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: Append to log took a long time: real 0.158s	user 0.006s	sys 0.017s
I20260709 13:12:23.064043  1427 consensus_queue.cc:260] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.065460  1427 raft_consensus.cc:3060] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.062426  1547 raft_consensus.cc:1081] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:23.034770  1575 raft_consensus.cc:697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:23.072796  1575 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.033799  1619 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:23.078202  1747 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:23.034411 29789 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:23.088675  1497 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:23.091800  1747 raft_consensus.cc:2804] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:23.092362  1747 raft_consensus.cc:697] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:23.093250  1747 consensus_queue.cc:237] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.073823 29822 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:52208
I20260709 13:12:23.094435 29822 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:23.094892 29822 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.102005 29745 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:12:23.103029 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 68695.8us
I20260709 13:12:23.107746  1410 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.108296  1410 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.109174 30344 raft_consensus.cc:1240] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:12:23.089601 29571 catalog_manager.cc:5697] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 9, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:23.119169 29571 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.120636 29823 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:23.125593 29814 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:12:23.126180 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:23.138788 29814 pending_rounds.cc:85] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 4
I20260709 13:12:23.118981 29822 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.139052 29673 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 6.
I20260709 13:12:23.139140 29814 pending_rounds.cc:107] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:12:23.139906 29814 raft_consensus.cc:2889] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.140532 29715 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:23.111811  1453 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.146401  1410 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:23.147840  1453 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:23.149426 29743 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:23.149726  1497 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:23.151206  1612 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:23.152524  1612 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:23.154377 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:23.160853 29822 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:23.162557 29668 raft_consensus.cc:1275] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:12:23.163578  1543 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:23.164242  1543 consensus_queue.cc:1243] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Peer 42c443079435463daa8845e244cec9d3 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:12:23.168251 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:23.170704 29714 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:23.171408 29673 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:12:23.179721 29745 raft_consensus.cc:2393] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 14: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:23.182376 29740 pending_rounds.cc:85] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Aborting all ops after (but not including) 9
I20260709 13:12:23.182696 29740 pending_rounds.cc:107] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:12:23.182924 29740 raft_consensus.cc:2889] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.185387 29668 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:23.185835 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:23.177340  1410 raft_consensus.cc:2804] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:23.186940 29822 raft_consensus.cc:2393] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:23.187002 29571 catalog_manager.cc:5697] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.180856  1738 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:23.192749 30350 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:12:23.194718 30350 pending_rounds.cc:85] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting all ops after (but not including) 10
I20260709 13:12:23.194993 30350 pending_rounds.cc:107] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:12:23.192957 29571 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:23.195226 30350 raft_consensus.cc:2889] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:23.179080  1301 consensus_queue.cc:1048] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:12:23.197834 30342 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 14.
I20260709 13:12:23.199013 29640 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:23.200769 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:23.201246 29668 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:23.202178 29571 catalog_manager.cc:5697] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } }
I20260709 13:12:23.204599  1738 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:23.205128  1738 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:23.206947  1739 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.207530  1739 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.194823  1410 raft_consensus.cc:697] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:23.210942  1410 consensus_queue.cc:237] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.212826  1739 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:23.214285 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:23.215127 29671 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 14: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:23.216794 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:23.217456 30350 raft_consensus.cc:1813] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Handling vote request from an unknown peer 42c443079435463daa8845e244cec9d3
I20260709 13:12:23.218050 30350 raft_consensus.cc:2410] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:12:23.200075 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:23.222802 29745 raft_consensus.cc:1240] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:12:23.223837 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "950ba8523bd4460bb0db3a8ae291f1ca" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:23.224547 30342 raft_consensus.cc:3055] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:12:23.224860 30342 raft_consensus.cc:740] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:23.239203 29668 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:23.240650 29715 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:23.241096  1702 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:23.242185  1525 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:23.241698  1702 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:23.247745 30342 consensus_queue.cc:260] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.237339  1619 consensus_queue.cc:1059] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:12:23.280841  1541 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.281437  1541 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.283656  1541 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:23.288872 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:23.253311  1747 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:12:23.289598 29671 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:23.304971 30316 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:23.307765 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:23.306178  1742 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:12:23.309145  1541 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:23.314364  1541 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.310688  1702 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.314813  1541 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.323544  1740 raft_consensus.cc:3055] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:23.324026  1740 raft_consensus.cc:740] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:23.324903  1740 consensus_queue.cc:260] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.328583  1525 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:23.333210  1749 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.333796  1749 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.343925  1749 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:23.347086 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:23.347800 29671 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 14.
I20260709 13:12:23.348758 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:23.351630  1758 log.cc:927] Time spent T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:12:23.354525 30316 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:23.356592  1740 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:23.362188  1543 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:23.362673  1543 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.363026  1543 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:23.310356 29789 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:23.373464 30342 raft_consensus.cc:3060] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:23.380445 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 71515.2us
I20260709 13:12:23.383889  1747 raft_consensus.cc:2804] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:23.344056  1541 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.384876  1609 consensus_queue.cc:1059] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:12:23.408957  1541 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:23.410007 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:23.410663 29671 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.402815  1747 raft_consensus.cc:697] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:23.420491 30342 raft_consensus.cc:2468] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:23.420420 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:23.432734 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:23.434433 29671 raft_consensus.cc:2468] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
I20260709 13:12:23.435941 30316 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:23.444998  1738 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.446192  1747 consensus_queue.cc:237] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.450778 29740 raft_consensus.cc:1240] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:12:23.447319  1738 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:23.440929  1547 raft_consensus.cc:2804] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:23.452173  1742 raft_consensus.cc:3055] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:12:23.452638  1742 raft_consensus.cc:740] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:23.453454  1742 consensus_queue.cc:260] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.454886  1742 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:23.436730  1609 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:12:23.460995 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:23.470409 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:23.472589  1704 consensus_queue.cc:1059] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:23.472592 29814 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:23.479362 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:23.452248  1547 raft_consensus.cc:697] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:23.490592  1427 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:23.502861 29715 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:23.488045  1683 raft_consensus.cc:3055] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:12:23.515059  1547 consensus_queue.cc:237] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.510645  1738 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:12:23.511627  1683 raft_consensus.cc:740] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:23.542712  1683 consensus_queue.cc:260] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.543939  1683 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:12:23.544701  1756 log.cc:927] Time spent T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 13:12:23.600356 29670 raft_consensus.cc:1275] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:23.629667  1739 consensus_queue.cc:1048] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:12:23.667858 30350 raft_consensus.cc:3060] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:23.680356 29673 raft_consensus.cc:2955] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 8 to 10, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:23.645874  1543 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.692657 30342 raft_consensus.cc:1240] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:12:23.695395 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:23.699522 29665 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:12:23.702346 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:23.698312  1543 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:23.705009 30315 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:23.706146  1543 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:12:23.715975 29814 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:12:23.717952  1763 log.cc:927] Time spent T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: Append to log took a long time: real 0.067s	user 0.004s	sys 0.000s
I20260709 13:12:23.723869  1746 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:12:23.742745 29665 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:23.743993 30342 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:12:23.745321  1739 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:23.745594  1612 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:12:23.758333  1747 consensus_queue.cc:1059] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:12:23.760711  1683 raft_consensus.cc:3055] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:23.761126  1683 raft_consensus.cc:740] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:23.761904  1683 consensus_queue.cc:260] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.764729  1739 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:23.765303  1739 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.766252  1683 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:23.768180  1739 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:23.771064 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:23.771751 29665 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 14.
I20260709 13:12:23.771852 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:23.772681 29817 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 14: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:23.774837  1739 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:23.775377  1739 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.778898 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:23.783012 29715 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:23.784940 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:23.785774 29665 raft_consensus.cc:2368] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 12. Current term is 13.
I20260709 13:12:23.786644  1738 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:23.787078  1738 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:23.787433  1738 raft_consensus.cc:3060] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:23.794466 29715 leader_election.cc:400] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 12. Current term is 13.
I20260709 13:12:23.794870 29715 leader_election.cc:403] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:23.785110 30350 raft_consensus.cc:1275] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:23.795610 29673 raft_consensus.cc:3060] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:23.796427  1427 raft_consensus.cc:3060] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:12:23.797206  1739 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:23.805083 29673 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:23.810348  1747 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:23.813443  1618 consensus_queue.cc:1048] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:23.818431 29740 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:12:23.826979 29822 raft_consensus.cc:1275] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:23.828713  1739 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:12:23.833520  1410 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.838210  1575 consensus_queue.cc:1048] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:23.838379  1410 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.839646  1427 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503) with higher term. Message: Invalid argument: T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 12. Current term is 13.
I20260709 13:12:23.840811  1410 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:23.829728  1497 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:12:23.842638 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:23.843941 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:23.848258 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:23.837400  1738 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.862826  1738 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:23.868870 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:23.870038 29671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:23.878504 29822 raft_consensus.cc:2393] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 14: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:23.886035 29671 raft_consensus.cc:2468] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 14.
I20260709 13:12:23.887629 29715 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:23.893725  1575 raft_consensus.cc:2804] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:23.894428  1575 raft_consensus.cc:697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 14 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:23.895455  1575 consensus_queue.cc:237] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:23.922976  1738 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:23.928611  1410 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:23.956444  1738 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:23.972890  1738 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:23.979023 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:23.979717 30344 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 15.
I20260709 13:12:23.980584 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:23.981328 29822 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 15: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:23.982326 29715 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:23.984154  1739 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:23.984549  1739 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:23.984910  1739 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:24.028575 29740 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:24.034993  1541 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:24.032244  1739 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.039323 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:24.039811 29673 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:24.040073 29822 raft_consensus.cc:2393] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 15: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:24.042476 29673 raft_consensus.cc:1275] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:12:24.043603  1742 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:24.044217  1543 consensus_queue.cc:1048] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:24.052772  1739 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:24.058295 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:24.064956 30342 raft_consensus.cc:1275] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:24.069653  1300 consensus_queue.cc:1048] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:24.069578 30350 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 15.
I20260709 13:12:24.080065 29715 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:24.081243  1575 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:24.081768  1575 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 15 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:24.082635  1575 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.114444  1742 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:24.115057  1742 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.117177  1742 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:24.118841 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:24.119706 30350 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:24.106600  1541 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.120903  1541 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.123162  1541 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.127851 29745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:24.128085 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:24.128616 29814 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:24.129243 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:24.129875 29743 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:24.129801 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:24.143877  1301 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:24.144320  1301 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.144642  1301 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.146976 29787 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:24.151312  1618 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:24.160183  1618 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:24.162647  1618 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:24.181304 29569 catalog_manager.cc:5697] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:24.183609 29569 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 8, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.184970 29571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50490 (request call id 310) took 2085 ms. Trace:
I20260709 13:12:24.186574 29571 rpcz_store.cc:276] 0709 13:12:22.111046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.111367 (+   321us) service_pool.cc:224] Handling call
0709 13:12:24.184888 (+2073521us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:23.684802 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:23.782921 (+ 98119us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:23.788658 (+  5737us) write_op.cc:435] Acquired schema lock
0709 13:12:23.788674 (+    16us) tablet.cc:662] Decoding operations
0709 13:12:23.790572 (+  1898us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:23.790653 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:23.790681 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:12:23.792158 (+  1477us) tablet.cc:701] Row locks acquired
0709 13:12:23.792173 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:12:23.792324 (+   151us) write_op.cc:270] Start()
0709 13:12:23.792440 (+   116us) write_op.cc:276] Timestamp: P: 1783602743792274 usec, L: 0
0709 13:12:23.792460 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:23.793109 (+   649us) log.cc:844] Serialized 7845 byte log entry
0709 13:12:23.946036 (+152927us) op_driver.cc:464] REPLICATION: finished
0709 13:12:23.958407 (+ 12371us) write_op.cc:301] APPLY: starting
0709 13:12:23.958488 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:24.017718 (+ 59230us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:24.040202 (+ 22484us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b54001bec54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a26571 00007fd9e9aba32a 00007fd9e9a3ff14 00007fd9e9a3fec3 00007fd9e9a3fe38 00007fd9e9a3fdf3 00007fd9e9a3f0dc 00007fd9e9a68e16 00007fd9e9a50cbb 00007fd9e9a3b39d 00007fd9e9a3ed75
0709 13:12:24.051068 (+ 10866us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:24.081999 (+ 30931us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:24.082314 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:12:24.082364 (+    50us) write_op.cc:312] APPLY: finished
0709 13:12:24.082736 (+   372us) log.cc:844] Serialized 180 byte log entry
0709 13:12:24.091739 (+  9003us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.091928 (+   189us) write_op.cc:454] Released schema lock
0709 13:12:24.091982 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:24.092501 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.092529 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":12092,"apply.run_cpu_time_us":32330,"apply.run_wall_time_us":134066,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87687,"num_ops":20,"prepare.queue_time_us":253790,"prepare.run_cpu_time_us":17300,"prepare.run_wall_time_us":171885,"raft.queue_time_us":64186,"raft.run_cpu_time_us":11090,"raft.run_wall_time_us":116115,"replication_time_us":138852,"spinlock_wait_cycles":5486336,"thread_start_us":223030,"threads_started":4,"wal-append.queue_time_us":57769}]]}
I20260709 13:12:24.186168 29569 catalog_manager.cc:5697] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.192827 29569 catalog_manager.cc:5697] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 12, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.195322 29569 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.197293 29569 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.198774 29569 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 6 to 9, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 9 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.201228 29569 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.203954  1301 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.204188 29569 catalog_manager.cc:5697] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:24.205667 29569 catalog_manager.cc:5697] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 9 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.207307 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:24.207093 29569 catalog_manager.cc:5697] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 11 to 13, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 13 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.207937 29814 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.209134 29569 catalog_manager.cc:5697] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 11, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 11 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.210618 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:24.212007 29569 catalog_manager.cc:5697] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.213518 29569 catalog_manager.cc:5697] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.215667 29569 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 11, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 11 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.213300  1301 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.218740 29569 catalog_manager.cc:5697] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 10, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 10 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.239959 29814 raft_consensus.cc:2468] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 11.
I20260709 13:12:24.241243 30315 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:24.242682  1502 raft_consensus.cc:2804] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:24.243403  1502 raft_consensus.cc:697] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:24.244550  1502 consensus_queue.cc:237] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.308705  1618 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.312126 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:24.312564 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:24.313361 30342 raft_consensus.cc:2393] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 in current term 9: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:24.317951  1618 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:24.346638 29744 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:24.348013 29787 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:24.348835  1618 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:24.349516  1618 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:24.350386  1618 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.350818 29570 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 8 to 10, term changed from 12 to 14, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to <none>, VOTER 42c443079435463daa8845e244cec9d3 (127.27.229.66) evicted. New cstate: current_term: 14 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.354452 29569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50496 (request call id 343) took 1818 ms. Trace:
I20260709 13:12:24.356042 29673 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:24.357762  1739 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:24.354882 29569 rpcz_store.cc:276] 0709 13:12:22.535627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.535905 (+   278us) service_pool.cc:224] Handling call
0709 13:12:24.354386 (+1818481us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:24.226151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:24.226687 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:24.226722 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:12:24.226754 (+    32us) tablet.cc:662] Decoding operations
0709 13:12:24.228072 (+  1318us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:24.228134 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:24.228161 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:12:24.229379 (+  1218us) tablet.cc:701] Row locks acquired
0709 13:12:24.229400 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:12:24.229553 (+   153us) write_op.cc:270] Start()
0709 13:12:24.229676 (+   123us) write_op.cc:276] Timestamp: P: 1783602744229500 usec, L: 0
0709 13:12:24.229694 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:12:24.233842 (+  4148us) log.cc:844] Serialized 6297 byte log entry
0709 13:12:24.236982 (+  3140us) op_driver.cc:464] REPLICATION: finished
0709 13:12:24.237322 (+   340us) write_op.cc:301] APPLY: starting
0709 13:12:24.237402 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:24.260559 (+ 23157us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:24.260652 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:24.277396 (+ 16744us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:24.277648 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:12:24.277693 (+    45us) write_op.cc:312] APPLY: finished
0709 13:12:24.278046 (+   353us) log.cc:844] Serialized 148 byte log entry
0709 13:12:24.290075 (+ 12029us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.290232 (+   157us) write_op.cc:454] Released schema lock
0709 13:12:24.290297 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:24.290650 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.290676 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12347,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":106,"apply.run_cpu_time_us":18391,"apply.run_wall_time_us":53295,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66848,"num_ops":16,"prepare.queue_time_us":136,"prepare.run_cpu_time_us":4548,"prepare.run_wall_time_us":7990,"replication_time_us":7141}]]}
I20260709 13:12:24.367518 29570 catalog_manager.cc:5697] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.391299 29570 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:24.419574 29822 raft_consensus.cc:1275] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:12:24.433861  1738 consensus_queue.cc:1048] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:24.404503 29570 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.502135 29568 catalog_manager.cc:5697] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 13 to 14, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 14 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.505332 29568 catalog_manager.cc:5697] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 9 to 10, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.507221 29568 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 14 to 15, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 15 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.513613  1738 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:24.514338  1738 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.514513 29568 catalog_manager.cc:5697] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 11 to 13, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 13 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.516450 29568 catalog_manager.cc:5697] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 7 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.517390 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:24.519327 29822 raft_consensus.cc:2368] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11.
I20260709 13:12:24.521413 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:24.518433 29568 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:24.527428 29568 catalog_manager.cc:5697] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 11 to 12, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 12 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.530221 29732 tablet_service.cc:1558] Processing DeleteTablet for tablet 0801ed5c1b69497e8182bfe2461cdbf3 with delete_type TABLET_DATA_TOMBSTONED (TS 42c443079435463daa8845e244cec9d3 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48012
I20260709 13:12:24.526674 29570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50500 (request call id 324) took 1868 ms. Trace:
I20260709 13:12:24.533070 29570 rpcz_store.cc:276] 0709 13:12:22.658429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:22.713720 (+ 55291us) service_pool.cc:224] Handling call
0709 13:12:22.942339 (+228619us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001bec54. stack: 00007fd9e699e343 00007fd9e699e240 00007fd9e632d1d4 00007fd9f006b304 00007fd9f006b299 00007fd9e9a27090 00007fd9e9ac5f3a 00007fd9ef87c1cc 00007fd9ef97a37e 00007fd9ede3b2a4 00007fd9ede3b232 00007fd9ede3b161 00007fd9ede3b0dc 00007fd9ede3a392 00007fd9e7df848c 00007fd9e7df78c6
0709 13:12:24.526604 (+1584265us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:24.477992 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:24.478529 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:24.478565 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:12:24.478583 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:24.479163 (+   580us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:24.479214 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:24.479251 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:12:24.479626 (+   375us) tablet.cc:701] Row locks acquired
0709 13:12:24.479641 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:12:24.479792 (+   151us) write_op.cc:270] Start()
0709 13:12:24.479903 (+   111us) write_op.cc:276] Timestamp: P: 1783602744479743 usec, L: 0
0709 13:12:24.479926 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:12:24.480547 (+   621us) log.cc:844] Serialized 1662 byte log entry
0709 13:12:24.482943 (+  2396us) op_driver.cc:464] REPLICATION: finished
0709 13:12:24.483380 (+   437us) write_op.cc:301] APPLY: starting
0709 13:12:24.483460 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:24.485558 (+  2098us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:24.485651 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:24.487895 (+  2244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:24.488077 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:12:24.488126 (+    49us) write_op.cc:312] APPLY: finished
0709 13:12:24.488359 (+   233us) log.cc:844] Serialized 49 byte log entry
0709 13:12:24.489129 (+   770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.489229 (+   100us) write_op.cc:454] Released schema lock
0709 13:12:24.489286 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:24.489650 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.489679 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31589,"reported_tablets":34,"spinlock_wait_cycles":466104576,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":5633,"apply.run_wall_time_us":6215,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16712,"num_ops":4,"prepare.queue_time_us":10398,"prepare.run_cpu_time_us":2888,"prepare.run_wall_time_us":2887,"replication_time_us":2873,"spinlock_wait_cycles":4480}]]}
I20260709 13:12:24.531214 29568 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 7 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.540858 29568 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 9 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:24.547078  1742 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.547662  1742 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.547289 29568 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 13 to 14, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 14 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.556993 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:24.566640 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:24.567164 30342 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 15.
I20260709 13:12:24.567986  1738 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:24.568503 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:24.569260  1300 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:24.569631  1300 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.569902  1300 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.585042  1742 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:24.586781 29714 leader_election.cc:400] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11.
I20260709 13:12:24.587146 29714 leader_election.cc:403] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:24.590330  1751 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.590354  1746 raft_consensus.cc:3060] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.591064  1751 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.593197  1751 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.594686  1502 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.595178  1502 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.597275  1502 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.603833 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:24.604540 29822 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:24.606910 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:24.607254 30315 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:24.607528 29744 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:24.608825 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:24.608980  1502 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:24.610347  1502 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.610728  1502 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.614849 30314 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:24.618739  1543 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:24.619186  1543 raft_consensus.cc:493] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.619517  1543 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.627971  1543 raft_consensus.cc:515] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.643754  1502 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.674007  1534 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:24.674714  1534 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.677258  1534 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.678138 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:24.678453 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:24.678874 29668 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.679049 29822 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 11.
I20260709 13:12:24.680351 29639 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:24.681207  1534 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:24.681973  1534 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:24.683643  1534 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:24.691227 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:24.691876 29743 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.642386  1746 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 for earlier term 10. Current term is 11.
I20260709 13:12:24.652386 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:24.666975 30342 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:24.670698 29572 catalog_manager.cc:5697] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 3 to 4, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 4 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.697880  1502 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.697690 29572 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.698907  1300 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.713961 29814 raft_consensus.cc:1240] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Rejecting Update request from peer 42c443079435463daa8845e244cec9d3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:12:24.705492  1410 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:24.717440 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:24.718278 29744 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:24.721879  1410 consensus_queue.cc:1059] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:24.724916  1575 raft_consensus.cc:3055] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:12:24.725332  1575 raft_consensus.cc:740] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:24.726171  1575 consensus_queue.cc:260] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.727155  1575 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:24.711134 29743 raft_consensus.cc:2468] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:24.712086 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5d5d9cc0034eee95e6e5d81dfcaeeb" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:24.700448 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:24.743379 29822 raft_consensus.cc:3060] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:24.713129  1543 leader_election.cc:290] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.746176 29668 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
I20260709 13:12:24.747840 30316 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:24.752617 30314 leader_election.cc:304] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:24.754552  1502 raft_consensus.cc:2804] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:24.759977 29822 raft_consensus.cc:2468] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
I20260709 13:12:24.758355  1751 raft_consensus.cc:2804] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:24.759177  1618 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.765172  1534 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.766646  1618 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.768182  1300 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 16 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:24.768774  1618 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:24.770550 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:24.766839  1751 raft_consensus.cc:697] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:24.772411 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:24.773265 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:24.773169  1751 consensus_queue.cc:237] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.774024 29747 raft_consensus.cc:2393] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 11: Already voted for candidate 42c443079435463daa8845e244cec9d3 in this term.
I20260709 13:12:24.775729 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:24.777276 29744 raft_consensus.cc:2410] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 389c080a49494f8fb56c53fa7e6087f3 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:12:24.781123 29787 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:24.782318  1742 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:12:24.776451 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:24.786475  1502 raft_consensus.cc:697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:24.783864 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:24.787130 29740 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:24.788511 29787 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:24.791401  1300 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:24.791919  1300 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.792349  1300 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.792827  1746 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:24.778334  1534 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.783420  1795 tablet_replica.cc:333] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:24.798190  1795 raft_consensus.cc:2243] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:24.799161  1795 raft_consensus.cc:2272] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:24.793358  1746 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.801966  1746 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.803407 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:24.804167 29822 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:24.805847 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:24.806813  1575 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:12:24.807220  1575 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:24.811874  1575 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.817696  1795 ts_tablet_manager.cc:1916] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:12:24.818780 29740 raft_consensus.cc:1240] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Rejecting Update request from peer 389c080a49494f8fb56c53fa7e6087f3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:12:24.824909  1742 consensus_queue.cc:1059] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:24.825886  1618 raft_consensus.cc:3055] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:12:24.826287  1618 raft_consensus.cc:740] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:24.827198  1618 consensus_queue.cc:260] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.828477  1618 raft_consensus.cc:3060] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:24.835465  1300 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.840649 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:24.836467  1575 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.828637  1502 consensus_queue.cc:237] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.849884 29740 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:24.851554  1541 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:24.859531 29822 raft_consensus.cc:1275] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:12:24.861111  1543 consensus_queue.cc:1048] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:24.884362 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:24.885022 29814 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.893657 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:24.894374 29747 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:24.911010 29814 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:24.912500 29747 raft_consensus.cc:2468] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:24.913880 29714 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:24.914775  1738 raft_consensus.cc:2804] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:12:24.915551  1738 raft_consensus.cc:697] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 12 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:24.916446  1738 consensus_queue.cc:237] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.913842 29787 leader_election.cc:304] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:12:24.921810 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 152875us
I20260709 13:12:24.926534 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:24.927312 29814 raft_consensus.cc:2368] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12.
I20260709 13:12:24.931819 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:24.932476 29673 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:24.933794 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df971e435c648008d74c7352ccea2d9" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:24.934468 29673 raft_consensus.cc:3060] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:12:24.942989 29571 catalog_manager.cc:5697] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 5 to 6, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 6 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } }
I20260709 13:12:24.921105  1747 raft_consensus.cc:2804] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:24.944295  1797 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:24.880838  1300 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:24.946450 29571 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 reported cstate change: leader changed from <none> to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 14 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.947793  1797 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:24.951670 29571 catalog_manager.cc:5697] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 8 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.953011 29572 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:42502 (request call id 201) took 1811 ms. Trace:
I20260709 13:12:24.944761  1575 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:24.954967 29639 leader_election.cc:400] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12.
I20260709 13:12:24.955502 29639 leader_election.cc:403] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:12:24.949736  1747 raft_consensus.cc:697] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:24.998566  1797 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:24.999377  1747 consensus_queue.cc:237] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:24.954928 29572 rpcz_store.cc:276] 0709 13:12:23.141226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:23.141868 (+   642us) service_pool.cc:224] Handling call
0709 13:12:24.952939 (+1811071us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:24.700946 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:24.701461 (+   515us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:24.701496 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:12:24.701512 (+    16us) tablet.cc:662] Decoding operations
0709 13:12:24.701891 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:24.701980 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:24.702006 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:24.702334 (+   328us) tablet.cc:701] Row locks acquired
0709 13:12:24.702351 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:24.702491 (+   140us) write_op.cc:270] Start()
0709 13:12:24.702599 (+   108us) write_op.cc:276] Timestamp: P: 1783602744702448 usec, L: 0
0709 13:12:24.702618 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:12:24.703172 (+   554us) log.cc:844] Serialized 919 byte log entry
0709 13:12:24.705064 (+  1892us) op_driver.cc:464] REPLICATION: finished
0709 13:12:24.712082 (+  7018us) write_op.cc:301] APPLY: starting
0709 13:12:24.712161 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:24.736622 (+ 24461us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:24.736731 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:24.753023 (+ 16292us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:24.763197 (+ 10174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:12:24.792911 (+ 29714us) write_op.cc:312] APPLY: finished
0709 13:12:24.793131 (+   220us) log.cc:844] Serialized 33 byte log entry
0709 13:12:24.794713 (+  1582us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.797094 (+  2381us) write_op.cc:454] Released schema lock
0709 13:12:24.797144 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:24.797508 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:24.797540 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":6784,"apply.run_cpu_time_us":4285,"apply.run_wall_time_us":85390,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":2516,"prepare.run_wall_time_us":2516,"replication_time_us":2348}]]}
I20260709 13:12:24.957208 29571 catalog_manager.cc:5697] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 7 to 8, leader changed from 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:24.963449 29673 raft_consensus.cc:2468] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:25.030551 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:25.031096 29814 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 15.
I20260709 13:12:25.032706 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:25.033527  1805 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:12:25.033979  1805 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:25.034345  1805 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:12:25.042315 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 73528.3us
I20260709 13:12:25.025205  1534 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 11. Current term is 12.
I20260709 13:12:25.064314 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:25.071667 30350 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 15: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:25.075479  1795 ts_tablet_manager.cc:1929] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 13:12:25.076146  1795 log.cc:1199] T 0801ed5c1b69497e8182bfe2461cdbf3 P 42c443079435463daa8845e244cec9d3: Deleting WAL directory at /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/wals/0801ed5c1b69497e8182bfe2461cdbf3
I20260709 13:12:25.078583 29557 catalog_manager.cc:5028] TS 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): tablet 0801ed5c1b69497e8182bfe2461cdbf3 (table test-workload [id=c5cd32acb8184f0c924609191c9d9ea7]) successfully deleted
I20260709 13:12:25.079342 29673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:25.080022 29673 raft_consensus.cc:606] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:25.083436 29673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:25.084066 29673 raft_consensus.cc:606] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Received request to transfer leadership to TS 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:25.087213 29673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:25.087833 29673 raft_consensus.cc:606] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:25.091037 29673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:25.091657 29673 raft_consensus.cc:606] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:25.094841 29668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e"
dest_uuid: "a9d8198d0b954886af452e89a8029614"
mode: GRACEFUL
new_leader_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:41950
I20260709 13:12:25.095409 29668 raft_consensus.cc:606] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Received request to transfer leadership to TS 42c443079435463daa8845e244cec9d3
I20260709 13:12:25.096875 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:25.098708 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:25.042987  1799 raft_consensus.cc:493] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
W20260709 13:12:25.143182 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 91511.7us
I20260709 13:12:25.072656  1805 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.106889  1799 raft_consensus.cc:515] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:25.234939 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 58745.9us
W20260709 13:12:25.231668  1810 log.cc:927] Time spent T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:12:25.236768 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 187203us
I20260709 13:12:25.249136  1805 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:25.252209  1799 leader_election.cc:290] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:25.246229  1801 log.cc:927] Time spent T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:12:25.260618 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 93890.1us
I20260709 13:12:25.275867 29814 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:12:25.276265 29814 pending_rounds.cc:85] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Aborting all ops after (but not including) 9
I20260709 13:12:25.276499 29814 pending_rounds.cc:107] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:12:25.276746 29814 raft_consensus.cc:2889] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:25.278824  1751 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:12:25.304316  1809 log.cc:927] Time spent T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: Append to log took a long time: real 0.153s	user 0.003s	sys 0.000s
W20260709 13:12:25.308292 29640 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 64492.4us
I20260709 13:12:25.310325 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:25.311124 30342 raft_consensus.cc:2393] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 in current term 15: Already voted for candidate 121060c6c5b14502957b76fd1dfc7b2d in this term.
I20260709 13:12:25.319515 29572 catalog_manager.cc:5697] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 9 to 11, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 11 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:25.320735 29673 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:25.326479  1811 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:25.338790 29821 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:25.343792 29568 catalog_manager.cc:5697] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 11 to 13, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 13 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:25.346529 29568 catalog_manager.cc:5697] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 8 to 10, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 10 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:25.350931  1798 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:25.359977 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:25.359962 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:25.362013 29745 raft_consensus.cc:1275] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:25.376168 29670 raft_consensus.cc:1275] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:25.383144  1751 consensus_queue.cc:1048] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:25.386291 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40195a1eb8d422f8e2cec6f836a23ee" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:25.387300 29744 raft_consensus.cc:2368] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8.
I20260709 13:12:25.401885 29571 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50490 (request call id 311) took 1165 ms. Trace:
I20260709 13:12:25.402544 29571 rpcz_store.cc:276] 0709 13:12:24.236154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:24.236301 (+   147us) service_pool.cc:224] Handling call
0709 13:12:25.401811 (+1165510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:25.035975 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:25.036507 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:25.036544 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:12:25.036558 (+    14us) tablet.cc:662] Decoding operations
0709 13:12:25.037113 (+   555us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:25.037163 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:25.037194 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:12:25.037586 (+   392us) tablet.cc:701] Row locks acquired
0709 13:12:25.037601 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:12:25.037750 (+   149us) write_op.cc:270] Start()
0709 13:12:25.037862 (+   112us) write_op.cc:276] Timestamp: P: 1783602745037701 usec, L: 0
0709 13:12:25.037877 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:12:25.038598 (+   721us) log.cc:844] Serialized 1687 byte log entry
0709 13:12:25.040699 (+  2101us) op_driver.cc:464] REPLICATION: finished
0709 13:12:25.041201 (+   502us) write_op.cc:301] APPLY: starting
0709 13:12:25.041289 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:25.190461 (+149172us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:25.196002 (+  5541us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:25.268977 (+ 72975us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:25.269173 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:12:25.269223 (+    50us) write_op.cc:312] APPLY: finished
0709 13:12:25.269500 (+   277us) log.cc:844] Serialized 49 byte log entry
0709 13:12:25.270335 (+   835us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:25.270682 (+   347us) write_op.cc:454] Released schema lock
0709 13:12:25.270732 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:25.281397 (+ 10665us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:25.281436 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63328,"reported_tablets":29,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":272,"apply.run_cpu_time_us":9595,"apply.run_wall_time_us":240161,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16712,"num_ops":4,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":2882,"prepare.run_wall_time_us":2881,"replication_time_us":2698}]]}
I20260709 13:12:25.415359  1823 raft_consensus.cc:993] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:25.415864  1823 raft_consensus.cc:1081] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:25.429013  1543 consensus_queue.cc:1048] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:25.433195 29823 raft_consensus.cc:1275] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:12:25.434922  1410 consensus_queue.cc:1048] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:25.447806  1301 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.448334  1301 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.451102 29638 leader_election.cc:400] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8.
I20260709 13:12:25.451606 29638 leader_election.cc:403] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:25.459227 29821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51152
I20260709 13:12:25.459885 29821 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.460263 29821 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.462489  1301 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:25.463496 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:25.464458  1764 raft_consensus.cc:3060] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:12:25.468025  1821 raft_consensus.cc:993] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:25.468560  1821 raft_consensus.cc:993] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:25.468716  1828 raft_consensus.cc:993] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:25.469000  1821 raft_consensus.cc:1081] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:25.469151  1828 raft_consensus.cc:1081] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:25.468434  1259 raft_consensus.cc:993] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: : Instructing follower 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:25.469858  1821 raft_consensus.cc:1081] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
I20260709 13:12:25.474538 29744 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:25.475515  1259 raft_consensus.cc:1081] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Signalling peer 42c443079435463daa8845e244cec9d3 to start an election
W20260709 13:12:25.479979 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 99924.9us
I20260709 13:12:25.482681 29822 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d8198d0b954886af452e89a8029614 in term 15.
I20260709 13:12:25.483690 29743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:12:25.486460 29743 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.486542 29639 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:25.487613 29747 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:12:25.486867 29743 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.487951 29740 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:12:25.488165 29747 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.488376 29742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433"
dest_uuid: "42c443079435463daa8845e244cec9d3"
 from {username='slave'} at 127.0.0.1:48028
I20260709 13:12:25.488577 29740 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.488692 29747 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:25.488903 29742 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:25.489061 29740 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.489315 29742 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.498394 29742 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.507148 29742 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:25.508186 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:25.509399 29672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:25.508839 29668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a9d8198d0b954886af452e89a8029614" is_pre_election: true
I20260709 13:12:25.516304 30342 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.516348 29672 raft_consensus.cc:3055] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:12:25.502789  1797 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:25.517009 29672 raft_consensus.cc:740] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:25.515290 29747 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.519986 29743 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.527946 29665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:25.528595 29665 raft_consensus.cc:3055] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:12:25.521817 29672 consensus_queue.cc:260] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.528898 29665 raft_consensus.cc:740] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:25.531533 29747 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:25.534617 29743 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:25.540666 29672 raft_consensus.cc:3060] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:25.541785 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:25.542462 30344 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:25.552567 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:25.553328 29673 raft_consensus.cc:3055] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:25.553633 29673 raft_consensus.cc:740] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:25.532887 29665 consensus_queue.cc:260] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.555853 29665 raft_consensus.cc:3060] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:12:25.554443 29673 consensus_queue.cc:260] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.559986 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:25.560623 30350 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.560366 29570 catalog_manager.cc:5697] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 12, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 12 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.566880 29673 raft_consensus.cc:3060] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.567595 29740 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:25.572144 30342 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
I20260709 13:12:25.529268  1797 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 15 LEADER]: Becoming Leader. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:25.574796 29715 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:25.582549 29666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:25.583197 29666 raft_consensus.cc:3055] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:25.583484 29666 raft_consensus.cc:740] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:25.584180 29666 consensus_queue.cc:260] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:25.585263 29666 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.503037  1829 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:12:25.594954 29665 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 15.
I20260709 13:12:25.597599  1764 raft_consensus.cc:2749] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333) with higher term. Message: Invalid argument: T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d8198d0b954886af452e89a8029614 for earlier term 7. Current term is 8.
I20260709 13:12:25.598793 29670 raft_consensus.cc:1275] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:25.601055 29715 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:25.602277  1811 raft_consensus.cc:2804] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:25.602828  1811 raft_consensus.cc:697] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:25.603767  1811 consensus_queue.cc:237] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.604657 29672 raft_consensus.cc:2468] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
I20260709 13:12:25.606016  1797 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.607065  1827 raft_consensus.cc:2804] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:12:25.607661  1827 raft_consensus.cc:697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 15 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:25.611754 30344 raft_consensus.cc:2468] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 15.
I20260709 13:12:25.612668 30350 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:25.575348 29740 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:25.617612 29673 raft_consensus.cc:2468] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:25.618983 29666 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:25.623657 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69b5d0bcdd3a4027b3e5abda839ab825" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:25.624449 29822 raft_consensus.cc:3060] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:25.613654 29715 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:25.593528 29821 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.637956 29715 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614; no voters: 
I20260709 13:12:25.641310 29821 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:25.608529  1827 consensus_queue.cc:237] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.639063  1575 raft_consensus.cc:2804] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:25.678826  1575 raft_consensus.cc:697] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:25.679905  1575 consensus_queue.cc:237] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.649740  1410 raft_consensus.cc:2804] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:25.681567  1410 raft_consensus.cc:697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:25.655638 29673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "a9d8198d0b954886af452e89a8029614"
I20260709 13:12:25.683707 29673 raft_consensus.cc:3055] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:12:25.684062 29673 raft_consensus.cc:740] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a9d8198d0b954886af452e89a8029614, State: Running, Role: LEADER
I20260709 13:12:25.684836 29673 consensus_queue.cc:260] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.632381  1829 consensus_queue.cc:1048] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:12:25.667281 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:25.686407 30350 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.688001  1410 consensus_queue.cc:237] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:25.689803 29673 raft_consensus.cc:3060] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:25.724730 30350 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 14.
I20260709 13:12:25.737389 29789 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:25.778720  1813 raft_consensus.cc:2804] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:25.779273  1813 raft_consensus.cc:697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:25.780037 29571 catalog_manager.cc:5697] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:25.780095  1813 consensus_queue.cc:237] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.801118 29822 raft_consensus.cc:2468] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:25.805151 29673 raft_consensus.cc:2468] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 14.
I20260709 13:12:25.864269  1410 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.864806  1410 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.868263 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:25.869904  1410 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:25.879055 29571 catalog_manager.cc:5697] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 13 to 14, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 14 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.888337 30316 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:25.892226  1301 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:25.897184 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:25.897957 29822 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 16.
I20260709 13:12:25.899196 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:25.900584  1827 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:12:25.900991  1827 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:25.901337  1827 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:25.927350  1827 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.930757 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:25.930763 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:25.931584 29821 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:12:25.931296  1827 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 17 election: Requested vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:25.934628 29822 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:25.941911 29571 catalog_manager.cc:5697] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 11, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 11 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.948995 29742 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:12:25.949273 29789 consensus_peers.cc:597] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c538253e68554f7b82c0f993198e47d3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.950651  1813 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:25.943758 29821 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 17.
I20260709 13:12:25.950541 29571 catalog_manager.cc:5697] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 12 to 13, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 13 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.952260 29714 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:25.952209 29571 catalog_manager.cc:5697] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 14 to 15, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 15 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.951076 29668 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:25.953780 29571 catalog_manager.cc:5697] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 11, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 11 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.953362  1827 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:12:25.955945  1827 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 17 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:25.956758  1827 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:25.963083  1813 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:25.978422 29568 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 reported cstate change: term changed from 14 to 15, leader changed from 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67) to a9d8198d0b954886af452e89a8029614 (127.27.229.65). New cstate: current_term: 15 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.989931  1807 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:26.005477 29571 catalog_manager.cc:5697] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.004808 29668 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:26.016573 29673 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:26.019227 29570 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:26.042554 29742 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:26.045799 29821 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:26.047461  1797 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:26.055928 29740 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:12:26.055430 29673 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:26.061417  1410 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:12:26.059603  1764 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260709 13:12:26.078764 29640 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fb4a6fd13164dbcbc05c397d0b009b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.107991 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:26.113267 30344 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:26.116268 30344 raft_consensus.cc:1275] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:12:26.118784  1827 consensus_queue.cc:1048] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:26.120533  1831 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:12:26.126276 29822 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Refusing update from remote peer a9d8198d0b954886af452e89a8029614: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:12:26.133417  1797 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:26.147547 29671 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:26.150740  1410 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:26.154351 29821 raft_consensus.cc:2955] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:26.152315  1797 raft_consensus.cc:2955] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:26.237087 29568 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 9 leader_uuid: "a9d8198d0b954886af452e89a8029614" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:26.241830 29668 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:26.255733  1826 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:26.227777  1850 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:26.278901  1850 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:26.281438  1850 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:26.268164 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
I20260709 13:12:26.291216 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:26.291996 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:26.292783 29822 raft_consensus.cc:2368] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 16. Current term is 17.
I20260709 13:12:26.299933 30344 raft_consensus.cc:1275] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:12:26.301632 30315 leader_election.cc:400] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 16. Current term is 17.
I20260709 13:12:26.302068 30315 leader_election.cc:403] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:26.303406  1543 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:12:26.315181 30344 raft_consensus.cc:1275] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:12:26.319653  1813 consensus_queue.cc:1048] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:12:26.386618 30316 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:26.396216 29821 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:12:26.403493  1410 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:12:26.411784  1543 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899) with higher term. Message: Invalid argument: T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 121060c6c5b14502957b76fd1dfc7b2d for earlier term 16. Current term is 17.
W20260709 13:12:26.465595 29639 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 120115us
W20260709 13:12:26.469467 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 82862.8us
W20260709 13:12:26.481546 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.484310 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.486444 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 144300us
I20260709 13:12:26.489739 29740 raft_consensus.cc:2955] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:12:26.576960 29620 auto_rebalancer.cc:629] Failed to schedule move for tablet a9aef678cd634050a9cbee4fe1f83abc: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:26.583348 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.584216 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.606832  1875 ts_tablet_manager.cc:933] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
W20260709 13:12:26.607347 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 112960us
W20260709 13:12:26.651846 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.665380 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.676605 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 191233us
I20260709 13:12:26.684170 29821 raft_consensus.cc:1275] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:26.686669  1575 consensus_queue.cc:1048] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:26.707942 30345 raft_consensus.cc:1275] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
W20260709 13:12:26.704310 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.671507  1876 ts_tablet_manager.cc:933] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:26.721716 30345 raft_consensus.cc:1275] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:12:26.716557 29789 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.737782 29789 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.743256  1830 consensus_queue.cc:1048] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:26.735749 29740 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:26.759379  1830 consensus_queue.cc:1048] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:12:26.760855  1875 tablet_copy_client.cc:323] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.65:35503
W20260709 13:12:26.765746 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.766378 29789 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.773167  1746 consensus_queue.cc:1048] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:12:26.778682 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.779474 29789 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.780104 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.780723 29789 consensus_peers.cc:597] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.781327 29789 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.793988 29789 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.794713 29789 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.799037 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.795324 29789 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.828822 29715 consensus_peers.cc:597] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.830238 29715 consensus_peers.cc:597] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.870472 29715 consensus_peers.cc:597] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.871232 29715 consensus_peers.cc:597] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.881569 29715 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.890143 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.889639 29715 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.891662 29715 consensus_peers.cc:597] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.897559 29715 consensus_peers.cc:597] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ff39d14c4684dfb9f2d3f7ed0bd42ad. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.904860 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.939261 29715 consensus_peers.cc:597] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.939963 29715 consensus_peers.cc:597] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.940563 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.943945 29715 consensus_peers.cc:597] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:26.970083  1876 tablet_copy_client.cc:323] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:12:26.978554 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet c538253e68554f7b82c0f993198e47d3 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:12:26.979187 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet c538253e68554f7b82c0f993198e47d3 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-c538253e68554f7b82c0f993198e47d3
I20260709 13:12:26.987213 29822 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:26.999738  1410 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:27.005321 29833 tablet_copy_source_session.cc:215] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:27.079239 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:27.084864 28565 tablet_replica.cc:333] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.081519  1876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c538253e68554f7b82c0f993198e47d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.096652 28565 raft_consensus.cc:2243] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.097301 28565 raft_consensus.cc:2272] T a40195a1eb8d422f8e2cec6f836a23ee P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.099875 28565 tablet_replica.cc:333] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.100677 28565 raft_consensus.cc:2243] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.101188 28565 raft_consensus.cc:2272] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.119102  1876 tablet_copy_client.cc:806] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:27.120085  1876 tablet_copy_client.cc:670] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:27.124410  1876 tablet_copy_client.cc:538] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:27.129467 28565 tablet_replica.cc:333] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.130498 28565 raft_consensus.cc:2243] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.131198 28565 raft_consensus.cc:2272] T c538253e68554f7b82c0f993198e47d3 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.133796 28565 tablet_replica.cc:333] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.134640 28565 raft_consensus.cc:2243] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.135172 28565 raft_consensus.cc:2272] T 307badafd0e64a4c87993caa003f0e2a P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.137706 28565 tablet_replica.cc:333] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.137382  1827 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:27.140357 29821 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:27.143901  1876 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:12:27.185221 29571 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 6, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:27.186954 28565 raft_consensus.cc:2243] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.192467 28565 raft_consensus.cc:2272] T aa5a096f6b164ab5849280a34b19d3b7 P a9d8198d0b954886af452e89a8029614 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.206111 28565 tablet_replica.cc:333] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.206957 28565 raft_consensus.cc:2243] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.208006 28565 raft_consensus.cc:2272] T 1638cc6362e14d898e868b6d6927b9c1 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.210723 28565 tablet_replica.cc:333] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.211532 28565 raft_consensus.cc:2243] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.256788 28565 raft_consensus.cc:2272] T 7df971e435c648008d74c7352ccea2d9 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.224371  1864 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.257979  1864 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.260104  1864 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.262887 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.224009  1831 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.215207  1816 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:27.265096  1831 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:27.267297  1831 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.267976 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "222c2ac209fd4c24a1f636fff5c13739" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.270125 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.265162  1816 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:27.281966 29640 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.283993 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cafd7309bc64f839076e213c80b391c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.286530 29638 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.296818  1869 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:27.298588  1831 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.299417  1831 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:27.294538  1868 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.316336  1831 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.316056  1868 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.316891  1831 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.297466  1869 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:27.318390  1868 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.319094  1831 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.319458  1869 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.321000  1816 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.321360 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.322242 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.325378 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.328346 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.329753 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924dd112e90f41f492fd016c204c1a21" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.332372 29640 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:27.338263  1864 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.338876  1864 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.340970  1864 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:27.346741 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 61236.1us
I20260709 13:12:27.334537  1797 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:27.348662 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dba966d409c4e37bce58c7db358ebbb" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.349484 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.351315 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5bb27f7a1364209b951570c1c03f996" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.353823 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.356076 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.357558 28565 tablet_replica.cc:333] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.359573 29638 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.360023 28565 raft_consensus.cc:2243] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.361409 29638 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.362485  1831 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.363436  1868 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.367986 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.369423 29638 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.369753  1797 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.370563  1797 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.375670 28565 raft_consensus.cc:2272] T 27ef48e8ba554972a5c426adeff23599 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.386999 28565 tablet_replica.cc:333] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.388072 28565 raft_consensus.cc:2243] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.399557 28565 raft_consensus.cc:2272] T 222c2ac209fd4c24a1f636fff5c13739 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.401650  1892 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:27.402442  1892 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.405028  1892 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.394644  1816 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.406415  1816 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:27.408627  1816 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.409150 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.413574 28565 tablet_replica.cc:333] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.414664 28565 raft_consensus.cc:2243] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.415462 28565 raft_consensus.cc:2272] T 950ba8523bd4460bb0db3a8ae291f1ca P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.417438 30344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3147da791a394c9da4f7b521dd52a560" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.426668 29639 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:27.430689 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.432425  1797 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.409178  1816 raft_consensus.cc:493] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.444810  1816 raft_consensus.cc:515] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.445045 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.447155  1816 leader_election.cc:290] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.444116  1864 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.448999  1864 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:27.451123  1864 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.444295  1892 raft_consensus.cc:493] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:27.454304 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.454936  1892 raft_consensus.cc:515] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:27.454253 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.457267  1892 leader_election.cc:290] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.459839 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc29718e51d549e395e72e7bff383425" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.460035 29639 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.463160 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.438474 28565 tablet_replica.cc:333] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.464293  1892 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:27.464443 28565 raft_consensus.cc:2243] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.467031 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c09d4b0feb04ea0b3d0bf11a0fd4094" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.469081 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a191ecb8137c4add8a89d6a240470f6b" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.470317 29639 leader_election.cc:304] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:27.470860 28565 raft_consensus.cc:2272] T 924dd112e90f41f492fd016c204c1a21 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.472357  1892 raft_consensus.cc:2749] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:27.475188 29639 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.482823 29639 leader_election.cc:304] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.479947  1895 ts_tablet_manager.cc:933] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:27.494232 28565 tablet_replica.cc:333] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.495185 28565 raft_consensus.cc:2243] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.495982 28565 raft_consensus.cc:2272] T fc29718e51d549e395e72e7bff383425 P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.498674  1816 raft_consensus.cc:2749] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.489712  1864 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.531766 28565 tablet_replica.cc:333] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.532725 28565 raft_consensus.cc:2243] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.533581 28565 raft_consensus.cc:2272] T 1cc4f503726e4efd8620c27deea0b183 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.534770  1816 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:27.535295  1816 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.537391  1816 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.539041 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.539269 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b3e1085d9ad4120b3284dbd3939b5e4" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.540850 29639 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:27.541623  1864 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.537866  1816 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.542409  1816 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.546424 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.548476  1816 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.549485 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.551424 29640 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:27.551733  1876 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.552759  1876 tablet_bootstrap.cc:492] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:12:27.553506  1876 ts_tablet_manager.cc:1403] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.410s	user 0.075s	sys 0.053s
I20260709 13:12:27.554014  1816 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:27.556849 28565 tablet_replica.cc:333] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.558951  1876 raft_consensus.cc:359] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:27.567559  1876 raft_consensus.cc:740] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:12:27.568614 28565 raft_consensus.cc:2243] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.568356  1876 consensus_queue.cc:260] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:27.565689  1816 raft_consensus.cc:493] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:27.572542  1816 raft_consensus.cc:515] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } }
I20260709 13:12:27.574322  1876 ts_tablet_manager.cc:1434] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.008s
I20260709 13:12:27.577824 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.579559  1816 leader_election.cc:290] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.577198 28565 raft_consensus.cc:2272] T b85eaa84d2104a8aa1d25054d069fd33 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.583660 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-c538253e68554f7b82c0f993198e47d3 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:12:27.584190 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-c538253e68554f7b82c0f993198e47d3 on tablet c538253e68554f7b82c0f993198e47d3 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:27.598037 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0af93d90eed4483befb4778a68e7b7c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.600693  1816 raft_consensus.cc:493] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.601313  1816 raft_consensus.cc:515] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.604362  1816 leader_election.cc:290] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.605110 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.600883 29638 leader_election.cc:304] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.618420  1816 raft_consensus.cc:2749] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.625875 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "917259a5b1e94566bb501796d8c4740d" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.626830  1895 tablet_copy_client.cc:323] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:12:27.627769 29638 leader_election.cc:304] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.628818 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:12:27.629436 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-3ff39d14c4684dfb9f2d3f7ed0bd42ad
I20260709 13:12:27.634398 28565 tablet_replica.cc:333] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.655864 28565 raft_consensus.cc:2243] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.655987  1892 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.640202 29759 tablet_copy_source_session.cc:215] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:27.640887  1864 raft_consensus.cc:2749] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.650291  1816 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.657406  1816 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:27.659683  1816 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:27.661653 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.661568  1895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.656497  1892 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.675406  1892 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.675887 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.676863 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63d505aa7c824fe884968612bdceec56" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.681170 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d5a34ce22a44e2a4882baa5443f81e" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.686749 29638 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.693439  1892 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:27.696848 29638 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.697818  1892 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.656445 28565 pending_rounds.cc:70] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Trying to abort 1 pending ops.
I20260709 13:12:27.698526 28565 pending_rounds.cc:77] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7305636846726295552 op_type: NO_OP noop_request { }
I20260709 13:12:27.701607 28565 raft_consensus.cc:2889] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:27.707984 28565 raft_consensus.cc:2272] T 69b5d0bcdd3a4027b3e5abda839ab825 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.720697 28565 tablet_replica.cc:333] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.724001  1864 raft_consensus.cc:493] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.724598  1864 raft_consensus.cc:515] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.724962  1816 raft_consensus.cc:493] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.724624 28565 raft_consensus.cc:2243] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.725507  1816 raft_consensus.cc:515] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.726830  1864 leader_election.cc:290] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.727526  1816 leader_election.cc:290] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.728066 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.728919 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.729596 28565 raft_consensus.cc:2272] T a191ecb8137c4add8a89d6a240470f6b P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.729169 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dff620b2062c4139940ec520664442a1" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.733035 29639 leader_election.cc:304] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:27.734439  1816 raft_consensus.cc:2749] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:27.733350  1892 raft_consensus.cc:493] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.735615  1892 raft_consensus.cc:515] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.737636  1892 leader_election.cc:290] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.738791 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.739043 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6262c59cea24959ab0dd23d4279895c" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:27.740391  1864 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:27.740923  1864 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.743474 29639 leader_election.cc:304] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:27.744371 28565 tablet_replica.cc:333] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.745291  1864 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.744578  1892 raft_consensus.cc:2749] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:27.745795 30342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.747649 28565 raft_consensus.cc:2243] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.748317 28565 raft_consensus.cc:2272] T 917259a5b1e94566bb501796d8c4740d P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.750941 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc891e1e674747fda6007601f64c4341" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.753132 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0f895f1660a4065920da71ac5df9433" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:27.756337  1895 tablet_copy_client.cc:806] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:27.756956  1895 tablet_copy_client.cc:670] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:27.757709 28565 tablet_replica.cc:333] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.759419 28565 raft_consensus.cc:2243] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:27.774093  1895 tablet_copy_client.cc:538] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:27.860836 29637 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:27.867372  1816 raft_consensus.cc:493] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.867986  1816 raft_consensus.cc:515] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.873040  1816 leader_election.cc:290] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.888413  1816 raft_consensus.cc:493] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:27.889309  1816 raft_consensus.cc:515] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:27.891533  1816 leader_election.cc:290] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:27.896369 28565 raft_consensus.cc:2272] T f96ce2eb1d674d2faf1a6340807d4961 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:27.899555 28565 tablet_replica.cc:333] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:27.894376 29638 leader_election.cc:304] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
W20260709 13:12:27.943256 29638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 48983.7us
I20260709 13:12:27.944325 29638 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:27.944936 28565 raft_consensus.cc:2243] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:27.913478 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:27.946110 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 90319.4us
I20260709 13:12:27.947178  1797 raft_consensus.cc:2749] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:27.948465  1797 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:27.928900  1895 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:12:27.950939 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11a95760a1b04359956b38a1861eeca2" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.996320 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:27.998435 29640 leader_election.cc:304] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:28.004457  1892 raft_consensus.cc:2749] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:27.929569 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 55749.1us
I20260709 13:12:27.945756 28565 raft_consensus.cc:2272] T 7b3e1085d9ad4120b3284dbd3939b5e4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.023938 28565 tablet_replica.cc:333] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.024751 28565 raft_consensus.cc:2243] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.025609 28565 raft_consensus.cc:2272] T abb12790de164e0a8286849b02b1dc26 P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.028498 28565 tablet_replica.cc:333] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.029341 28565 raft_consensus.cc:2243] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.029894 28565 pending_rounds.cc:70] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Trying to abort 1 pending ops.
I20260709 13:12:28.030257 28565 pending_rounds.cc:77] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614: Aborting op as it isn't in flight: id { term: 11 index: 10 } timestamp: 7305636846565384192 op_type: NO_OP noop_request { }
I20260709 13:12:28.030658 28565 raft_consensus.cc:2889] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:28.077086 28565 raft_consensus.cc:2272] T f0d5a34ce22a44e2a4882baa5443f81e P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.091116 30342 raft_consensus.cc:1217] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:12:28.114593 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5fd36b246f24922bf4e9f9658c19013" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:28.123128 28565 tablet_replica.cc:333] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.134721 28565 raft_consensus.cc:2243] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.135691 28565 raft_consensus.cc:2272] T a9aef678cd634050a9cbee4fe1f83abc P a9d8198d0b954886af452e89a8029614 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.148742 29638 leader_election.cc:304] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:28.149993  1901 raft_consensus.cc:2749] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:28.150427 28565 tablet_replica.cc:333] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.151322 28565 raft_consensus.cc:2243] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.151918 28565 raft_consensus.cc:2272] T 5cafd7309bc64f839076e213c80b391c P a9d8198d0b954886af452e89a8029614 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.154861 28565 tablet_replica.cc:333] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.155643 28565 raft_consensus.cc:2243] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.156736 28565 raft_consensus.cc:2272] T 4abf8e3126194219b6a68c724a22f711 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.159524 28565 tablet_replica.cc:333] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.160243 28565 raft_consensus.cc:2243] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.160812 28565 raft_consensus.cc:2272] T b5bb27f7a1364209b951570c1c03f996 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.163957 28565 tablet_replica.cc:333] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.164711 28565 raft_consensus.cc:2243] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.165218 28565 raft_consensus.cc:2272] T e0f895f1660a4065920da71ac5df9433 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.168808 28565 tablet_replica.cc:333] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.174074 28565 raft_consensus.cc:2243] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.175081 28565 raft_consensus.cc:2272] T 0dba966d409c4e37bce58c7db358ebbb P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.177605 28565 tablet_replica.cc:333] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.178375 28565 raft_consensus.cc:2243] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.216259  1895 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:28.217247  1895 tablet_bootstrap.cc:492] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:12:28.217995  1895 ts_tablet_manager.cc:1403] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.289s	user 0.023s	sys 0.010s
I20260709 13:12:28.225797  1895 raft_consensus.cc:359] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:28.226699  1895 raft_consensus.cc:740] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:12:28.227425  1895 consensus_queue.cc:260] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:28.229835  1895 ts_tablet_manager.cc:1434] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.000s
I20260709 13:12:28.263701 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-3ff39d14c4684dfb9f2d3f7ed0bd42ad received from {username='slave'} at 127.0.0.1:36354
I20260709 13:12:28.264210 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-3ff39d14c4684dfb9f2d3f7ed0bd42ad on tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:28.285291 28565 raft_consensus.cc:2272] T 1f520c8b2a9e4af1a8676180d2dd96f4 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.299567 28565 tablet_replica.cc:333] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.306178 28565 raft_consensus.cc:2243] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.317214 28565 raft_consensus.cc:2272] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.341235 28565 tablet_replica.cc:333] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.342065 28565 raft_consensus.cc:2243] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.348484 28565 raft_consensus.cc:2272] T fc891e1e674747fda6007601f64c4341 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.395083 28565 tablet_replica.cc:333] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.396148 28565 raft_consensus.cc:2243] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.396782 28565 raft_consensus.cc:2272] T 11a95760a1b04359956b38a1861eeca2 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.416447 28565 tablet_replica.cc:333] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.417434 28565 raft_consensus.cc:2243] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.418481 28565 raft_consensus.cc:2272] T 3147da791a394c9da4f7b521dd52a560 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.421368 28565 tablet_replica.cc:333] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.422155 28565 raft_consensus.cc:2243] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.422732 28565 raft_consensus.cc:2272] T 44b63ddac1a74c0c852d0c1d433ae7c4 P a9d8198d0b954886af452e89a8029614 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.425710 28565 tablet_replica.cc:333] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.426753 28565 raft_consensus.cc:2243] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.427450 28565 raft_consensus.cc:2272] T 15438e4033d048dfa9c154db86242bc3 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.443997 28565 tablet_replica.cc:333] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.444845 28565 raft_consensus.cc:2243] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.446026 28565 raft_consensus.cc:2272] T 5444d738efbb44128f4f34da83448b15 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.448787 28565 tablet_replica.cc:333] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.449568 28565 raft_consensus.cc:2243] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.457031 28565 raft_consensus.cc:2272] T 43661428e7964263870fe7a8e07bf265 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.480155 30350 raft_consensus.cc:1217] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:12:28.480491  1885 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:28.481024  1885 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:28.483122  1885 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:28.492197 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:28.519030 29789 leader_election.cc:336] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:28.520882 29789 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:28.522516  1817 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.546278  1826 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:28.552050  1826 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:28.555701  1826 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:28.567318 29715 leader_election.cc:336] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:28.585230 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:28.586086 29823 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:28.589107 28565 tablet_replica.cc:333] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.591079 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:28.593094  1826 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:28.593598  1826 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:28.594164  1826 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:28.606644 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.612968  1883 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:28.613579  1883 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:28.616919  1883 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:28.617129 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:28.623577 30316 leader_election.cc:336] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:28.624431 30316 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:28.625268  1883 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:28.637828  1813 raft_consensus.cc:1064] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:12:28.644266  1813 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:28.658648  1827 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:28.659349  1827 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:28.661808  1827 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:28.683269 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:28.698814 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 106763us
I20260709 13:12:28.705410 28565 raft_consensus.cc:2243] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.706316 28565 raft_consensus.cc:2272] T dff620b2062c4139940ec520664442a1 P a9d8198d0b954886af452e89a8029614 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.709275 28565 tablet_replica.cc:333] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.821867 28565 raft_consensus.cc:2243] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:28.823330 28565 raft_consensus.cc:2272] T 63d505aa7c824fe884968612bdceec56 P a9d8198d0b954886af452e89a8029614 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.820343  1826 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:28.853268 29743 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:28.857713 29715 leader_election.cc:336] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:28.872049 29715 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:28.872874  1905 raft_consensus.cc:2749] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:28.875044  1826 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:28.876399  1807 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:28.887907 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:28.895576 28565 tablet_replica.cc:333] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:28.913415 28565 raft_consensus.cc:2243] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:12:28.937103 28565 raft_consensus.cc:2272] T 1689d69ba5ba4e52b2fc43a53054f310 P a9d8198d0b954886af452e89a8029614 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:28.951442 30350 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:12:28.969887  1807 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:28.970597  1807 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:28.977064  1807 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:28.978363  1883 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:28.979228  1883 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:28.984407 30316 leader_election.cc:336] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:28.985888  1883 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:28.996785 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:28.998762 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:28.999392 29744 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 8.
I20260709 13:12:28.992069 28565 tablet_replica.cc:333] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.010497 30314 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.013270  1883 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:29.013702  1883 raft_consensus.cc:493] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.014129  1883 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:29.020697 29789 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.011297 28565 raft_consensus.cc:2243] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:29.024734 28565 raft_consensus.cc:2272] T f6262c59cea24959ab0dd23d4279895c P a9d8198d0b954886af452e89a8029614 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:29.031525  1826 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.032202  1826 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.044399  1826 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:29.057323 28565 tablet_replica.cc:333] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.058218 28565 raft_consensus.cc:2243] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:29.059264 28565 raft_consensus.cc:2272] T 69d6f3febc834e4aa68fd4b032f83332 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:29.078480 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.089082 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.092830 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:29.093566 30350 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:29.102460 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1638cc6362e14d898e868b6d6927b9c1" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:29.103259 29823 raft_consensus.cc:3060] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:29.110632 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.117017  1826 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.117641  1826 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.120247  1826 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:29.124472  1883 raft_consensus.cc:515] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:29.130405 30316 leader_election.cc:336] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.148671  1901 raft_consensus.cc:493] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:29.149411  1901 raft_consensus.cc:515] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.153776 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:29.155138 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.155889  1905 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:29.156256  1905 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.156620  1905 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.156667  1901 leader_election.cc:290] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:29.158134 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb08df13591747d7bf91993e76665808" candidate_uuid: "a9d8198d0b954886af452e89a8029614" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:29.172993 29638 leader_election.cc:304] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d8198d0b954886af452e89a8029614; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:29.177201  1903 raft_consensus.cc:2749] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:29.187085  1827 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.187711  1827 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.190307  1827 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:29.191532 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.192188 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.200831  1905 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.204000 28565 tablet_replica.cc:333] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.204852 28565 raft_consensus.cc:2243] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:29.205747 28565 raft_consensus.cc:2272] T fb08df13591747d7bf91993e76665808 P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:29.208407 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 53348.7us
W20260709 13:12:29.210767 29715 leader_election.cc:336] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:29.216765 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.217834 29823 raft_consensus.cc:2468] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:29.227864 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b85eaa84d2104a8aa1d25054d069fd33" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:29.228582 29743 raft_consensus.cc:3060] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.236384 29743 raft_consensus.cc:2468] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:29.237622 30314 leader_election.cc:304] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.238463  1841 raft_consensus.cc:2804] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:29.238994  1841 raft_consensus.cc:697] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:29.239822  1841 consensus_queue.cc:237] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.240677  1883 leader_election.cc:290] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:29.245267  1905 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:29.259889 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:29.264140 28565 tablet_replica.cc:333] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.265103 28565 raft_consensus.cc:2243] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:12:29.274277 29570 catalog_manager.cc:5697] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 8 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 9 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.278795 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cc4f503726e4efd8620c27deea0b183" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:29.279412 30350 raft_consensus.cc:3060] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:29.283046 28565 raft_consensus.cc:2272] T 0f1f4e71b89146369180189f4402f3db P a9d8198d0b954886af452e89a8029614 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:29.285852 28565 tablet_replica.cc:333] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.286639 28565 raft_consensus.cc:2243] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:29.286767 30350 raft_consensus.cc:2468] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 11.
I20260709 13:12:29.309875 29715 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.310683  1827 raft_consensus.cc:2804] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:29.311180  1827 raft_consensus.cc:697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:29.312047  1827 consensus_queue.cc:237] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.312372  1807 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:29.287739 28565 raft_consensus.cc:2272] T 57815098d70a4f2bb7a308d71da6ef9a P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:29.320374 29714 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.321290  1807 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.321846  1807 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.322738  1826 raft_consensus.cc:2804] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:29.323257  1826 raft_consensus.cc:697] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:29.326117 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:29.326716 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:29.329417 29821 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 8.
W20260709 13:12:29.332554 29789 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.333438 29789 consensus_peers.cc:597] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:29.324031  1807 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:29.346892 29715 leader_election.cc:336] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.357499 28565 tablet_replica.cc:333] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614: stopping tablet replica
W20260709 13:12:29.360668 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.324159  1826 consensus_queue.cc:237] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.364475 28565 raft_consensus.cc:2243] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:29.365233 28565 raft_consensus.cc:2272] T e0af93d90eed4483befb4778a68e7b7c P a9d8198d0b954886af452e89a8029614 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:29.367017 29714 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.365576  1906 raft_consensus.cc:1064] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:12:29.410597  1919 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:29.411304  1919 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.411721  1919 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.419690 28565 tablet_replica.cc:333] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.420542 28565 raft_consensus.cc:2243] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:29.421667 28565 raft_consensus.cc:2272] T 0801ed5c1b69497e8182bfe2461cdbf3 P a9d8198d0b954886af452e89a8029614 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:29.435846 29789 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.436384 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.431509  1906 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:29.430253 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 65511.9us
W20260709 13:12:29.441139 29789 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.441840 29789 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.447630 29789 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.448336 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.448877 29789 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.449378 29789 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.449898 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.450747 29715 consensus_peers.cc:597] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.451450 29715 leader_election.cc:336] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.451838 29715 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.453838  1841 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.454778  1841 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.456103  1919 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:29.457757 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.458760 29715 consensus_peers.cc:597] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.459285 29715 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:29.460180 29715 leader_election.cc:336] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.463642  1919 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:29.444126  1911 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:29.485780 29715 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.486757 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.488440 30342 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:12:29.490962 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 87470.6us
I20260709 13:12:29.495456 28565 tablet_replica.cc:333] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.496273 28565 raft_consensus.cc:2243] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:29.497561 28565 raft_consensus.cc:2272] T 7fb4a6fd13164dbcbc05c397d0b009b5 P a9d8198d0b954886af452e89a8029614 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:29.461401  1905 raft_consensus.cc:2749] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:29.500541 28565 tablet_replica.cc:333] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614: stopping tablet replica
I20260709 13:12:29.500778  1841 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:29.501255 30316 leader_election.cc:336] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.501258 28565 raft_consensus.cc:2243] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:29.502924 28565 raft_consensus.cc:2272] T c5fd36b246f24922bf4e9f9658c19013 P a9d8198d0b954886af452e89a8029614 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:29.506309 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:29.507040 29743 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:29.509327 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.512213  1841 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.512648  1841 raft_consensus.cc:493] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.513034  1841 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:29.533658  1841 raft_consensus.cc:515] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:29.557175 30316 leader_election.cc:336] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:29.566305 29715 consensus_peers.cc:597] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.568104  1813 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.569696 29570 catalog_manager.cc:5697] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 11, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 11 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.570326  1813 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.572475  1813 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:29.574224 29715 consensus_peers.cc:597] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.578341 29715 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.576305 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:29.579576 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f520c8b2a9e4af1a8676180d2dd96f4" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:29.580178 29743 raft_consensus.cc:3060] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:29.582026 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 131622us
I20260709 13:12:29.583401  1807 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:29.587428 29570 catalog_manager.cc:5697] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 10 to 11, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 11 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.591616 29743 raft_consensus.cc:2468] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 10.
I20260709 13:12:29.596477 30314 leader_election.cc:304] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.597384  1543 raft_consensus.cc:2804] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:29.597885  1543 raft_consensus.cc:697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:29.598712  1543 consensus_queue.cc:237] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.600992  1921 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:12:29.575922  1841 leader_election.cc:290] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:29.618124 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
W20260709 13:12:29.618353 29715 consensus_peers.cc:597] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:29.618765 29821 raft_consensus.cc:3060] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:12:29.619024 29715 consensus_peers.cc:597] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.619212 29814 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:12:29.621263  1919 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.621843  1919 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.624136  1916 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.624851  1919 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:29.626674  1926 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.627238  1926 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.624768  1916 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.648388  1916 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:29.642387  1826 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.649051  1826 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.643747 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:29.651132 29789 leader_election.cc:336] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.651731 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:29.626283 29715 consensus_peers.cc:597] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.629426 29743 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:29.655740 29821 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:29.650735 29740 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 3.
I20260709 13:12:29.662726  1826 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:29.662446 29570 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:29.658131  1885 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:29.665011 29787 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.629374  1926 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:29.674655  1885 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:29.675140  1885 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.675580  1885 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:12:29.683794 29715 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.693536 29715 consensus_peers.cc:597] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.703470  1922 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:29.704198  1911 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.704752  1911 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.706976  1911 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:29.712539 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:29.713239 29740 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:29.714576 29787 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.715452  1920 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:12:29.715835  1920 raft_consensus.cc:493] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.716167  1920 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.721726 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:29.722483 29815 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:29.725150 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:29.725867 29817 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 12.
I20260709 13:12:29.726912 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:29.725718  1885 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.744028  1885 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:29.746531 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:29.748052  1920 raft_consensus.cc:515] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.749257 29821 raft_consensus.cc:2393] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 9: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:29.757066 29743 raft_consensus.cc:3060] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:29.762887 29571 catalog_manager.cc:5697] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 9 to 10, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 10 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:12:29.842718 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 53603.2us
I20260709 13:12:29.836602 29714 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.780783 30350 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:29.844197  1916 raft_consensus.cc:2804] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:29.844727  1916 raft_consensus.cc:697] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:29.845566  1916 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.818744 29743 raft_consensus.cc:2468] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 4.
I20260709 13:12:29.861357 29787 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.862288  1885 raft_consensus.cc:2804] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:29.863160  1885 raft_consensus.cc:697] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:29.863667  1920 leader_election.cc:290] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:29.862200 29743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb12790de164e0a8286849b02b1dc26" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:29.864073  1885 consensus_queue.cc:237] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.864830 29743 raft_consensus.cc:3060] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:29.894688 30345 raft_consensus.cc:1275] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:29.896729 29714 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.897627  1826 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:29.898108  1826 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.898535 29714 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.899535  1916 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:29.899973  1916 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:29.900341  1916 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:29.900362 29743 raft_consensus.cc:2468] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:29.915648 29740 raft_consensus.cc:1275] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:29.906818 29715 leader_election.cc:336] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.920723 29714 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.921895  1921 raft_consensus.cc:2749] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:29.924935 30316 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:29.922955 29571 catalog_manager.cc:5697] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 3 to 4, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:29.926138 29715 leader_election.cc:336] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:29.929064 29715 leader_election.cc:336] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.928437 29568 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 8 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:29.934051  1905 consensus_queue.cc:1048] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:29.929373  1543 consensus_queue.cc:1048] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:12:29.927026 29787 leader_election.cc:304] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:29.898496  1826 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:12:29.938673 29715 consensus_peers.cc:597] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:29.939093  1926 raft_consensus.cc:2804] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:29.945151  1926 raft_consensus.cc:697] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:29.953971  1926 consensus_queue.cc:237] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:29.955983 29817 consensus_queue.cc:237] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:29.959028  1826 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:29.967741 29715 leader_election.cc:336] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.965898  1826 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:29.978005 29715 consensus_peers.cc:597] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:29.984752 29789 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:29.985515 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:29.991648 29742 raft_consensus.cc:1275] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:12:29.992322 29789 leader_election.cc:336] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:29.993747  1543 consensus_queue.cc:1048] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:29.994514 29743 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:29.992725 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:29.996659  1918 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:29.999382 29638 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:30.001770  1918 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:30.001646  1905 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.010329 30345 raft_consensus.cc:1275] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:30.018069 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:30.018702 29821 raft_consensus.cc:3060] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.023085 29817 raft_consensus.cc:1275] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:12:30.024919 30345 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.028371  1916 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.030633  1916 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.031376 29821 raft_consensus.cc:2468] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:30.043676 29814 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.037410  1920 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.049401 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4abf8e3126194219b6a68c724a22f711" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:30.048816 29742 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.050987 29817 raft_consensus.cc:3060] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:12:30.056406 29715 leader_election.cc:336] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:30.084048 29568 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 6 to 7, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.106458  1905 consensus_queue.cc:1048] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:12:30.124826 29817 raft_consensus.cc:2468] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 13.
W20260709 13:12:30.128258 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 43653.6us
I20260709 13:12:30.098237  1807 consensus_queue.cc:1048] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:12:30.157227 29570 catalog_manager.cc:5697] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 9, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:30.150499 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 71258.8us
W20260709 13:12:30.167733 29789 leader_election.cc:336] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:12:30.170574 29714 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 70607.2us
W20260709 13:12:30.170933 29789 leader_election.cc:336] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:30.174665 29714 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
W20260709 13:12:30.173161 29789 leader_election.cc:336] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:30.168640  1911 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:30.191838 29789 leader_election.cc:336] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:30.194958  1919 raft_consensus.cc:2804] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:30.195578  1919 raft_consensus.cc:697] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:30.196473  1919 consensus_queue.cc:237] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.221326  1941 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.221972  1941 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:30.222429 30316 connection.cc:573] client connection to 127.27.229.65:35503 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:12:30.238523 29558 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c538253e68554f7b82c0f993198e47d3 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:30.226469  1911 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.252599 29714 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.255988  1941 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:30.251648  1942 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
W20260709 13:12:30.262910 29789 leader_election.cc:336] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:30.263845  1911 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:30.265632 29740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:30.271333  1905 raft_consensus.cc:2804] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:30.271922  1905 raft_consensus.cc:697] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:30.272826  1905 consensus_queue.cc:237] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:30.281867 29789 leader_election.cc:336] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:12:30.287967 30345 raft_consensus.cc:2955] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:30.294873 30316 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.297202 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:30.303213 29789 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.304092  1943 raft_consensus.cc:2749] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:12:30.304100 29747 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:30.269542  1942 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.314836 29740 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 7.
I20260709 13:12:30.317624 29787 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.319939  1941 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:12:30.320326  1941 raft_consensus.cc:493] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.320695  1941 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:12:30.323542  1942 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.330096 30345 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:30.332541 29817 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:12:30.333251 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:30.336560 29747 raft_consensus.cc:1275] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:30.338299  1943 consensus_queue.cc:1048] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:12:30.342710 29715 connection.cc:769] client connection to 127.27.229.65:35503 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:12:30.349270 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:30.350589 29715 leader_election.cc:336] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:12:30.372268  1922 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:12:30.377007  1920 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.377584  1920 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:30.379731  1920 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:30.381510  1922 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:30.385087 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:30.386858 29817 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:12:30.390532  1941 raft_consensus.cc:515] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.392045  1922 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:12:30.392649  1941 leader_election.cc:290] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:30.393745 29823 raft_consensus.cc:2393] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 42c443079435463daa8845e244cec9d3 in current term 8: Already voted for candidate 389c080a49494f8fb56c53fa7e6087f3 in this term.
I20260709 13:12:30.396449 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1689d69ba5ba4e52b2fc43a53054f310" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:30.397083 29742 raft_consensus.cc:3060] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:12:30.394145 29789 leader_election.cc:336] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.402321 29789 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
W20260709 13:12:30.403590 29789 consensus_peers.cc:597] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.405804  1911 raft_consensus.cc:2749] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:30.407644  1919 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.411290 29570 catalog_manager.cc:5697] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 8 to 9, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.426281 29744 raft_consensus.cc:1275] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:30.428247 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:30.429986 29714 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:30.431979 29789 leader_election.cc:336] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.439507  1920 consensus_queue.cc:1048] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:30.434638 29823 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.435961 29742 raft_consensus.cc:2468] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:30.442857 29787 leader_election.cc:304] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.442407  1919 raft_consensus.cc:2749] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:12:30.480969 30345 raft_consensus.cc:2955] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:30.475659  1926 raft_consensus.cc:2804] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:12:30.487784  1926 raft_consensus.cc:697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:30.488701  1926 consensus_queue.cc:237] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.500566  1905 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.501121  1905 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.502799 29568 catalog_manager.cc:5697] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 9 to 10, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.505908  1905 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.504889 29568 catalog_manager.cc:5697] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 12 to 13, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 13 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:30.511085 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:30.518601 29715 leader_election.cc:336] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.519232 29715 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.520035  1905 raft_consensus.cc:2749] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:30.524994  1920 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.525614  1920 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:30.527916 29789 consensus_peers.cc:597] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.528914  1920 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:30.529116 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:30.529934 29744 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
I20260709 13:12:30.531698 29787 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:30.532594  1807 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:30.532995  1807 raft_consensus.cc:493] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.533360  1807 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.551045  1807 raft_consensus.cc:515] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.554752 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69d6f3febc834e4aa68fd4b032f83332" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:30.555436 29744 raft_consensus.cc:3060] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.557528  1807 leader_election.cc:290] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:30.562704 29789 leader_election.cc:336] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:30.568903 29789 leader_election.cc:336] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.575654 29744 raft_consensus.cc:2468] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:30.577090 29787 leader_election.cc:304] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.577205  1807 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.577872  1807 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.567188 29568 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 7 to 8, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 8 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:30.580247  1926 raft_consensus.cc:2804] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:30.580822  1926 raft_consensus.cc:697] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:30.581743  1926 consensus_queue.cc:237] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:30.584374 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c538253e68554f7b82c0f993198e47d3: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.585023  1807 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:30.588887 29789 leader_election.cc:336] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.590063 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:30.591598 29787 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.596690  1920 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:30.597445 29571 catalog_manager.cc:5697] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 7 to 8, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 8 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:30.629801 29715 consensus_peers.cc:597] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.651413  1930 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.651988  1930 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:30.669818 30316 leader_election.cc:336] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.679257  1928 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.679849  1928 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:30.684185  1928 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.685827 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:30.686555 29823 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 6.
I20260709 13:12:30.687753 30315 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:30.688572  1928 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:12:30.688968  1928 raft_consensus.cc:493] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.689320  1928 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.691715  1930 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.693252 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:30.694180 29823 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 15.
I20260709 13:12:30.698438  1922 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.699046  1922 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.701109  1922 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.707618  1928 raft_consensus.cc:515] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:30.709017 30315 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.709904  1883 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:12:30.734578  1883 raft_consensus.cc:493] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.711850 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1f4e71b89146369180189f4402f3db" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:30.735831 29823 raft_consensus.cc:3060] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:12:30.728372 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:30.736438 29822 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
W20260709 13:12:30.734254 29715 leader_election.cc:336] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.734999  1883 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:12:30.716269 30316 leader_election.cc:336] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.742626 29822 raft_consensus.cc:1275] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:12:30.744577 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.741765 29823 raft_consensus.cc:2468] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 7.
I20260709 13:12:30.746019  1942 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:30.746414  1942 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.746770  1942 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.751171 30315 leader_election.cc:304] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:30.715049 29571 catalog_manager.cc:5697] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 9 to 10, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:30.752430  1543 raft_consensus.cc:2804] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:12:30.752921  1543 raft_consensus.cc:697] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
I20260709 13:12:30.758462  1543 consensus_queue.cc:237] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:30.709795  1928 leader_election.cc:290] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.757850  1905 consensus_queue.cc:1048] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 13:12:30.778362 30316 leader_election.cc:336] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.784533 29822 raft_consensus.cc:1275] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:30.789805  1922 consensus_queue.cc:1048] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:30.782989  1883 raft_consensus.cc:515] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:30.799872 30316 leader_election.cc:336] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.806108  1942 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.811280 29822 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:30.811990 29822 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:30.818048  1942 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.818883 29822 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:30.824584 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0801ed5c1b69497e8182bfe2461cdbf3" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:30.825263 29821 raft_consensus.cc:3060] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:12:30.823549  1883 leader_election.cc:290] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:30.838860 29571 catalog_manager.cc:5697] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 6 to 7, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 7 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:30.840623 29714 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:30.842222  1919 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:30.842741  1919 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:30.843600  1919 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:30.849826 29821 raft_consensus.cc:2468] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 16.
I20260709 13:12:30.853989  1943 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.865113  1943 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:30.870445  1943 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:30.873715 29789 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.880906 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:30.883239 30315 leader_election.cc:304] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: a9d8198d0b954886af452e89a8029614
I20260709 13:12:30.889761 29787 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:30.852234 29715 leader_election.cc:336] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:30.892964  1943 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:30.895262  1883 raft_consensus.cc:2804] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:12:30.897111  1883 raft_consensus.cc:697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 16 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
W20260709 13:12:30.907799 29715 consensus_peers.cc:597] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:30.898587  1883 consensus_queue.cc:237] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:30.971606 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 46751.6us
I20260709 13:12:30.980733  1875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49712 (request call id 1067) took 4478 ms. Trace:
I20260709 13:12:30.988263  1942 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:30.989262  1875 rpcz_store.cc:276] 0709 13:12:26.496754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:26.496913 (+   159us) service_pool.cc:224] Handling call
0709 13:12:26.664382 (+167469us) ts_tablet_manager.cc:934] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503)
0709 13:12:30.975113 (+4310731us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10953,"tablet-copy.queue_time_us":109368,"thread_start_us":193621,"threads_started":2}
W20260709 13:12:31.046890 29789 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:31.053624 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 53753.9us
W20260709 13:12:31.063495 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 56807.6us
W20260709 13:12:31.068372 30314 connection.cc:466] server connection from 127.0.0.1:49712 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:49712 (request call id 1067) could send its response
I20260709 13:12:31.011102  1942 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:31.075085 29747 raft_consensus.cc:1275] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:12:31.090418  1911 consensus_queue.cc:1048] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:12:31.096733  1942 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:31.099092 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:31.099954 29814 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 9.
I20260709 13:12:31.143563 29714 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:31.145267  1980 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:12:31.145730  1980 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a9d8198d0b954886af452e89a8029614)
I20260709 13:12:31.146205  1980 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:31.148111 29568 catalog_manager.cc:5697] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 15 to 16, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 16 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.168934 29742 raft_consensus.cc:1275] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:12:31.170614  1943 consensus_queue.cc:1048] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:12:31.174535 29571 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 9 to 10, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:31.180460 29715 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:31.199291 29789 consensus_peers.cc:597] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:31.209647 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:31.232278  1980 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:31.240033  1980 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:31.241135 29814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:31.241741 29814 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:12:31.251819 29814 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c443079435463daa8845e244cec9d3 in term 10.
I20260709 13:12:31.270056 29814 raft_consensus.cc:1275] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:12:31.310415 29714 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
I20260709 13:12:31.314528  1883 consensus_queue.cc:1048] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:31.318406  1980 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:12:31.319392  1980 raft_consensus.cc:697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Leader. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:31.321590  1980 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:31.337842 29818 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:12:31.346678 30316 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.340513  1945 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 13:12:31.392256 28565 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:31.399411 29715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111) [suppressed 391 similar messages]
W20260709 13:12:31.400707 29715 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:31.440351 29568 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 reported cstate change: term changed from 9 to 10, leader changed from a9d8198d0b954886af452e89a8029614 (127.27.229.65) to 42c443079435463daa8845e244cec9d3 (127.27.229.66). New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:31.470752 29817 raft_consensus.cc:1275] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:12:31.472630 29715 consensus_peers.cc:597] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.474260  1883 consensus_queue.cc:1048] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:12:31.503885 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.504575 30316 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:31.540683 29742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:12:31.541496 29742 raft_consensus.cc:606] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Received request to transfer leadership
W20260709 13:12:31.553490 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:31.564394 29747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
W20260709 13:12:31.564827 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:31.565124 29747 raft_consensus.cc:606] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Received request to transfer leadership
I20260709 13:12:31.569433 29747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5"
dest_uuid: "42c443079435463daa8845e244cec9d3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48012
I20260709 13:12:31.570045 29747 raft_consensus.cc:606] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Received request to transfer leadership
W20260709 13:12:31.596576 29620 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:12:31.597033 29620 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 7fb4a6fd13164dbcbc05c397d0b009b5 already in progress
W20260709 13:12:31.597337 29620 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 7fb4a6fd13164dbcbc05c397d0b009b5 already in progress
W20260709 13:12:31.636632 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.701810 29715 consensus_peers.cc:597] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.734685 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.759040 29715 consensus_peers.cc:597] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:31.796018 29817 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:12:31.797791  1922 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:12:31.804236 29789 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.822430 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:31.825449  1919 raft_consensus.cc:993] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3: : Instructing follower 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:31.826056  1919 raft_consensus.cc:1081] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Signalling peer 389c080a49494f8fb56c53fa7e6087f3 to start an election
I20260709 13:12:31.830857 29814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5"
dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
 from {username='slave'} at 127.0.0.1:51156
I20260709 13:12:31.831514 29814 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.831888 29814 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:31.857313 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.880144 29789 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.869566 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.898097 29715 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fb4a6fd13164dbcbc05c397d0b009b5. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:31.901249 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.903820 29715 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:31.911228 29789 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:31.914144 29814 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:31.929265 29814 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:31.930172 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "42c443079435463daa8845e244cec9d3"
I20260709 13:12:31.930889 29742 raft_consensus.cc:3055] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:12:31.931173 29742 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 42c443079435463daa8845e244cec9d3, State: Running, Role: LEADER
I20260709 13:12:31.932142 29742 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:31.933583 29742 raft_consensus.cc:3060] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:12:31.934000 29715 consensus_peers.cc:597] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:31.943624 29742 raft_consensus.cc:2468] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:31.945338 29787 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3; no voters: 
W20260709 13:12:31.946748 29789 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:31.947077  1926 raft_consensus.cc:2804] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:31.947650  1926 raft_consensus.cc:697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:31.948680  1926 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:12:31.969125 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:31.970366 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c538253e68554f7b82c0f993198e47d3: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:31.974766 29571 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 10 to 11, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 11 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:32.018056 29715 consensus_peers.cc:597] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.041847 29789 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.077333 29789 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.087543 29715 consensus_peers.cc:597] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.088197 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.100394 29789 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.287021 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 140120us
W20260709 13:12:32.320926 29789 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.321499 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.321956 29789 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.344521 29789 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:32.366891 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.376127 29715 consensus_peers.cc:597] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.377880 29715 consensus_peers.cc:597] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.392976 28565 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:32.420279 29789 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7fb4a6fd13164dbcbc05c397d0b009b5. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:32.439642 29715 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.445259 30316 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:32.461099 29747 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:12:32.462992  1911 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:12:32.461882 29715 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:32.466881 29715 consensus_peers.cc:597] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:32.563130 30316 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:32.674230 29715 consensus_peers.cc:597] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:32.787389 29789 consensus_peers.cc:597] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:32.832682 29817 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:32.859540 29740 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:12:32.861450 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5bb27f7a1364209b951570c1c03f996. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:32.862964  1926 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:32.870841 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:32.891916  1926 raft_consensus.cc:2955] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:32.905884 29747 raft_consensus.cc:2955] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:33.019004  2002 ts_tablet_manager.cc:933] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:33.049365 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:33.052038  2002 tablet_copy_client.cc:323] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:12:33.055115 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 7fb4a6fd13164dbcbc05c397d0b009b5 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:12:33.055778 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 7fb4a6fd13164dbcbc05c397d0b009b5 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-7fb4a6fd13164dbcbc05c397d0b009b5
W20260709 13:12:33.060853 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:33.073899 29571 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:33.096982 29747 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:33.097846 29833 tablet_copy_source_session.cc:215] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:33.101703  2002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fb4a6fd13164dbcbc05c397d0b009b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:33.144273 29715 consensus_peers.cc:597] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:33.151377 29603 debug-util.cc:398] Leaking SignalData structure 0x7b0800359f60 after lost signal to thread 28568
W20260709 13:12:33.152500 29603 debug-util.cc:398] Leaking SignalData structure 0x7b080035ed00 after lost signal to thread 29606
W20260709 13:12:33.153772 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd700 after lost signal to thread 29773
W20260709 13:12:33.156219 29603 debug-util.cc:398] Leaking SignalData structure 0x7b08003077c0 after lost signal to thread 29847
W20260709 13:12:33.157506 29603 debug-util.cc:398] Leaking SignalData structure 0x7b0800385400 after lost signal to thread 30374
W20260709 13:12:33.160086 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f96ce2eb1d674d2faf1a6340807d4961. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:33.172021 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.178532 29814 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:12:33.184254 29789 consensus_peers.cc:597] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:33.188256  1919 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:12:33.194876  2002 tablet_copy_client.cc:806] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:33.197975  2002 tablet_copy_client.cc:670] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:33.212368  2002 tablet_copy_client.cc:538] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:33.232973  2002 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:12:33.245957  1945 raft_consensus.cc:2955] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:33.251587 29817 raft_consensus.cc:2955] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:33.290719 29747 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:33.294468  2013 ts_tablet_manager.cc:933] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:33.295054 29568 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:12:33.322652 29715 consensus_peers.cc:597] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57815098d70a4f2bb7a308d71da6ef9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.343173  2013 tablet_copy_client.cc:323] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:12:33.345232 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet b5bb27f7a1364209b951570c1c03f996 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:12:33.345866 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet b5bb27f7a1364209b951570c1c03f996 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-b5bb27f7a1364209b951570c1c03f996
I20260709 13:12:33.349056 29817 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:12:33.350729  1919 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:33.356663 29715 consensus_peers.cc:597] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.363459 29833 tablet_copy_source_session.cc:215] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:33.369192  2013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bb27f7a1364209b951570c1c03f996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.376055  1826 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:33.386591 29817 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
W20260709 13:12:33.393460 28565 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 29695)
I20260709 13:12:33.399242 29814 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:12:33.406101 29715 consensus_peers.cc:597] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:33.405575 29571 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:33.423329 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:33.431700  2002 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:33.432931  2002 tablet_bootstrap.cc:492] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:12:33.433779  2002 ts_tablet_manager.cc:1403] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.201s	user 0.031s	sys 0.015s
I20260709 13:12:33.443379  2002 raft_consensus.cc:359] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:33.445259  2002 raft_consensus.cc:740] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:12:33.446049  2002 consensus_queue.cc:260] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:33.468825  2002 ts_tablet_manager.cc:1434] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:12:33.474750 30342 raft_consensus.cc:1217] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEARNER]: Deduplicated request from leader. Original: 10.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 13:12:33.478591  2013 tablet_copy_client.cc:806] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:33.479174  2013 tablet_copy_client.cc:670] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:33.485749  2013 tablet_copy_client.cc:538] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:33.487852 29747 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:12:33.492566 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165): Couldn't send request to peer 121060c6c5b14502957b76fd1dfc7b2d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 307badafd0e64a4c87993caa003f0e2a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.495043  2020 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:12:33.496395 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.542474 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-7fb4a6fd13164dbcbc05c397d0b009b5 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:12:33.543001 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-7fb4a6fd13164dbcbc05c397d0b009b5 on tablet 7fb4a6fd13164dbcbc05c397d0b009b5 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:33.548525  1982 raft_consensus.cc:2955] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:33.554395  2013 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:12:33.555464 29747 raft_consensus.cc:2955] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } } }
I20260709 13:12:33.595599 29568 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index -1 to 8, NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) added. New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:33.642033  2002 ts_tablet_manager.cc:933] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:33.675326  2002 tablet_copy_client.cc:323] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:12:33.679692 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet f96ce2eb1d674d2faf1a6340807d4961 from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:12:33.680327 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet f96ce2eb1d674d2faf1a6340807d4961 from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-f96ce2eb1d674d2faf1a6340807d4961
I20260709 13:12:33.700423 29759 tablet_copy_source_session.cc:215] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:33.719309  2002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f96ce2eb1d674d2faf1a6340807d4961. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:33.769879  2024 ts_tablet_manager.cc:933] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:33.772235 29789 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:33.794461 30316 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:33.800318  2002 tablet_copy_client.cc:806] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:33.800973  2002 tablet_copy_client.cc:670] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:12:33.805153 29789 consensus_peers.cc:597] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:33.810029  2002 tablet_copy_client.cc:538] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:12:33.865404  2002 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
W20260709 13:12:33.909511 30316 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:33.953356 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:33.993232  2013 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:33.999331  2013 tablet_bootstrap.cc:492] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:12:34.000124  2013 ts_tablet_manager.cc:1403] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.446s	user 0.027s	sys 0.029s
W20260709 13:12:34.005246 29715 consensus_peers.cc:597] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.016973  1911 raft_consensus.cc:1064] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:12:34.017319  2024 tablet_copy_client.cc:323] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.66:46333
I20260709 13:12:34.019399 29759 tablet_copy_service.cc:140] P 42c443079435463daa8845e244cec9d3: Received BeginTabletCopySession request for tablet 57815098d70a4f2bb7a308d71da6ef9a from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:36354)
I20260709 13:12:34.020017 29759 tablet_copy_service.cc:161] P 42c443079435463daa8845e244cec9d3: Beginning new tablet copy session on tablet 57815098d70a4f2bb7a308d71da6ef9a from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:36354: session id = 121060c6c5b14502957b76fd1dfc7b2d-57815098d70a4f2bb7a308d71da6ef9a
I20260709 13:12:34.019863  1911 consensus_queue.cc:237] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:34.028345 29759 tablet_copy_source_session.cc:215] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:34.046952  2013 raft_consensus.cc:359] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:12:34.055918 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.068023  2024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57815098d70a4f2bb7a308d71da6ef9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:34.081573 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.085845 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.087054  2028 ts_tablet_manager.cc:933] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: Initiating tablet copy from peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:34.089190 29789 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.057667  2013 raft_consensus.cc:740] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:12:34.101634 30342 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:34.104295 29747 raft_consensus.cc:1275] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:12:34.106216  2028 tablet_copy_client.cc:323] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Beginning tablet copy session from remote peer at address 127.27.229.67:34899
I20260709 13:12:34.108529 29833 tablet_copy_service.cc:140] P 389c080a49494f8fb56c53fa7e6087f3: Received BeginTabletCopySession request for tablet 307badafd0e64a4c87993caa003f0e2a from peer 121060c6c5b14502957b76fd1dfc7b2d ({username='slave'} at 127.0.0.1:52208)
I20260709 13:12:34.109145 29833 tablet_copy_service.cc:161] P 389c080a49494f8fb56c53fa7e6087f3: Beginning new tablet copy session on tablet 307badafd0e64a4c87993caa003f0e2a from peer 121060c6c5b14502957b76fd1dfc7b2d at {username='slave'} at 127.0.0.1:52208: session id = 121060c6c5b14502957b76fd1dfc7b2d-307badafd0e64a4c87993caa003f0e2a
I20260709 13:12:34.109715  2020 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:12:34.112730  2020 consensus_queue.cc:1048] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:34.115940 29789 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:34.117079 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:42165, user_credentials={real_user=slave}} blocked reactor thread for 58850.1us
I20260709 13:12:34.129845  2002 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:34.139120  2002 tablet_bootstrap.cc:492] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:12:34.139978  2002 ts_tablet_manager.cc:1403] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.275s	user 0.040s	sys 0.007s
I20260709 13:12:34.142911 29833 tablet_copy_source_session.cc:215] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:12:34.147197  2002 raft_consensus.cc:359] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:34.148180  2002 raft_consensus.cc:740] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:12:34.153203  2002 consensus_queue.cc:260] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:34.138371  2013 consensus_queue.cc:260] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:34.173259  2028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307badafd0e64a4c87993caa003f0e2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:34.176091  2013 ts_tablet_manager.cc:1434] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.176s	user 0.007s	sys 0.002s
I20260709 13:12:34.190991 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-b5bb27f7a1364209b951570c1c03f996 received from {username='slave'} at 127.0.0.1:52208
I20260709 13:12:34.191427 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-b5bb27f7a1364209b951570c1c03f996 on tablet b5bb27f7a1364209b951570c1c03f996 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:34.192287  2002 ts_tablet_manager.cc:1434] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 13:12:34.194753 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f96ce2eb1d674d2faf1a6340807d4961 received from {username='slave'} at 127.0.0.1:36354
I20260709 13:12:34.195204 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-f96ce2eb1d674d2faf1a6340807d4961 on tablet f96ce2eb1d674d2faf1a6340807d4961 with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:34.202889  1982 raft_consensus.cc:2955] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 6 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:34.212292 29747 raft_consensus.cc:2955] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 6 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:34.225255 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.230027  2024 tablet_copy_client.cc:806] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
I20260709 13:12:34.230643  2024 tablet_copy_client.cc:670] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
W20260709 13:12:34.231748 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.242637  2024 tablet_copy_client.cc:538] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:34.245388 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 43832.1us
I20260709 13:12:34.247228 30345 raft_consensus.cc:2955] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 6 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:34.264052  2024 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
I20260709 13:12:34.264640 29568 catalog_manager.cc:5697] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 6 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:34.279829 30342 raft_consensus.cc:1217] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:12:34.281880 30344 raft_consensus.cc:1217] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Deduplicated request from leader. Original: 9.7->[9.8-9.8]   Dedup: 9.8->[]
I20260709 13:12:34.278519  2028 tablet_copy_client.cc:806] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 0 data blocks...
W20260709 13:12:34.289687 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.309891  2028 tablet_copy_client.cc:670] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Starting download of 1 WAL segments...
I20260709 13:12:34.343624  2028 tablet_copy_client.cc:538] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:12:34.393965 28565 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:34.454495 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.385835  2028 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap starting.
W20260709 13:12:34.522739 29789 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.543582 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.577275 29715 consensus_peers.cc:597] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.579728 29715 consensus_peers.cc:597] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.586432 29789 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.587146 29789 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.591961 29789 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.618589  2028 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:34.619772  2028 tablet_bootstrap.cc:492] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:12:34.620999  2028 ts_tablet_manager.cc:1403] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.235s	user 0.046s	sys 0.004s
I20260709 13:12:34.624161  2028 raft_consensus.cc:359] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:34.634519  2028 raft_consensus.cc:740] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:12:34.641199  2028 consensus_queue.cc:260] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
W20260709 13:12:34.647616 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.650322  2028 ts_tablet_manager.cc:1434] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.002s
I20260709 13:12:34.654893 29833 tablet_copy_service.cc:342] P 389c080a49494f8fb56c53fa7e6087f3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-307badafd0e64a4c87993caa003f0e2a received from {username='slave'} at 127.0.0.1:52208
I20260709 13:12:34.655309 29833 tablet_copy_service.cc:434] P 389c080a49494f8fb56c53fa7e6087f3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-307badafd0e64a4c87993caa003f0e2a on tablet 307badafd0e64a4c87993caa003f0e2a with peer 121060c6c5b14502957b76fd1dfc7b2d
I20260709 13:12:34.674028  2024 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:34.694643  2024 tablet_bootstrap.cc:492] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: Bootstrap complete.
I20260709 13:12:34.700361  2024 ts_tablet_manager.cc:1403] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: Time spent bootstrapping tablet: real 0.437s	user 0.030s	sys 0.013s
I20260709 13:12:34.715669  2024 raft_consensus.cc:359] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:34.723658  2024 raft_consensus.cc:740] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Initialized, Role: LEARNER
I20260709 13:12:34.766809  2024 consensus_queue.cc:260] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: NON_VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: true } }
I20260709 13:12:34.769416  2024 ts_tablet_manager.cc:1434] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: Time spent starting tablet: real 0.068s	user 0.000s	sys 0.004s
W20260709 13:12:34.774577 29789 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.787820 29715 consensus_peers.cc:597] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.796208 29759 tablet_copy_service.cc:342] P 42c443079435463daa8845e244cec9d3: Request end of tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-57815098d70a4f2bb7a308d71da6ef9a received from {username='slave'} at 127.0.0.1:36354
I20260709 13:12:34.796783 29759 tablet_copy_service.cc:434] P 42c443079435463daa8845e244cec9d3: ending tablet copy session 121060c6c5b14502957b76fd1dfc7b2d-57815098d70a4f2bb7a308d71da6ef9a on tablet 57815098d70a4f2bb7a308d71da6ef9a with peer 121060c6c5b14502957b76fd1dfc7b2d
W20260709 13:12:34.805518 29715 consensus_peers.cc:597] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.810607 29789 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.813808  1919 raft_consensus.cc:1064] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:12:34.816143  1919 consensus_queue.cc:237] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:34.824424 29715 consensus_peers.cc:597] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:34.858412 29715 consensus_peers.cc:597] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.859704 30344 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:12:34.861249 29817 raft_consensus.cc:1275] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:34.864205 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:34.864694  2016 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:34.869994 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.871373  1919 consensus_queue.cc:1048] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:34.885331  2035 raft_consensus.cc:1064] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:12:34.888284  2035 consensus_queue.cc:237] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:34.890955 29789 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:34.911413 30316 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:34.918280 30316 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:34.932394  2016 raft_consensus.cc:2955] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:34.936117 29740 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:34.941035  2035 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:34.936705 30344 raft_consensus.cc:1275] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:12:34.943694 29822 raft_consensus.cc:2955] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:34.947124 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:34.950474  2035 consensus_queue.cc:1048] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:34.975095 29715 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:34.992169 30342 raft_consensus.cc:1217] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
W20260709 13:12:35.005452 29715 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:35.048512 29571 catalog_manager.cc:5697] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.058547 30345 raft_consensus.cc:2955] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.061285  2035 raft_consensus.cc:2955] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.075785 29740 raft_consensus.cc:2955] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.116176 30345 raft_consensus.cc:2955] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:35.155004 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:35.162663 29715 consensus_peers.cc:597] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:35.185057 29715 consensus_peers.cc:597] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:35.196911 29570 catalog_manager.cc:5697] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.210975 30345 raft_consensus.cc:1217] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
W20260709 13:12:35.394569 28565 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 29695)
I20260709 13:12:35.476449  2020 raft_consensus.cc:1064] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
I20260709 13:12:35.481987  2020 consensus_queue.cc:237] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:35.520771 30345 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:35.520857 29744 raft_consensus.cc:1275] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:35.524564  1982 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:35.532835 29789 consensus_peers.cc:597] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:35.534231  1911 consensus_queue.cc:1048] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:35.563309 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:35.568257  2035 raft_consensus.cc:2955] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.610441 29744 raft_consensus.cc:2955] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.614624 30345 raft_consensus.cc:2955] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.622340 29568 catalog_manager.cc:5697] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:35.642694  2032 raft_consensus.cc:1064] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: attempting to promote NON_VOTER 121060c6c5b14502957b76fd1dfc7b2d to VOTER
W20260709 13:12:35.644758 29715 consensus_peers.cc:597] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:35.655813 29789 consensus_peers.cc:597] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:35.665155  2032 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:35.776423 29822 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:35.776467 30344 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEARNER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:12:35.780014  2032 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:12:35.781896  1919 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:12:35.783779 29715 consensus_peers.cc:597] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:35.810129 29715 consensus_peers.cc:597] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:35.823107  2032 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.827862 29822 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:35.878413 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:12:35.877992 29571 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.917069 30345 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } attrs { replace: true } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:35.993077 29744 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:36.000597 30345 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:36.002558  2060 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:12:36.018074  2032 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:36.021132 30345 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
I20260709 13:12:36.032213 29822 raft_consensus.cc:1275] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Refusing update from remote peer 42c443079435463daa8845e244cec9d3: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:12:36.034045 29557 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57815098d70a4f2bb7a308d71da6ef9a with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:12:36.037412  2032 consensus_queue.cc:1048] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:12:36.043926 29571 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 reported cstate change: config changed from index 9 to 10, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New cstate: current_term: 10 leader_uuid: "42c443079435463daa8845e244cec9d3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:36.055857 29822 raft_consensus.cc:2955] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER a9d8198d0b954886af452e89a8029614 (127.27.229.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } } }
W20260709 13:12:36.162034 29559 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51524.7us
W20260709 13:12:36.164896 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57815098d70a4f2bb7a308d71da6ef9a: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:36.174719 30316 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:36.324050 29715 consensus_peers.cc:597] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.349748 30316 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:36.395366 28565 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:36.402901 29715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111) [suppressed 463 similar messages]
W20260709 13:12:36.500128 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.545441 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.593194 29789 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.624207 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.644821 29789 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:36.658404 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.669370 29789 consensus_peers.cc:597] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:36.682150 29789 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:36.716913 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.742723 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.781422 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.802315 30314 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 75534.7us
W20260709 13:12:36.825667 29715 consensus_peers.cc:597] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.883637 29789 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.871809 29715 consensus_peers.cc:597] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.945505 29789 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.960285 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:36.964520 29789 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.007563 29789 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.108036 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.122303 29715 consensus_peers.cc:597] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.191447 30316 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:37.195752 29789 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.214095 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:37.274780 30316 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:37.330480 29715 consensus_peers.cc:597] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:37.332197 29789 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.338753 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.395990 28565 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:37.401489 29715 consensus_peers.cc:597] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.437805 29715 consensus_peers.cc:597] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:37.458348 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.460433 29559 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 65075.7us
W20260709 13:12:37.463320 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57815098d70a4f2bb7a308d71da6ef9a: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:37.532212 29789 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.556309 29715 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.559659 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:37.601563 29715 consensus_peers.cc:597] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.612465 29715 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.690753 29715 consensus_peers.cc:597] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:37.953390 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:38.043083 29789 consensus_peers.cc:597] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:38.068959 29715 consensus_peers.cc:597] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:38.365869 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:38.403380 28565 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:38.748850 29559 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 44559.9us
W20260709 13:12:38.768873 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57815098d70a4f2bb7a308d71da6ef9a: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:38.968566 30314 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.019s	sys 0.018s
W20260709 13:12:38.969091 30314 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.019s	sys 0.018s
W20260709 13:12:38.970986 30315 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.004s	sys 0.011s
W20260709 13:12:38.971421 30315 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.004s	sys 0.011s
W20260709 13:12:39.006910 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 616593us
W20260709 13:12:39.039436 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 45028.5us
I20260709 13:12:39.305209  2077 raft_consensus.cc:493] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:39.305866  2077 raft_consensus.cc:515] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:39.345141 29787 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:46333, user_credentials={real_user=slave}} blocked reactor thread for 266297us
I20260709 13:12:39.347779  2085 raft_consensus.cc:493] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:39.348385  2085 raft_consensus.cc:515] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:39.367537 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 288517us
W20260709 13:12:39.369253 29559 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 70497.7us
I20260709 13:12:39.374521  2084 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:39.375366  2084 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:39.378552 29789 consensus_peers.cc:597] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:39.378593  2084 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:39.378786 29742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5444d738efbb44128f4f34da83448b15" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
W20260709 13:12:39.383301 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:39.393401  2077 leader_election.cc:290] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:39.395128 29789 leader_election.cc:336] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:39.398854 29715 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 956410us
I20260709 13:12:39.399577 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:39.401722  2090 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:39.403903 28565 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:39.412153 29715 consensus_peers.cc:597] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:39.418089 29715 leader_election.cc:336] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:39.457186  2064 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:39.461869  2040 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:39.462486  2040 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:39.464041  2074 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:39.464614  2074 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:39.457844  2064 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:39.465385  2040 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:39.476222  2077 raft_consensus.cc:493] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:39.476835  2077 raft_consensus.cc:515] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:39.478902  2077 leader_election.cc:290] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:39.484236 29715 leader_election.cc:336] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:39.501435  2080 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:39.502075  2080 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:39.505559  2076 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:39.506207  2080 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:39.506199  2076 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:39.509337 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44b63ddac1a74c0c852d0c1d433ae7c4" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:39.509542  2076 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:39.466691  2074 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:39.514086 29715 consensus_peers.cc:597] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:39.469762  2064 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:39.525106  2076 raft_consensus.cc:493] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 121060c6c5b14502957b76fd1dfc7b2d)
I20260709 13:12:39.525837  2076 raft_consensus.cc:515] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:39.528707  2076 leader_election.cc:290] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:39.536878  2085 leader_election.cc:290] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:39.541199 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:39.543411 29744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa5a096f6b164ab5849280a34b19d3b7" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:39.550971 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:39.560529  2093 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:39.561184  2093 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:39.563503  2093 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:39.564446 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:39.566519 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:39.570434 29815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:39.571990 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fb4a6fd13164dbcbc05c397d0b009b5" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:39.549566  2080 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:39.575938  2080 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:39.578367  2080 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:39.578559 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:39.581310 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:39.589053 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15438e4033d048dfa9c154db86242bc3" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:39.592484 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc2bf2df3534ed4bb09dedb2cec3002" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:39.601562 29747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "42c443079435463daa8845e244cec9d3" is_pre_election: true
I20260709 13:12:39.610366 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9aef678cd634050a9cbee4fe1f83abc" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:39.612815 30315 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:39.614384 29823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c996471e869b4dc78487f6b92d7bb586" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:39.615324 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:39.615479 29821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247648c6c3c549fcb98f79d8df339536" candidate_uuid: "42c443079435463daa8845e244cec9d3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:39.619493  2070 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:39.617321 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43661428e7964263870fe7a8e07bf265" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
W20260709 13:12:39.620393 29789 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:39.622799 30315 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:39.625836  2070 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:39.628074 30315 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:39.629959  2070 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:39.632064 29789 leader_election.cc:336] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:39.632637 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:39.634099 30316 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 51958us
I20260709 13:12:39.634331  2085 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:39.642199 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:39.645172 29714 leader_election.cc:304] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:39.647712  2079 raft_consensus.cc:2749] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:39.651660 29714 leader_election.cc:304] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:39.653187  2095 raft_consensus.cc:2749] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:12:39.666911 30316 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:39.672305 30316 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:39.675053 30316 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:39.675161 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
W20260709 13:12:39.675973 30316 leader_election.cc:336] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:39.676038  2085 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:12:39.677029 30316 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:39.677858  2070 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:12:39.679062 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:39.677889 29714 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:39.680681 29714 leader_election.cc:304] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 42c443079435463daa8845e244cec9d3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3
I20260709 13:12:39.681782  2077 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:39.682452  2077 raft_consensus.cc:2749] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:39.679340 29715 consensus_peers.cc:597] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:39.688697 29789 leader_election.cc:336] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:39.689384 29789 leader_election.cc:304] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, a9d8198d0b954886af452e89a8029614
I20260709 13:12:39.694218  2085 raft_consensus.cc:2749] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:39.718145 29789 consensus_peers.cc:597] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:39.718756 29789 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:39.827811 29789 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:39.913430 29715 consensus_peers.cc:597] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:39.922691 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:39.933055 29789 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:39.933620 29789 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:39.945804 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:39.980069 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.020711 29789 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.028553 29715 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.056802 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800042900 after lost signal to thread 28568
W20260709 13:12:40.057955 29844 debug-util.cc:398] Leaking SignalData structure 0x7b080033b960 after lost signal to thread 29606
W20260709 13:12:40.059281 29844 debug-util.cc:398] Leaking SignalData structure 0x7b0800346cc0 after lost signal to thread 29773
W20260709 13:12:40.060431 29844 debug-util.cc:398] Leaking SignalData structure 0x7b08001e11c0 after lost signal to thread 29847
W20260709 13:12:40.061619 29844 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8160 after lost signal to thread 30374
W20260709 13:12:40.135643 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.159991 29789 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.197767 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:40.404930 28565 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:40.442667 30316 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:40.517083 29715 consensus_peers.cc:597] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.561887 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.563903 29789 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.565258 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.575734 29715 consensus_peers.cc:597] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.579552 30316 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:40.621133 29789 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.644681 29715 consensus_peers.cc:597] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.685585 29789 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.782542 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:40.872728 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57815098d70a4f2bb7a308d71da6ef9a: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:40.973569 29715 consensus_peers.cc:597] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:40.989609 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:41.059630 29715 consensus_peers.cc:597] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:41.116858 29715 consensus_peers.cc:597] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:41.174958 29715 consensus_peers.cc:597] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:41.176525 29789 consensus_peers.cc:597] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:41.268949 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:41.377741 29715 consensus_peers.cc:597] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:41.436189 28565 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 29695)
W20260709 13:12:41.477769 29715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111) [suppressed 405 similar messages]
W20260709 13:12:41.574504 29789 consensus_peers.cc:597] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:41.589730 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:41.623027 29789 consensus_peers.cc:597] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:41.949384 30316 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:41.961717 29789 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:42.002640 29715 consensus_peers.cc:597] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.098585 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.132557 29715 consensus_peers.cc:597] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:42.145485 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
W20260709 13:12:42.148787 29715 consensus_peers.cc:597] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:42.157115 29789 consensus_peers.cc:597] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:42.170078 29715 consensus_peers.cc:597] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:42.264652 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.265434 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.268265 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.278192 29789 consensus_peers.cc:597] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.311975 30316 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:12:42.329288 29715 consensus_peers.cc:597] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:42.365350 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
W20260709 13:12:42.398391 30314 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.399262 30314 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.427228 29789 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.437026 29789 consensus_peers.cc:597] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.469858 29789 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.473337 29789 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:42.476424 30314 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.497606 29787 consensus_peers.cc:597] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.500959 29715 consensus_peers.cc:597] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:12:42.507359 29787 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.511932 30314 consensus_peers.cc:597] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.526681 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:42.529114 28565 tablet_replica.cc:333] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3: stopping tablet replica
W20260709 13:12:42.535104 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.540021 29787 consensus_peers.cc:597] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.550858 29787 consensus_peers.cc:597] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.567420 30314 consensus_peers.cc:597] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.568257 29787 consensus_peers.cc:597] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.571255 30314 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.572309 28565 raft_consensus.cc:2243] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.573505 28565 raft_consensus.cc:2272] T a40195a1eb8d422f8e2cec6f836a23ee P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.595876 30314 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.601425 28565 tablet_replica.cc:333] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.602615 28565 raft_consensus.cc:2243] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.604055 28565 raft_consensus.cc:2272] T 1638cc6362e14d898e868b6d6927b9c1 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.609189 28565 tablet_replica.cc:333] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3: stopping tablet replica
W20260709 13:12:42.615685 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:42.624069 28565 raft_consensus.cc:2243] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.625384 28565 raft_consensus.cc:2272] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.628422 28565 tablet_replica.cc:333] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.629451 28565 raft_consensus.cc:2243] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.630757 28565 raft_consensus.cc:2272] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.648260 29787 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.649650 28565 tablet_replica.cc:333] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
W20260709 13:12:42.650547 29787 consensus_peers.cc:597] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.650784 28565 raft_consensus.cc:2243] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.652235 28565 raft_consensus.cc:2272] T c538253e68554f7b82c0f993198e47d3 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.657428 29787 consensus_peers.cc:597] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.662320 28565 tablet_replica.cc:333] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3: stopping tablet replica
W20260709 13:12:42.665542 29787 consensus_peers.cc:597] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.674566 29787 consensus_peers.cc:597] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.677448 28565 raft_consensus.cc:2243] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.678387 28565 raft_consensus.cc:2272] T a191ecb8137c4add8a89d6a240470f6b P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.681401 28565 tablet_replica.cc:333] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.682284 28565 raft_consensus.cc:2243] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.682972 28565 raft_consensus.cc:2272] T fc891e1e674747fda6007601f64c4341 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.686368 28565 tablet_replica.cc:333] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.687211 28565 raft_consensus.cc:2243] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.689105 28565 raft_consensus.cc:2272] T 307badafd0e64a4c87993caa003f0e2a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.692088 28565 tablet_replica.cc:333] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.692924 28565 raft_consensus.cc:2243] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.693980 28565 raft_consensus.cc:2272] T aa5a096f6b164ab5849280a34b19d3b7 P 42c443079435463daa8845e244cec9d3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.696919 28565 tablet_replica.cc:333] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.697762 28565 raft_consensus.cc:2243] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.698972 28565 raft_consensus.cc:2272] T 222c2ac209fd4c24a1f636fff5c13739 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.701848 28565 tablet_replica.cc:333] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.702726 28565 raft_consensus.cc:2243] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.703281 28565 raft_consensus.cc:2272] T f35983a3f0f340da8a2b9daae61af306 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.706130 28565 tablet_replica.cc:333] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.706919 28565 raft_consensus.cc:2243] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.708190 28565 raft_consensus.cc:2272] T 69b5d0bcdd3a4027b3e5abda839ab825 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.711807 28565 tablet_replica.cc:333] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.712661 28565 raft_consensus.cc:2243] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.714298 28565 raft_consensus.cc:2272] T 1cc4f503726e4efd8620c27deea0b183 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.717082 28565 tablet_replica.cc:333] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.717840 28565 raft_consensus.cc:2243] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:42.714187 29787 consensus_peers.cc:597] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.720691 28565 raft_consensus.cc:2272] T b85eaa84d2104a8aa1d25054d069fd33 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.723225 29715 consensus_peers.cc:597] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:42.728336 30314 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.729229 29787 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.736357 30314 consensus_peers.cc:597] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.741037 30314 consensus_peers.cc:597] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.744545 28565 tablet_replica.cc:333] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.745422 28565 raft_consensus.cc:2243] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.746601 28565 raft_consensus.cc:2272] T b03ee62645904e089f0f2c4dffb22b40 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.749310 28565 tablet_replica.cc:333] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.750101 28565 raft_consensus.cc:2243] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.750890 28565 raft_consensus.cc:2272] T 917259a5b1e94566bb501796d8c4740d P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.751574 29789 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:42.753907 28565 tablet_replica.cc:333] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.754794 28565 raft_consensus.cc:2243] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.756502 28565 raft_consensus.cc:2272] T f96ce2eb1d674d2faf1a6340807d4961 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.759307 28565 tablet_replica.cc:333] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.760087 28565 raft_consensus.cc:2243] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:42.760816 29787 consensus_peers.cc:597] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.760919 28565 raft_consensus.cc:2272] T abb12790de164e0a8286849b02b1dc26 P 42c443079435463daa8845e244cec9d3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.764031 28565 tablet_replica.cc:333] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.764807 28565 raft_consensus.cc:2243] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.766351 28565 raft_consensus.cc:2272] T f0d5a34ce22a44e2a4882baa5443f81e P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.773550 29787 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.770144 28565 tablet_replica.cc:333] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.774896 28565 raft_consensus.cc:2243] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.776288 28565 raft_consensus.cc:2272] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.779364 28565 tablet_replica.cc:333] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.780189 28565 raft_consensus.cc:2243] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.781301 28565 raft_consensus.cc:2272] T b5bb27f7a1364209b951570c1c03f996 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.784056 28565 tablet_replica.cc:333] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.784855 28565 raft_consensus.cc:2243] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.786072 28565 raft_consensus.cc:2272] T 4abf8e3126194219b6a68c724a22f711 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.788913 28565 tablet_replica.cc:333] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.789670 28565 raft_consensus.cc:2243] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.790377 28565 raft_consensus.cc:2272] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.793088 28565 tablet_replica.cc:333] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.793824 28565 raft_consensus.cc:2243] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.795204 28565 raft_consensus.cc:2272] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 42c443079435463daa8845e244cec9d3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.798025 28565 tablet_replica.cc:333] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.798835 28565 raft_consensus.cc:2243] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.799417 28565 raft_consensus.cc:2272] T 15438e4033d048dfa9c154db86242bc3 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.802239 28565 tablet_replica.cc:333] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.803021 28565 raft_consensus.cc:2243] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.804221 28565 raft_consensus.cc:2272] T 5444d738efbb44128f4f34da83448b15 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.807778 30314 consensus_peers.cc:597] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.808327 28565 tablet_replica.cc:333] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.809131 28565 raft_consensus.cc:2243] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:42.815322 29715 consensus_peers.cc:597] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:42.816042 28565 raft_consensus.cc:2272] T a9aef678cd634050a9cbee4fe1f83abc P 42c443079435463daa8845e244cec9d3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.819343 28565 tablet_replica.cc:333] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.820129 28565 raft_consensus.cc:2243] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.821470 28565 raft_consensus.cc:2272] T 247648c6c3c549fcb98f79d8df339536 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.825700 28565 tablet_replica.cc:333] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.826570 28565 raft_consensus.cc:2243] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.827713 28565 raft_consensus.cc:2272] T 5cafd7309bc64f839076e213c80b391c P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.830786 28565 tablet_replica.cc:333] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.831602 28565 raft_consensus.cc:2243] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.832438 28565 raft_consensus.cc:2272] T c996471e869b4dc78487f6b92d7bb586 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.835794 28565 tablet_replica.cc:333] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.836572 28565 raft_consensus.cc:2243] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.837801 28565 raft_consensus.cc:2272] T 0dba966d409c4e37bce58c7db358ebbb P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.840442 28565 tablet_replica.cc:333] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.841239 28565 raft_consensus.cc:2243] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.842376 28565 raft_consensus.cc:2272] T e0f895f1660a4065920da71ac5df9433 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.845036 28565 tablet_replica.cc:333] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.845777 28565 raft_consensus.cc:2243] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.846653 28565 raft_consensus.cc:2272] T 1689d69ba5ba4e52b2fc43a53054f310 P 42c443079435463daa8845e244cec9d3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.849723 28565 tablet_replica.cc:333] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.850554 28565 raft_consensus.cc:2243] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.851734 28565 raft_consensus.cc:2272] T 7df971e435c648008d74c7352ccea2d9 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.855751 28565 tablet_replica.cc:333] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.857046 28565 raft_consensus.cc:2243] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.858199 28565 raft_consensus.cc:2272] T 63d505aa7c824fe884968612bdceec56 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.862741 28565 tablet_replica.cc:333] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.863477 28565 raft_consensus.cc:2243] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.869653 28565 raft_consensus.cc:2272] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 42c443079435463daa8845e244cec9d3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.872473 28565 tablet_replica.cc:333] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
W20260709 13:12:42.872944 29787 consensus_peers.cc:597] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.873359 28565 raft_consensus.cc:2243] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.874027 28565 raft_consensus.cc:2272] T 69d6f3febc834e4aa68fd4b032f83332 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.877009 28565 tablet_replica.cc:333] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.880329 28565 raft_consensus.cc:2243] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.881217 28565 raft_consensus.cc:2272] T fb08df13591747d7bf91993e76665808 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.882717 30316 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:42.921510 28565 tablet_replica.cc:333] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.922622 28565 raft_consensus.cc:2243] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.931661 28565 raft_consensus.cc:2272] T 8c959a6f0c6345c9b312b54d4090ba28 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.934726 28565 tablet_replica.cc:333] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.955407 28565 raft_consensus.cc:2243] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.980191 28565 raft_consensus.cc:2272] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.998603 28565 tablet_replica.cc:333] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:42.999454 28565 raft_consensus.cc:2243] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:12:43.005164 28565 raft_consensus.cc:2272] T d7943a6965d54826a2eee391b1459b90 P 42c443079435463daa8845e244cec9d3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:43.014120 28565 tablet_replica.cc:333] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:43.014963 28565 raft_consensus.cc:2243] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:43.015931 28565 raft_consensus.cc:2272] T c5fd36b246f24922bf4e9f9658c19013 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:43.018914 28565 tablet_replica.cc:333] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:43.019654 28565 raft_consensus.cc:2243] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:43.020328 28565 raft_consensus.cc:2272] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:43.053908 28565 tablet_replica.cc:333] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:43.054728 28565 raft_consensus.cc:2243] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:43.056190 28565 raft_consensus.cc:2272] T 57815098d70a4f2bb7a308d71da6ef9a P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:43.064301 28565 tablet_replica.cc:333] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:43.065085 28565 raft_consensus.cc:2243] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:43.065886 28565 raft_consensus.cc:2272] T 955eae6c53474f8a9c1673dbd294937e P 42c443079435463daa8845e244cec9d3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:43.073084 28565 tablet_replica.cc:333] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:43.073887 28565 raft_consensus.cc:2243] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:43.075098 28565 raft_consensus.cc:2272] T fba8307a3fdc4b40993f8208111c67f1 P 42c443079435463daa8845e244cec9d3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:43.158833 30316 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:43.173115 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:43.179301 28565 tablet_replica.cc:333] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3: stopping tablet replica
I20260709 13:12:43.197722 28565 raft_consensus.cc:2243] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:43.198657 28565 raft_consensus.cc:2272] T e0af93d90eed4483befb4778a68e7b7c P 42c443079435463daa8845e244cec9d3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:43.578639  2103 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.579329  2103 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:43.593158 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:43.597694 30314 leader_election.cc:336] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:43.602834 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:43.605520 30315 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:43.606796  2071 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:43.622496  2103 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:43.713495  2103 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.714222  2103 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:43.721077 30314 leader_election.cc:336] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:43.722085  2103 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:43.728950 30316 leader_election.cc:336] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:43.735052 30316 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:43.738333  2110 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.739063  2110 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.739537  2110 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:43.742990  2110 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:43.748380 30314 leader_election.cc:336] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:43.754417 30316 leader_election.cc:336] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:43.754954 30316 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:43.755748  2103 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.784149  2112 raft_consensus.cc:493] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.784807  2112 raft_consensus.cc:515] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:43.787200  2112 leader_election.cc:290] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:43.799399 29787 leader_election.cc:336] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:43.816218 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:43.834242  2103 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.834828  2103 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:43.837080  2103 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:43.846609 30314 leader_election.cc:336] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:43.853364 30316 leader_election.cc:336] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:43.853849 30316 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:43.854597  2103 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:43.857112  2112 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.857700  2112 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:43.862350 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:43.863032 30350 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 8.
I20260709 13:12:43.874958 29789 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:43.875954  2111 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:12:43.876324 29787 leader_election.cc:336] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:43.876364  2111 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.877686  2111 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.879807  2112 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:43.891142  2085 raft_consensus.cc:493] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.891693  2085 raft_consensus.cc:515] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:43.893713  2085 leader_election.cc:290] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:43.916263 29787 leader_election.cc:336] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:43.934113  2111 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:43.936468  2111 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:43.941450 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ff39d14c4684dfb9f2d3f7ed0bd42ad" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:43.942143 30350 raft_consensus.cc:3060] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:12:43.947325  2103 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.947968  2103 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:43.954139 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:43.954797 29817 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 12.
I20260709 13:12:43.955955 30315 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:43.956808  2110 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:12:43.957192  2110 raft_consensus.cc:493] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.957552  2110 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.967742  2110 raft_consensus.cc:515] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:43.971103 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03ee62645904e089f0f2c4dffb22b40" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3"
I20260709 13:12:43.971704 29817 raft_consensus.cc:3060] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:12:43.971887  2112 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:43.972697  2112 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:43.975489  2112 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:43.976122  2103 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:43.991808 29817 raft_consensus.cc:2468] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 13.
W20260709 13:12:43.998817 29789 consensus_peers.cc:597] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:43.999557 29789 consensus_peers.cc:597] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:12:44.000013 29789 consensus_peers.cc:597] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:44.000116 30315 leader_election.cc:304] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:44.000367  2110 leader_election.cc:290] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:44.000595 29787 leader_election.cc:336] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.001003  2110 raft_consensus.cc:2804] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:12:44.001488  2110 raft_consensus.cc:697] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Becoming Leader. State: Replica: 121060c6c5b14502957b76fd1dfc7b2d, State: Running, Role: LEADER
W20260709 13:12:44.002851 30314 leader_election.cc:336] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.003824 30350 raft_consensus.cc:2468] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 9.
W20260709 13:12:44.011533 30314 leader_election.cc:336] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:44.013422 29787 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.002470  2110 consensus_queue.cc:237] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:44.014248 29789 leader_election.cc:336] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.014688 29789 leader_election.cc:304] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:44.015595 29789 leader_election.cc:336] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.016000 29789 leader_election.cc:304] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.016656  2112 raft_consensus.cc:2749] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:44.017478  2112 raft_consensus.cc:2749] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:44.019194 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:44.027424 29789 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3
I20260709 13:12:44.028604 29789 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 121060c6c5b14502957b76fd1dfc7b2d, 42c443079435463daa8845e244cec9d3
I20260709 13:12:44.029343  2085 raft_consensus.cc:2804] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:12:44.029774  2085 raft_consensus.cc:697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:44.030557  2085 consensus_queue.cc:237] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.033658  2111 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.042088  2112 raft_consensus.cc:493] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.042623  2112 raft_consensus.cc:515] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:44.046321  2112 leader_election.cc:290] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:44.058214  2071 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.058799  2071 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.061192  2071 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:44.060942 29568 catalog_manager.cc:5697] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 8 to 9, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 9 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:44.067786 30316 leader_election.cc:336] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:44.063061 29789 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.106419  2112 raft_consensus.cc:493] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.106968  2112 raft_consensus.cc:515] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:44.109416  2112 leader_election.cc:290] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:44.110162  2071 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.110728  2071 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:44.109815 29787 leader_election.cc:336] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.113476  2103 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.139262  2103 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.142851  2103 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:44.125623  2071 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:44.153412  2085 raft_consensus.cc:493] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.154009  2085 raft_consensus.cc:515] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:44.157195 29789 leader_election.cc:336] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.159051 29789 leader_election.cc:304] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:44.161813 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:34899, user_credentials={real_user=slave}} blocked reactor thread for 48734.7us
I20260709 13:12:44.163556 29817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f96ce2eb1d674d2faf1a6340807d4961" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:44.164186 29817 raft_consensus.cc:2468] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 121060c6c5b14502957b76fd1dfc7b2d in term 9.
I20260709 13:12:44.175292  2120 raft_consensus.cc:2749] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:44.174849 29571 catalog_manager.cc:5697] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d reported cstate change: term changed from 12 to 13, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68). New cstate: current_term: 13 leader_uuid: "121060c6c5b14502957b76fd1dfc7b2d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.177220  2085 leader_election.cc:290] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:44.196753 30316 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:44.200817 30316 leader_election.cc:336] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:44.202731 29789 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35503, user_credentials={real_user=slave}} blocked reactor thread for 45546.9us
W20260709 13:12:44.221027 29789 consensus_peers.cc:597] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:44.222574  2121 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.223173  2121 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.225389  2121 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:44.228701 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:44.229420  2112 raft_consensus.cc:493] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.230010  2112 raft_consensus.cc:515] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:44.234437 30314 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.234833  2112 leader_election.cc:290] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:44.236443  2118 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
W20260709 13:12:44.238236 29787 leader_election.cc:336] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.238080  2118 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.241366  2118 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:44.241909  2118 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.242045 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
I20260709 13:12:44.243291  2125 raft_consensus.cc:493] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.242412  2118 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.243820  2125 raft_consensus.cc:515] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:44.246035  2125 leader_election.cc:290] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:44.247475  2118 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:44.247676 29818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "121060c6c5b14502957b76fd1dfc7b2d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "389c080a49494f8fb56c53fa7e6087f3" is_pre_election: true
W20260709 13:12:44.247982 29789 leader_election.cc:336] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.248404 29789 leader_election.cc:304] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.249109 30314 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.250152  2125 raft_consensus.cc:2749] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:44.251011 30314 leader_election.cc:336] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:44.251121 29789 consensus_peers.cc:597] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:44.251719  2121 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:44.251502 30314 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:44.255076 29787 leader_election.cc:336] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:44.257895 29787 leader_election.cc:336] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.262276  2125 raft_consensus.cc:493] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.262884  2125 raft_consensus.cc:515] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
W20260709 13:12:44.263427 29789 leader_election.cc:336] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.263897 29789 leader_election.cc:304] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.264942  2125 leader_election.cc:290] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:44.265206 29787 leader_election.cc:336] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.265595  2125 raft_consensus.cc:2749] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:44.264886 29789 leader_election.cc:336] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.267009 29789 leader_election.cc:304] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.268580  2125 raft_consensus.cc:2749] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:12:44.271975 29787 leader_election.cc:336] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.273566  2121 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:44.253850 30314 leader_election.cc:336] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.275427 30314 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
W20260709 13:12:44.278877 29789 leader_election.cc:336] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.279429 29789 leader_election.cc:304] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.280251  2125 raft_consensus.cc:2749] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:12:44.283836  2118 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:44.284246 29789 leader_election.cc:336] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.284742  2118 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.285279  2118 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.286619 29789 leader_election.cc:304] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.287357  2125 raft_consensus.cc:2749] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:44.290097  2118 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:44.295385 30316 leader_election.cc:336] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:44.297816 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
W20260709 13:12:44.311333 30314 leader_election.cc:336] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.316532 30314 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:44.317705  2121 raft_consensus.cc:2749] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:44.319048 30314 leader_election.cc:336] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.319617 30314 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:44.320602  2121 raft_consensus.cc:2749] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:44.322010 30314 leader_election.cc:336] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.322471 30314 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:44.323187  2121 raft_consensus.cc:2749] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:12:44.328269 30314 leader_election.cc:336] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.328773 30314 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.329599  2121 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:44.349623  2125 raft_consensus.cc:493] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.350342  2125 raft_consensus.cc:515] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } }
I20260709 13:12:44.359396  2125 leader_election.cc:290] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:44.361515 29789 leader_election.cc:336] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:44.363397 29787 leader_election.cc:336] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.363893 29787 leader_election.cc:304] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 389c080a49494f8fb56c53fa7e6087f3; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:44.365321  2125 raft_consensus.cc:2749] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:44.425504  2125 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.426296  2125 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.429554  2112 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.430173 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:44.430236  2112 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.430948 30350 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 10.
I20260709 13:12:44.432775  2112 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:44.434543 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:44.435254 30350 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 17.
I20260709 13:12:44.435302 29789 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:44.437487 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:44.438460  2085 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:12:44.438742  2124 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:12:44.438855  2085 raft_consensus.cc:493] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.439353  2085 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:44.439278  2124 raft_consensus.cc:493] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.439898  2124 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:44.442698  2125 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:44.443785  2125 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.449649 29818 raft_consensus.cc:1275] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Refusing update from remote peer 121060c6c5b14502957b76fd1dfc7b2d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:12:44.453034  2118 consensus_queue.cc:1048] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:12:44.455513 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
I20260709 13:12:44.460872  2085 raft_consensus.cc:515] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:44.463903 30315 consensus_peers.cc:597] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.472494  2085 leader_election.cc:290] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:44.444430  2125 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.482467 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57815098d70a4f2bb7a308d71da6ef9a" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:44.483099 30346 raft_consensus.cc:3060] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:12:44.486557  2125 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
W20260709 13:12:44.489866 29789 consensus_peers.cc:597] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:12:44.494993 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d" is_pre_election: true
I20260709 13:12:44.495683 30350 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 13.
I20260709 13:12:44.494855  2124 raft_consensus.cc:515] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.497524 30346 raft_consensus.cc:2468] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 11.
I20260709 13:12:44.500340 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:44.504105  2112 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:12:44.504575  2112 raft_consensus.cc:493] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:44.504324 29789 leader_election.cc:304] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:44.504987  2112 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.505622  2120 raft_consensus.cc:2804] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:12:44.506207  2120 raft_consensus.cc:697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:44.504717  2124 leader_election.cc:290] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:44.507130  2120 consensus_queue.cc:237] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.514540  2112 raft_consensus.cc:515] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:44.515569 30316 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:44.516722  2112 leader_election.cc:290] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Requested vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 121060c6c5b14502957b76fd1dfc7b2d (127.27.229.68:42165)
I20260709 13:12:44.520704 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7943a6965d54826a2eee391b1459b90" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:44.521093 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba8307a3fdc4b40993f8208111c67f1" candidate_uuid: "389c080a49494f8fb56c53fa7e6087f3" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "121060c6c5b14502957b76fd1dfc7b2d"
I20260709 13:12:44.521639 30350 raft_consensus.cc:3060] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:12:44.521806 30346 raft_consensus.cc:3060] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:12:44.528427 30346 raft_consensus.cc:2468] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 18.
I20260709 13:12:44.528983 30350 raft_consensus.cc:2468] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 389c080a49494f8fb56c53fa7e6087f3 in term 14.
W20260709 13:12:44.534459 30315 consensus_peers.cc:597] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.544979 29789 leader_election.cc:304] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:44.545878  2120 raft_consensus.cc:2804] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:12:44.546412  2120 raft_consensus.cc:697] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 18 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
I20260709 13:12:44.547374  2120 consensus_queue.cc:237] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:44.548138 29789 leader_election.cc:304] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d, 389c080a49494f8fb56c53fa7e6087f3; no voters: 
I20260709 13:12:44.552635  2125 raft_consensus.cc:2804] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:12:44.553135  2125 raft_consensus.cc:697] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: Becoming Leader. State: Replica: 389c080a49494f8fb56c53fa7e6087f3, State: Running, Role: LEADER
W20260709 13:12:44.555395 30315 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.554009  2125 consensus_queue.cc:237] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:44.565055 30314 consensus_peers.cc:597] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.575654 29568 catalog_manager.cc:5697] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 reported cstate change: term changed from 10 to 11, leader changed from 42c443079435463daa8845e244cec9d3 (127.27.229.66) to 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67). New cstate: current_term: 11 leader_uuid: "389c080a49494f8fb56c53fa7e6087f3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:44.582129 30314 consensus_peers.cc:597] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:44.590389 29787 leader_election.cc:336] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:44.592648 30316 consensus_peers.cc:597] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:44.596755 29787 leader_election.cc:336] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:44.602653 30316 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:12:44.605149 30315 consensus_peers.cc:597] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:44.613870 30315 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:44.611443 29787 leader_election.cc:336] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:44.628022 29789 consensus_peers.cc:597] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:12:44.636926 30350 raft_consensus.cc:1275] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Refusing update from remote peer 389c080a49494f8fb56c53fa7e6087f3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:12:44.638163 29787 leader_election.cc:336] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.638729  2130 consensus_queue.cc:1048] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:12:44.639262 29787 leader_election.cc:336] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:44.640846 29787 leader_election.cc:336] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:44.649049 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:44.652045 28565 tablet_replica.cc:333] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.653048 28565 raft_consensus.cc:2243] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.654187 28565 raft_consensus.cc:2272] T a40195a1eb8d422f8e2cec6f836a23ee P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.657198 28565 tablet_replica.cc:333] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
W20260709 13:12:44.658164 30316 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:44.661959 30314 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:44.673009 29787 consensus_peers.cc:597] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.680787 28565 raft_consensus.cc:2243] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Raft consensus shutting down.
W20260709 13:12:44.685339 30316 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:44.686229 30314 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:44.688450 30315 consensus_peers.cc:597] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.688935 28565 raft_consensus.cc:2272] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.699810 30315 consensus_peers.cc:597] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.703188 28565 tablet_replica.cc:333] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.704257 28565 raft_consensus.cc:2243] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.705456 28565 raft_consensus.cc:2272] T c538253e68554f7b82c0f993198e47d3 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.708284 28565 tablet_replica.cc:333] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.709082 28565 raft_consensus.cc:2243] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.710141 28565 raft_consensus.cc:2272] T 950ba8523bd4460bb0db3a8ae291f1ca P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.712891 28565 tablet_replica.cc:333] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.713737 28565 raft_consensus.cc:2243] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.714742 28565 raft_consensus.cc:2272] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.717474 28565 tablet_replica.cc:333] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.718364 28565 raft_consensus.cc:2243] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.719529 28565 raft_consensus.cc:2272] T 27ef48e8ba554972a5c426adeff23599 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.721766 28565 tablet_replica.cc:333] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.722466 28565 raft_consensus.cc:2243] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.723067 28565 raft_consensus.cc:2272] T 1638cc6362e14d898e868b6d6927b9c1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.725194 28565 tablet_replica.cc:333] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.725792 28565 raft_consensus.cc:2243] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.726636 28565 raft_consensus.cc:2272] T 0f1f4e71b89146369180189f4402f3db P 389c080a49494f8fb56c53fa7e6087f3 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.728838 28565 tablet_replica.cc:333] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.729491 28565 raft_consensus.cc:2243] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.730365 28565 raft_consensus.cc:2272] T 69d6f3febc834e4aa68fd4b032f83332 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.732355 28565 tablet_replica.cc:333] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.732969 28565 raft_consensus.cc:2243] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.733557 28565 raft_consensus.cc:2272] T fc29718e51d549e395e72e7bff383425 P 389c080a49494f8fb56c53fa7e6087f3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.736150 28565 tablet_replica.cc:333] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.736923 28565 raft_consensus.cc:2243] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.738068 28565 raft_consensus.cc:2272] T c996471e869b4dc78487f6b92d7bb586 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.739706 30315 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.744433 28565 tablet_replica.cc:333] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.745424 28565 raft_consensus.cc:2243] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.746304 28565 raft_consensus.cc:2272] T b03ee62645904e089f0f2c4dffb22b40 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.749375 28565 tablet_replica.cc:333] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.750138 28565 raft_consensus.cc:2243] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.750711 28565 raft_consensus.cc:2272] T 69b5d0bcdd3a4027b3e5abda839ab825 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.753255 28565 tablet_replica.cc:333] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.754125 28565 raft_consensus.cc:2243] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.755255 28565 raft_consensus.cc:2272] T 3147da791a394c9da4f7b521dd52a560 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.756165 30315 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.757896 28565 tablet_replica.cc:333] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.758777 28565 raft_consensus.cc:2243] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.759907 28565 raft_consensus.cc:2272] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.762535 28565 tablet_replica.cc:333] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.763294 28565 raft_consensus.cc:2243] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.764370 28565 raft_consensus.cc:2272] T a191ecb8137c4add8a89d6a240470f6b P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.764990 30315 consensus_peers.cc:597] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.767280 28565 tablet_replica.cc:333] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.768146 28565 raft_consensus.cc:2243] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.769001 28565 raft_consensus.cc:2272] T f96ce2eb1d674d2faf1a6340807d4961 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.771636 28565 tablet_replica.cc:333] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.772452 28565 raft_consensus.cc:2243] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.773329 28565 raft_consensus.cc:2272] T abb12790de164e0a8286849b02b1dc26 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.775578 28565 tablet_replica.cc:333] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.776146 28565 raft_consensus.cc:2243] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.776659 28565 raft_consensus.cc:2272] T 11a95760a1b04359956b38a1861eeca2 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.779330 28565 tablet_replica.cc:333] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.780062 28565 raft_consensus.cc:2243] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.780722 28565 raft_consensus.cc:2272] T 2c09d4b0feb04ea0b3d0bf11a0fd4094 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.783387 28565 tablet_replica.cc:333] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.784171 28565 raft_consensus.cc:2243] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.785684 28565 raft_consensus.cc:2272] T b5bb27f7a1364209b951570c1c03f996 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.788560 28565 tablet_replica.cc:333] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.789388 28565 raft_consensus.cc:2243] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.790027 28565 raft_consensus.cc:2272] T 4abf8e3126194219b6a68c724a22f711 P 389c080a49494f8fb56c53fa7e6087f3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.792784 28565 tablet_replica.cc:333] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.793557 28565 raft_consensus.cc:2243] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.794226 28565 raft_consensus.cc:2272] T 44b63ddac1a74c0c852d0c1d433ae7c4 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.797063 28565 tablet_replica.cc:333] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.797845 28565 raft_consensus.cc:2243] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.798532 28565 raft_consensus.cc:2272] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.801079 28565 tablet_replica.cc:333] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.801805 28565 raft_consensus.cc:2243] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.802884 28565 raft_consensus.cc:2272] T 15438e4033d048dfa9c154db86242bc3 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.805540 28565 tablet_replica.cc:333] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.806332 28565 raft_consensus.cc:2243] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.806911 28565 raft_consensus.cc:2272] T 7df971e435c648008d74c7352ccea2d9 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.809226 28565 tablet_replica.cc:333] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.809805 28565 raft_consensus.cc:2243] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.810346 28565 raft_consensus.cc:2272] T 63d505aa7c824fe884968612bdceec56 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.812469 28565 tablet_replica.cc:333] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.813024 28565 raft_consensus.cc:2243] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.813902 28565 raft_consensus.cc:2272] T a9aef678cd634050a9cbee4fe1f83abc P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.815964 28565 tablet_replica.cc:333] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.816516 28565 raft_consensus.cc:2243] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.817009 28565 raft_consensus.cc:2272] T 5cafd7309bc64f839076e213c80b391c P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.818964 28565 tablet_replica.cc:333] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.819522 28565 raft_consensus.cc:2243] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.819993 28565 raft_consensus.cc:2272] T 247648c6c3c549fcb98f79d8df339536 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.821879 28565 tablet_replica.cc:333] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.822438 28565 raft_consensus.cc:2243] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.822959 28565 raft_consensus.cc:2272] T 5444d738efbb44128f4f34da83448b15 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.824977 28565 tablet_replica.cc:333] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.825512 28565 raft_consensus.cc:2243] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.826472 28565 raft_consensus.cc:2272] T 1689d69ba5ba4e52b2fc43a53054f310 P 389c080a49494f8fb56c53fa7e6087f3 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.828545 28565 tablet_replica.cc:333] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.829087 28565 raft_consensus.cc:2243] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.829618 28565 raft_consensus.cc:2272] T f6262c59cea24959ab0dd23d4279895c P 389c080a49494f8fb56c53fa7e6087f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.831620 28565 tablet_replica.cc:333] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.832113 28565 raft_consensus.cc:2243] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.833060 28565 pending_rounds.cc:70] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Trying to abort 1 pending ops.
I20260709 13:12:44.833246 28565 pending_rounds.cc:77] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3: Aborting op as it isn't in flight: id { term: 11 index: 11 } timestamp: 7305636923445301248 op_type: NO_OP noop_request { }
I20260709 13:12:44.833565 28565 raft_consensus.cc:2889] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:44.833871 28565 raft_consensus.cc:2272] T 57815098d70a4f2bb7a308d71da6ef9a P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.836215 28565 tablet_replica.cc:333] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.836803 28565 raft_consensus.cc:2243] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.837651 28565 raft_consensus.cc:2272] T 955eae6c53474f8a9c1673dbd294937e P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.840332 28565 tablet_replica.cc:333] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.841084 28565 raft_consensus.cc:2243] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.842360 28565 pending_rounds.cc:70] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Trying to abort 1 pending ops.
I20260709 13:12:44.842609 28565 pending_rounds.cc:77] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305636923641688064 op_type: NO_OP noop_request { }
I20260709 13:12:44.842931 28565 raft_consensus.cc:2889] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:44.843243 28565 raft_consensus.cc:2272] T fba8307a3fdc4b40993f8208111c67f1 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.846053 28565 tablet_replica.cc:333] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.846840 28565 raft_consensus.cc:2243] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.847489 28565 raft_consensus.cc:2272] T f35983a3f0f340da8a2b9daae61af306 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.849153 30316 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:44.850087 28565 tablet_replica.cc:333] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.850718 28565 raft_consensus.cc:2243] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.851749 28565 raft_consensus.cc:2272] T 924dd112e90f41f492fd016c204c1a21 P 389c080a49494f8fb56c53fa7e6087f3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.854359 28565 tablet_replica.cc:333] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.855080 28565 raft_consensus.cc:2243] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.856534 28565 raft_consensus.cc:2272] T 307badafd0e64a4c87993caa003f0e2a P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.859148 28565 tablet_replica.cc:333] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.859833 28565 raft_consensus.cc:2243] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.860836 28565 raft_consensus.cc:2272] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.863273 28565 tablet_replica.cc:333] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
W20260709 13:12:44.863271 30315 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.864272 28565 raft_consensus.cc:2243] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.865242 28565 raft_consensus.cc:2272] T dff620b2062c4139940ec520664442a1 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.867362 28565 tablet_replica.cc:333] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.867941 28565 raft_consensus.cc:2243] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.868434 28565 raft_consensus.cc:2272] T 43661428e7964263870fe7a8e07bf265 P 389c080a49494f8fb56c53fa7e6087f3 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.870829 28565 tablet_replica.cc:333] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.871459 28565 raft_consensus.cc:2243] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.872387 28565 raft_consensus.cc:2272] T e0af93d90eed4483befb4778a68e7b7c P 389c080a49494f8fb56c53fa7e6087f3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.875020 28565 tablet_replica.cc:333] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.875597 28565 raft_consensus.cc:2243] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.876047 28565 raft_consensus.cc:2272] T 8c959a6f0c6345c9b312b54d4090ba28 P 389c080a49494f8fb56c53fa7e6087f3 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.877997 28565 tablet_replica.cc:333] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.878577 28565 raft_consensus.cc:2243] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.879252 28565 pending_rounds.cc:70] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Trying to abort 1 pending ops.
I20260709 13:12:44.879462 28565 pending_rounds.cc:77] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3: Aborting op as it isn't in flight: id { term: 18 index: 14 } timestamp: 7305636923608494080 op_type: NO_OP noop_request { }
I20260709 13:12:44.879725 28565 raft_consensus.cc:2889] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 18 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:44.880019 28565 raft_consensus.cc:2272] T d7943a6965d54826a2eee391b1459b90 P 389c080a49494f8fb56c53fa7e6087f3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.882792 28565 tablet_replica.cc:333] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
I20260709 13:12:44.883467 28565 raft_consensus.cc:2243] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.884168 28565 raft_consensus.cc:2272] T 0801ed5c1b69497e8182bfe2461cdbf3 P 389c080a49494f8fb56c53fa7e6087f3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.886718 28565 tablet_replica.cc:333] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3: stopping tablet replica
W20260709 13:12:44.886554 30315 consensus_peers.cc:597] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.887348 28565 raft_consensus.cc:2243] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.888605 28565 raft_consensus.cc:2272] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 389c080a49494f8fb56c53fa7e6087f3 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.921834 30314 consensus_peers.cc:597] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:44.960721 30315 consensus_peers.cc:597] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Couldn't send request to peer 389c080a49494f8fb56c53fa7e6087f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:44.982817 30314 consensus_peers.cc:597] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.012095 30314 consensus_peers.cc:597] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.034054 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57815098d70a4f2bb7a308d71da6ef9a: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:45.070456 30314 consensus_peers.cc:597] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.144310 30314 consensus_peers.cc:597] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.162755 30316 consensus_peers.cc:597] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:45.184463 30316 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:45.191792 30314 consensus_peers.cc:597] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.227111 30314 consensus_peers.cc:597] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.273087 30314 consensus_peers.cc:597] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Couldn't send request to peer 42c443079435463daa8845e244cec9d3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:45.484020 30316 consensus_peers.cc:597] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:45.493603  2121 raft_consensus.cc:493] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:45.494213  2121 raft_consensus.cc:515] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:45.496434  2121 leader_election.cc:290] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:45.529366 30314 leader_election.cc:336] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:45.531095 30316 leader_election.cc:336] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:45.531551 30316 leader_election.cc:304] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:45.532903  2121 raft_consensus.cc:2749] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:45.656118 30316 consensus_peers.cc:597] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:12:45.752388  2139 raft_consensus.cc:493] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:45.753106  2139 raft_consensus.cc:515] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:45.755496  2139 leader_election.cc:290] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:45.761103 30314 leader_election.cc:336] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:45.765595  2138 raft_consensus.cc:493] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:45.766274  2138 raft_consensus.cc:515] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:45.768550  2138 leader_election.cc:290] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:45.777731 30315 leader_election.cc:336] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
W20260709 13:12:45.800704 30316 leader_election.cc:336] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:45.806162 30316 leader_election.cc:304] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:45.808025  2139 raft_consensus.cc:2749] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:12:45.811681  2139 raft_consensus.cc:493] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:45.816349  2139 raft_consensus.cc:515] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:45.828697  2139 leader_election.cc:290] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:45.834753 30316 leader_election.cc:336] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:45.835986 30316 leader_election.cc:304] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:45.841274  2139 raft_consensus.cc:2749] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:45.843433 30314 leader_election.cc:336] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:45.844491 30316 leader_election.cc:336] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:45.844995 30316 leader_election.cc:304] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:45.846434  2139 raft_consensus.cc:2749] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:45.887243 30316 consensus_peers.cc:597] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:12:45.906289  2139 raft_consensus.cc:493] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:45.907160  2139 raft_consensus.cc:515] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:45.921593  2139 leader_election.cc:290] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:45.930794 30314 leader_election.cc:336] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
W20260709 13:12:45.933387 30315 leader_election.cc:336] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:45.934041 30315 leader_election.cc:304] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:45.935506  2138 raft_consensus.cc:2749] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:12:45.970775  2139 raft_consensus.cc:493] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:45.971421  2139 raft_consensus.cc:515] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:45.975346  2139 leader_election.cc:290] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:45.977293 30316 consensus_peers.cc:597] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:12:45.985556 30314 leader_election.cc:336] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:45.985112  2139 raft_consensus.cc:493] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:45.989312  2138 raft_consensus.cc:493] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:45.989892  2138 raft_consensus.cc:515] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:45.992137  2138 leader_election.cc:290] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:45.987000  2139 raft_consensus.cc:515] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:45.999661 30315 leader_election.cc:336] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
W20260709 13:12:46.003245 30316 leader_election.cc:336] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:46.003970 30316 leader_election.cc:304] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.004793  2138 raft_consensus.cc:2749] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:12:46.017733  2139 leader_election.cc:290] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:46.025020 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
W20260709 13:12:46.030864 30314 leader_election.cc:336] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.035785 30314 leader_election.cc:304] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:46.037554  2139 raft_consensus.cc:2749] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:46.035247 30316 leader_election.cc:336] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:46.039032  2139 raft_consensus.cc:493] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:46.039628  2139 raft_consensus.cc:515] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:46.040565 30315 leader_election.cc:336] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.044134 30315 leader_election.cc:304] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.049458  2118 raft_consensus.cc:2749] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:46.055286 30316 leader_election.cc:336] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:46.043179  2139 leader_election.cc:290] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
W20260709 13:12:46.070084 30314 leader_election.cc:336] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.070459  2140 raft_consensus.cc:493] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.074836  2139 raft_consensus.cc:493] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.074759  2140 raft_consensus.cc:515] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:46.075435  2139 raft_consensus.cc:515] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:46.077788  2138 raft_consensus.cc:493] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.078373  2138 raft_consensus.cc:515] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:46.079087  2139 leader_election.cc:290] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.076647 30314 leader_election.cc:336] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.079743 30314 leader_election.cc:304] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.080668  2138 leader_election.cc:290] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:46.083282  2139 raft_consensus.cc:2749] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:12:46.088569 30316 leader_election.cc:336] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:46.088837  2121 raft_consensus.cc:493] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.090078  2118 raft_consensus.cc:493] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.090646  2118 raft_consensus.cc:515] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:46.093137  2118 leader_election.cc:290] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
I20260709 13:12:46.094482  2139 raft_consensus.cc:493] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.095039  2139 raft_consensus.cc:515] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:46.097509 30316 leader_election.cc:336] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:46.089466  2121 raft_consensus.cc:515] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:46.101346 30315 leader_election.cc:336] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.101840 30315 leader_election.cc:304] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.102418  2121 leader_election.cc:290] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.102785 30315 leader_election.cc:336] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.103108  2138 raft_consensus.cc:2749] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:12:46.097352  2139 leader_election.cc:290] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.108235 30315 leader_election.cc:336] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.108765 30315 leader_election.cc:304] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.109524  2121 raft_consensus.cc:2749] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:12:46.108120  2140 leader_election.cc:290] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.122105 30316 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:46.124995 30314 leader_election.cc:336] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.125553 30314 leader_election.cc:304] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:46.126368  2140 raft_consensus.cc:2749] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:12:46.109669 30315 leader_election.cc:336] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
W20260709 13:12:46.136435 30315 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.136883 30315 leader_election.cc:304] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.137725  2140 raft_consensus.cc:2749] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:12:46.138324 30316 leader_election.cc:336] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:46.139693 30314 leader_election.cc:336] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.142096 30314 leader_election.cc:304] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:46.142931  2140 raft_consensus.cc:2749] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:46.145637 30315 leader_election.cc:336] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.154284 30315 leader_election.cc:304] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.155119  2140 raft_consensus.cc:2749] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:46.162549 30314 leader_election.cc:336] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.195588  2140 raft_consensus.cc:493] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.196131  2140 raft_consensus.cc:515] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:46.203341 30314 leader_election.cc:336] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.212702  2140 leader_election.cc:290] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.217856 30315 leader_election.cc:336] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.218384 30315 leader_election.cc:304] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, 42c443079435463daa8845e244cec9d3
I20260709 13:12:46.219599  2140 raft_consensus.cc:2749] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:12:46.262573  2140 raft_consensus.cc:493] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.263280  2140 raft_consensus.cc:515] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:46.267804  2121 raft_consensus.cc:493] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:46.268458  2121 raft_consensus.cc:515] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } attrs { replace: true } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:46.271328  2121 leader_election.cc:290] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.272590 30316 leader_election.cc:336] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:46.275512  2121 raft_consensus.cc:493] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 42c443079435463daa8845e244cec9d3)
I20260709 13:12:46.276135  2121 raft_consensus.cc:515] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
W20260709 13:12:46.278419 30316 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:46.278916  2121 leader_election.cc:290] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333)
I20260709 13:12:46.267765  2140 leader_election.cc:290] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.291354 30314 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.299329 30314 leader_election.cc:304] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.304687  2140 raft_consensus.cc:2749] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:12:46.303689 30316 leader_election.cc:336] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:46.308041 30315 leader_election.cc:336] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.313154 30315 leader_election.cc:304] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.317046  2140 raft_consensus.cc:2749] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:12:46.314306 30314 leader_election.cc:336] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.316381 28565 tablet_server.cc:179] TabletServer@127.27.229.68:0 shutting down...
W20260709 13:12:46.318851 30315 leader_election.cc:336] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.318219 30314 leader_election.cc:304] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 42c443079435463daa8845e244cec9d3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.320531  2140 raft_consensus.cc:2749] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:12:46.342168  2140 raft_consensus.cc:493] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 389c080a49494f8fb56c53fa7e6087f3)
I20260709 13:12:46.342830  2140 raft_consensus.cc:515] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a9d8198d0b954886af452e89a8029614" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35503 } } peers { permanent_uuid: "42c443079435463daa8845e244cec9d3" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 46333 } attrs { replace: true } } peers { permanent_uuid: "389c080a49494f8fb56c53fa7e6087f3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 34899 } } peers { permanent_uuid: "121060c6c5b14502957b76fd1dfc7b2d" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 42165 } attrs { promote: false } }
I20260709 13:12:46.352313  2140 leader_election.cc:290] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503), 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333), 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899)
W20260709 13:12:46.353413 30316 leader_election.cc:336] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:46.355527 30315 leader_election.cc:336] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 389c080a49494f8fb56c53fa7e6087f3 (127.27.229.67:34899): Network error: Client connection negotiation failed: client connection to 127.27.229.67:34899: connect: Connection refused (error 111)
I20260709 13:12:46.356174 30315 leader_election.cc:304] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 121060c6c5b14502957b76fd1dfc7b2d; no voters: 389c080a49494f8fb56c53fa7e6087f3, a9d8198d0b954886af452e89a8029614
I20260709 13:12:46.357414  2140 raft_consensus.cc:2749] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:12:46.371598 30314 leader_election.cc:336] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 42c443079435463daa8845e244cec9d3 (127.27.229.66:46333): Network error: Client connection negotiation failed: client connection to 127.27.229.66:46333: connect: Connection refused (error 111)
I20260709 13:12:46.381141 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:46.382314 28565 tablet_replica.cc:333] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.383338 28565 raft_consensus.cc:2243] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.384110 28565 raft_consensus.cc:2272] T 7fb4a6fd13164dbcbc05c397d0b009b5 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.387317 28565 tablet_replica.cc:333] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.388264 28565 raft_consensus.cc:2243] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.389807 28565 raft_consensus.cc:2272] T 0801ed5c1b69497e8182bfe2461cdbf3 P 121060c6c5b14502957b76fd1dfc7b2d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.398702 28565 tablet_replica.cc:333] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.399652 28565 raft_consensus.cc:2243] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.400838 28565 raft_consensus.cc:2272] T f35983a3f0f340da8a2b9daae61af306 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.405373 28565 tablet_replica.cc:333] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.406293 28565 raft_consensus.cc:2243] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.406970 28565 raft_consensus.cc:2272] T 4dc2bf2df3534ed4bb09dedb2cec3002 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.409971 28565 tablet_replica.cc:333] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.411054 28565 raft_consensus.cc:2243] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.412506 28565 raft_consensus.cc:2272] T b85eaa84d2104a8aa1d25054d069fd33 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.415289 28565 tablet_replica.cc:333] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.415948 28565 raft_consensus.cc:2243] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.416474 28565 raft_consensus.cc:2272] T 3147da791a394c9da4f7b521dd52a560 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.419117 28565 tablet_replica.cc:333] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.419844 28565 raft_consensus.cc:2243] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.420526 28565 raft_consensus.cc:2272] T 27ef48e8ba554972a5c426adeff23599 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.423152 28565 tablet_replica.cc:333] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.424916 28565 raft_consensus.cc:2243] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.426128 28565 raft_consensus.cc:2272] T 11a95760a1b04359956b38a1861eeca2 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.429056 28565 tablet_replica.cc:333] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
W20260709 13:12:46.429462 30316 consensus_peers.cc:597] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d -> Peer a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): Couldn't send request to peer a9d8198d0b954886af452e89a8029614. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:12:46.429875 28565 raft_consensus.cc:2243] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.431109 28565 raft_consensus.cc:2272] T fc891e1e674747fda6007601f64c4341 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.435279 28565 tablet_replica.cc:333] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.436167 28565 raft_consensus.cc:2243] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.438406 28565 pending_rounds.cc:70] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Trying to abort 1 pending ops.
I20260709 13:12:46.438704 28565 pending_rounds.cc:77] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d: Aborting op as it isn't in flight: id { term: 13 index: 12 } timestamp: 7305636921539059712 op_type: NO_OP noop_request { }
I20260709 13:12:46.439090 28565 raft_consensus.cc:2889] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:46.439448 28565 raft_consensus.cc:2272] T b03ee62645904e089f0f2c4dffb22b40 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.442443 28565 tablet_replica.cc:333] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.443305 28565 raft_consensus.cc:2243] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.444008 28565 raft_consensus.cc:2272] T b5bb27f7a1364209b951570c1c03f996 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.448323 28565 tablet_replica.cc:333] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.450344 28565 raft_consensus.cc:2243] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.451458 28565 raft_consensus.cc:2272] T fc29718e51d549e395e72e7bff383425 P 121060c6c5b14502957b76fd1dfc7b2d [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.454619 28565 tablet_replica.cc:333] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.455530 28565 raft_consensus.cc:2243] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.456439 28565 raft_consensus.cc:2272] T 0dba966d409c4e37bce58c7db358ebbb P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.459393 28565 tablet_replica.cc:333] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.460093 28565 raft_consensus.cc:2243] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.461030 28565 raft_consensus.cc:2272] T c5fd36b246f24922bf4e9f9658c19013 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.463855 28565 tablet_replica.cc:333] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.464632 28565 raft_consensus.cc:2243] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.465371 28565 raft_consensus.cc:2272] T 1cc4f503726e4efd8620c27deea0b183 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.468393 28565 tablet_replica.cc:333] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.469192 28565 raft_consensus.cc:2243] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.470386 28565 raft_consensus.cc:2272] T 8c959a6f0c6345c9b312b54d4090ba28 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.473174 28565 tablet_replica.cc:333] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.474045 28565 raft_consensus.cc:2243] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.475198 28565 raft_consensus.cc:2272] T dff620b2062c4139940ec520664442a1 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.477523 28565 tablet_replica.cc:333] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.478204 28565 raft_consensus.cc:2243] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.478757 28565 raft_consensus.cc:2272] T f96ce2eb1d674d2faf1a6340807d4961 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.481293 28565 tablet_replica.cc:333] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.481987 28565 raft_consensus.cc:2243] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.482692 28565 raft_consensus.cc:2272] T f0d5a34ce22a44e2a4882baa5443f81e P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.484998 28565 tablet_replica.cc:333] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.485644 28565 raft_consensus.cc:2243] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.486208 28565 raft_consensus.cc:2272] T 7b3e1085d9ad4120b3284dbd3939b5e4 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.488550 28565 tablet_replica.cc:333] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.489315 28565 raft_consensus.cc:2243] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.490368 28565 raft_consensus.cc:2272] T 247648c6c3c549fcb98f79d8df339536 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:46.491766 30316 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111) [suppressed 584 similar messages]
I20260709 13:12:46.493283 28565 tablet_replica.cc:333] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.494263 28565 raft_consensus.cc:2243] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.494813 28565 raft_consensus.cc:2272] T 3ff39d14c4684dfb9f2d3f7ed0bd42ad P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.497488 28565 tablet_replica.cc:333] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.498148 28565 raft_consensus.cc:2243] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.499056 28565 raft_consensus.cc:2272] T f6262c59cea24959ab0dd23d4279895c P 121060c6c5b14502957b76fd1dfc7b2d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.501425 28565 tablet_replica.cc:333] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.502103 28565 raft_consensus.cc:2243] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.502620 28565 raft_consensus.cc:2272] T e0f895f1660a4065920da71ac5df9433 P 121060c6c5b14502957b76fd1dfc7b2d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.504801 28565 tablet_replica.cc:333] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.505481 28565 raft_consensus.cc:2243] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.506157 28565 raft_consensus.cc:2272] T aa5a096f6b164ab5849280a34b19d3b7 P 121060c6c5b14502957b76fd1dfc7b2d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.508936 28565 tablet_replica.cc:333] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.509560 28565 raft_consensus.cc:2243] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.510697 28565 raft_consensus.cc:2272] T 81b2426a3eab4a3993fe9c9a5eb04e3d P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.513020 28565 tablet_replica.cc:333] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.513607 28565 raft_consensus.cc:2243] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.514489 28565 raft_consensus.cc:2272] T fb08df13591747d7bf91993e76665808 P 121060c6c5b14502957b76fd1dfc7b2d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.517604 28565 tablet_replica.cc:333] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.518347 28565 raft_consensus.cc:2243] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.519059 28565 raft_consensus.cc:2272] T 57815098d70a4f2bb7a308d71da6ef9a P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.521425 28565 tablet_replica.cc:333] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.522039 28565 raft_consensus.cc:2243] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.522568 28565 raft_consensus.cc:2272] T 955eae6c53474f8a9c1673dbd294937e P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.524732 28565 tablet_replica.cc:333] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.525352 28565 raft_consensus.cc:2243] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.525998 28565 raft_consensus.cc:2272] T fba8307a3fdc4b40993f8208111c67f1 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.528457 28565 tablet_replica.cc:333] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.529047 28565 raft_consensus.cc:2243] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.530001 28565 raft_consensus.cc:2272] T 0f1f4e71b89146369180189f4402f3db P 121060c6c5b14502957b76fd1dfc7b2d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.532135 28565 tablet_replica.cc:333] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.532804 28565 raft_consensus.cc:2243] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.533356 28565 raft_consensus.cc:2272] T 924dd112e90f41f492fd016c204c1a21 P 121060c6c5b14502957b76fd1dfc7b2d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.535876 28565 tablet_replica.cc:333] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.536456 28565 raft_consensus.cc:2243] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.537026 28565 raft_consensus.cc:2272] T c996471e869b4dc78487f6b92d7bb586 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.539203 28565 tablet_replica.cc:333] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.539829 28565 raft_consensus.cc:2243] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.540668 28565 raft_consensus.cc:2272] T 43661428e7964263870fe7a8e07bf265 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.543211 28565 tablet_replica.cc:333] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.543888 28565 raft_consensus.cc:2243] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.544764 28565 raft_consensus.cc:2272] T 4d5d5d9cc0034eee95e6e5d81dfcaeeb P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.547039 28565 tablet_replica.cc:333] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.547642 28565 raft_consensus.cc:2243] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.548213 28565 raft_consensus.cc:2272] T 950ba8523bd4460bb0db3a8ae291f1ca P 121060c6c5b14502957b76fd1dfc7b2d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.550540 28565 tablet_replica.cc:333] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.551090 28565 raft_consensus.cc:2243] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.551630 28565 raft_consensus.cc:2272] T d7943a6965d54826a2eee391b1459b90 P 121060c6c5b14502957b76fd1dfc7b2d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.553907 28565 tablet_replica.cc:333] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.554509 28565 raft_consensus.cc:2243] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.555473 28565 raft_consensus.cc:2272] T 1f520c8b2a9e4af1a8676180d2dd96f4 P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.557785 28565 tablet_replica.cc:333] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.558355 28565 raft_consensus.cc:2243] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.558915 28565 raft_consensus.cc:2272] T 222c2ac209fd4c24a1f636fff5c13739 P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.561105 28565 tablet_replica.cc:333] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.561797 28565 raft_consensus.cc:2243] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.562354 28565 raft_consensus.cc:2272] T 307badafd0e64a4c87993caa003f0e2a P 121060c6c5b14502957b76fd1dfc7b2d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.564548 28565 tablet_replica.cc:333] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.565099 28565 raft_consensus.cc:2243] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:46.565797 28565 raft_consensus.cc:2272] T c538253e68554f7b82c0f993198e47d3 P 121060c6c5b14502957b76fd1dfc7b2d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:46.568413 28565 tablet_replica.cc:333] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d: stopping tablet replica
I20260709 13:12:46.569180 28565 raft_consensus.cc:2243] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:12:46.570150 28565 raft_consensus.cc:2272] T 917259a5b1e94566bb501796d8c4740d P 121060c6c5b14502957b76fd1dfc7b2d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:47.171968 28565 tablet_server.cc:196] TabletServer@127.27.229.68:0 shutdown complete.
I20260709 13:12:47.251120 28565 master.cc:562] Master@127.27.229.126:42083 shutting down...
W20260709 13:12:47.288355 29620 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:12:47.288712 29620 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:47.289001 29620 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:47.589414 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 3ff39d14c4684dfb9f2d3f7ed0bd42ad: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
W20260709 13:12:53.263968 29559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260709 13:12:53.267596 29559 catalog_manager.cc:4755] TS a9d8198d0b954886af452e89a8029614 (127.27.229.65:35503): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 57815098d70a4f2bb7a308d71da6ef9a: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35503: connect: Connection refused (error 111)
I20260709 13:12:54.280169 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:54.281149 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.281507 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P fa34c50a94a64ecc89d5a56c3ce9a26a: stopping tablet replica
I20260709 13:12:54.491860 28565 master.cc:584] Master@127.27.229.126:42083 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (166641 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:54.595551 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:46147
I20260709 13:12:54.596728 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:54.602962  2148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.603051  2147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.604321  2150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.605067 28565 server_base.cc:1061] running on GCE node
I20260709 13:12:54.607484 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:54.607689 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:54.607801 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602774607790 us; error 0 us; skew 500 ppm
I20260709 13:12:54.608263 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:54.610647 28565 webserver.cc:533] Webserver started at http://127.27.229.126:35703/ using document root <none> and password file <none>
I20260709 13:12:54.611104 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:54.611258 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:54.611471 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:54.612731 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "dc930e44c99944e487346fe701d1e9bb"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-twc1"
I20260709 13:12:54.617141 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:12:54.620515  2155 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.621230 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:54.621518 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "dc930e44c99944e487346fe701d1e9bb"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-twc1"
I20260709 13:12:54.621794 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:54.635686 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:54.636917 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:54.675400 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:46147
I20260709 13:12:54.675516  2206 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:46147 every 8 connection(s)
I20260709 13:12:54.679701  2207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:54.691668  2207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb: Bootstrap starting.
I20260709 13:12:54.696616  2207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:54.701066  2207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb: No bootstrap required, opened a new log
I20260709 13:12:54.703424  2207 raft_consensus.cc:359] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc930e44c99944e487346fe701d1e9bb" member_type: VOTER }
I20260709 13:12:54.703872  2207 raft_consensus.cc:385] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:54.704121  2207 raft_consensus.cc:740] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc930e44c99944e487346fe701d1e9bb, State: Initialized, Role: FOLLOWER
I20260709 13:12:54.704739  2207 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc930e44c99944e487346fe701d1e9bb" member_type: VOTER }
I20260709 13:12:54.705224  2207 raft_consensus.cc:399] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:54.705453  2207 raft_consensus.cc:493] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:54.705701  2207 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:54.710420  2207 raft_consensus.cc:515] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc930e44c99944e487346fe701d1e9bb" member_type: VOTER }
I20260709 13:12:54.710970  2207 leader_election.cc:304] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc930e44c99944e487346fe701d1e9bb; no voters: 
I20260709 13:12:54.712116  2207 leader_election.cc:290] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:54.712458  2210 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:54.713784  2210 raft_consensus.cc:697] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 1 LEADER]: Becoming Leader. State: Replica: dc930e44c99944e487346fe701d1e9bb, State: Running, Role: LEADER
I20260709 13:12:54.714569  2210 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc930e44c99944e487346fe701d1e9bb" member_type: VOTER }
I20260709 13:12:54.715250  2207 sys_catalog.cc:565] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:54.721674  2211 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc930e44c99944e487346fe701d1e9bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc930e44c99944e487346fe701d1e9bb" member_type: VOTER } }
I20260709 13:12:54.721809  2212 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc930e44c99944e487346fe701d1e9bb. Latest consensus state: current_term: 1 leader_uuid: "dc930e44c99944e487346fe701d1e9bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc930e44c99944e487346fe701d1e9bb" member_type: VOTER } }
I20260709 13:12:54.722544  2211 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:54.722574  2212 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:54.724936  2220 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:54.732493  2220 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:54.733557 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:54.742256  2220 catalog_manager.cc:1383] Generated new cluster ID: 7e0934b036b8426a8b702abf08e296cb
I20260709 13:12:54.742527  2220 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:54.756032  2220 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:54.757305  2220 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:54.771992  2220 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb: Generated new TSK 0
I20260709 13:12:54.772567  2220 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:54.800309 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:54.806828  2228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.807629  2229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.810101  2231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.810159 28565 server_base.cc:1061] running on GCE node
I20260709 13:12:54.812291 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:54.812527 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:54.812711 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602774812691 us; error 0 us; skew 500 ppm
I20260709 13:12:54.813282 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:54.815768 28565 webserver.cc:533] Webserver started at http://127.27.229.65:43767/ using document root <none> and password file <none>
I20260709 13:12:54.816264 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:54.816457 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:54.816711 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:54.817909 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-twc1"
I20260709 13:12:54.822707 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:54.826655  2236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.827499 28565 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:54.827804 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-twc1"
I20260709 13:12:54.828084 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:54.849123 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:54.850401 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:54.851872 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:54.854486 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:54.854712 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.854957 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:54.855121 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.897439 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:40559
I20260709 13:12:54.897558  2298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:40559 every 8 connection(s)
I20260709 13:12:54.902570 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:54.910197  2303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.911502  2304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:54.914839  2306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:54.915951  2299 heartbeater.cc:344] Connected to a master server at 127.27.229.126:46147
I20260709 13:12:54.915961 28565 server_base.cc:1061] running on GCE node
I20260709 13:12:54.916534  2299 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:54.917461  2299 heartbeater.cc:507] Master 127.27.229.126:46147 requested a full tablet report, sending...
I20260709 13:12:54.917907 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:54.918212 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:54.918416 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602774918387 us; error 0 us; skew 500 ppm
I20260709 13:12:54.919114 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:54.919766  2172 ts_manager.cc:194] Registered new tserver with Master: b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:54.921662  2172 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38508
I20260709 13:12:54.921909 28565 webserver.cc:533] Webserver started at http://127.27.229.66:33601/ using document root <none> and password file <none>
I20260709 13:12:54.922513 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:54.922699 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:54.923054 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:54.924400 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "cf33d724fb704d85ab3127e566123c10"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-twc1"
I20260709 13:12:54.929188 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:54.932811  2311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.933636 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:54.933952 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "cf33d724fb704d85ab3127e566123c10"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-twc1"
I20260709 13:12:54.934249 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:54.947016 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:54.948278 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:54.949790 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:54.952082 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:54.952287 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.952521 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:54.952673 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:54.994259 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:37949
I20260709 13:12:54.994371  2373 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:37949 every 8 connection(s)
I20260709 13:12:54.999423 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:55.007727  2377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.008600  2378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.010612  2380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.012216 28565 server_base.cc:1061] running on GCE node
I20260709 13:12:55.012274  2374 heartbeater.cc:344] Connected to a master server at 127.27.229.126:46147
I20260709 13:12:55.012941  2374 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:55.013561 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:55.013873 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:55.014011  2374 heartbeater.cc:507] Master 127.27.229.126:46147 requested a full tablet report, sending...
I20260709 13:12:55.014135 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602775014112 us; error 0 us; skew 500 ppm
I20260709 13:12:55.015030 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:55.016499  2172 ts_manager.cc:194] Registered new tserver with Master: cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:55.017858 28565 webserver.cc:533] Webserver started at http://127.27.229.67:33641/ using document root <none> and password file <none>
I20260709 13:12:55.018599 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:55.018514  2172 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38510
I20260709 13:12:55.018977 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:55.019318 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:55.020704 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "e98dadf6176848ef8893b68c45629066"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-twc1"
I20260709 13:12:55.025542 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.006s
I20260709 13:12:55.029096  2385 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.029875 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:55.030264 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "e98dadf6176848ef8893b68c45629066"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-twc1"
I20260709 13:12:55.030592 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:55.047159 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:55.048492 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:55.050122 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:55.052460 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:55.052690 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.052922 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:55.053076 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.094899 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:33615
I20260709 13:12:55.095027  2447 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:33615 every 8 connection(s)
I20260709 13:12:55.100009 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:55.107770  2451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.109352  2452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.110587 28565 server_base.cc:1061] running on GCE node
W20260709 13:12:55.112355  2454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.112963  2448 heartbeater.cc:344] Connected to a master server at 127.27.229.126:46147
I20260709 13:12:55.113425  2448 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:55.113543 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:55.113853 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:55.114089 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602775114071 us; error 0 us; skew 500 ppm
I20260709 13:12:55.114509  2448 heartbeater.cc:507] Master 127.27.229.126:46147 requested a full tablet report, sending...
I20260709 13:12:55.114945 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:55.117187  2172 ts_manager.cc:194] Registered new tserver with Master: e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:55.118382 28565 webserver.cc:533] Webserver started at http://127.27.229.68:44835/ using document root <none> and password file <none>
I20260709 13:12:55.119060 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:55.119079  2172 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38520
I20260709 13:12:55.119441 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:55.119870 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:55.121403 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-3-root/instance:
uuid: "7d612b55885c4aee87952bd05925f03b"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-twc1"
I20260709 13:12:55.126448 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:12:55.129878  2459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.130702 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:55.130987 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-3-root
uuid: "7d612b55885c4aee87952bd05925f03b"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-twc1"
I20260709 13:12:55.131227 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:55.156271 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:55.157546 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:55.159076 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:55.161537 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:55.161736 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.161942 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:55.162071 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:12:55.204941 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.68:36641
I20260709 13:12:55.205049  2521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.68:36641 every 8 connection(s)
I20260709 13:12:55.219780  2522 heartbeater.cc:344] Connected to a master server at 127.27.229.126:46147
I20260709 13:12:55.220232  2522 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:55.221202  2522 heartbeater.cc:507] Master 127.27.229.126:46147 requested a full tablet report, sending...
I20260709 13:12:55.223706  2172 ts_manager.cc:194] Registered new tserver with Master: 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:55.224591 28565 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016323052s
I20260709 13:12:55.225540  2172 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38524
I20260709 13:12:55.252130  2172 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38538:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:55.485239  2339 tablet_service.cc:1511] Processing CreateTablet for tablet e0dbbafcfa9d45b8b88a1851186758d6 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:55.485526  2264 tablet_service.cc:1511] Processing CreateTablet for tablet e0dbbafcfa9d45b8b88a1851186758d6 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:55.485935  2338 tablet_service.cc:1511] Processing CreateTablet for tablet 572f21ffe3d5423ab1708c3718752308 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:55.486969  2339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0dbbafcfa9d45b8b88a1851186758d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.488448  2337 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd662b171494cd18b261a83314083d3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:55.490003  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd662b171494cd18b261a83314083d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.489763  2263 tablet_service.cc:1511] Processing CreateTablet for tablet 572f21ffe3d5423ab1708c3718752308 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:55.487075  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0dbbafcfa9d45b8b88a1851186758d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.488492  2262 tablet_service.cc:1511] Processing CreateTablet for tablet a388dcea8c964b44a75944b6a5e72c97 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:55.493769  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a388dcea8c964b44a75944b6a5e72c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.494788  2263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572f21ffe3d5423ab1708c3718752308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.495510  2261 tablet_service.cc:1511] Processing CreateTablet for tablet b1afd652caeb4870bc040ee85a68ee9f (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:55.497001  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1afd652caeb4870bc040ee85a68ee9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.499732  2336 tablet_service.cc:1511] Processing CreateTablet for tablet b1afd652caeb4870bc040ee85a68ee9f (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:55.501227  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1afd652caeb4870bc040ee85a68ee9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.503181  2338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572f21ffe3d5423ab1708c3718752308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.507848  2260 tablet_service.cc:1511] Processing CreateTablet for tablet da44ad18eaab4920bb17c257fe5ff546 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:55.509366  2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da44ad18eaab4920bb17c257fe5ff546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.512521  2335 tablet_service.cc:1511] Processing CreateTablet for tablet da44ad18eaab4920bb17c257fe5ff546 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:55.514166  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da44ad18eaab4920bb17c257fe5ff546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.516228  2259 tablet_service.cc:1511] Processing CreateTablet for tablet c9d485c05977430d926f04e26c16f267 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:55.517863  2259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d485c05977430d926f04e26c16f267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.525216  2487 tablet_service.cc:1511] Processing CreateTablet for tablet e0dbbafcfa9d45b8b88a1851186758d6 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:55.525457  2486 tablet_service.cc:1511] Processing CreateTablet for tablet a388dcea8c964b44a75944b6a5e72c97 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:55.526891  2487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0dbbafcfa9d45b8b88a1851186758d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.527529  2485 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd662b171494cd18b261a83314083d3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:55.530299  2484 tablet_service.cc:1511] Processing CreateTablet for tablet da44ad18eaab4920bb17c257fe5ff546 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:55.531252  2334 tablet_service.cc:1511] Processing CreateTablet for tablet bf6df690111e402c94e06d82cb995e45 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:55.532848  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6df690111e402c94e06d82cb995e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.533435  2483 tablet_service.cc:1511] Processing CreateTablet for tablet c9d485c05977430d926f04e26c16f267 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:55.537521  2333 tablet_service.cc:1511] Processing CreateTablet for tablet fa1e1d96a4584c249a551ed8c02cd932 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:55.538463  2482 tablet_service.cc:1511] Processing CreateTablet for tablet bf6df690111e402c94e06d82cb995e45 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:55.539084  2333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1e1d96a4584c249a551ed8c02cd932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.541181  2258 tablet_service.cc:1511] Processing CreateTablet for tablet fa1e1d96a4584c249a551ed8c02cd932 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:55.542725  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1e1d96a4584c249a551ed8c02cd932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.544190  2481 tablet_service.cc:1511] Processing CreateTablet for tablet 2d57bcd5dc1f4559959b6af08f31e9ad (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:55.546667  2332 tablet_service.cc:1511] Processing CreateTablet for tablet 2d57bcd5dc1f4559959b6af08f31e9ad (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:55.548195  2332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d57bcd5dc1f4559959b6af08f31e9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.548662  2480 tablet_service.cc:1511] Processing CreateTablet for tablet b0c3f9ead2094675856fff4f3fdc8cf9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:55.551146  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 500e7e1147774338aa8067755a8dfcb0 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:55.552711  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500e7e1147774338aa8067755a8dfcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.555181  2479 tablet_service.cc:1511] Processing CreateTablet for tablet 500e7e1147774338aa8067755a8dfcb0 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:55.558050  2255 tablet_service.cc:1511] Processing CreateTablet for tablet 32dce47c7bca4ca9867196d40543c2a9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:55.558502  2330 tablet_service.cc:1511] Processing CreateTablet for tablet 32dce47c7bca4ca9867196d40543c2a9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:55.559999  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32dce47c7bca4ca9867196d40543c2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.541181  2257 tablet_service.cc:1511] Processing CreateTablet for tablet 2d57bcd5dc1f4559959b6af08f31e9ad (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:55.561241  2256 tablet_service.cc:1511] Processing CreateTablet for tablet b0c3f9ead2094675856fff4f3fdc8cf9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:55.559654  2478 tablet_service.cc:1511] Processing CreateTablet for tablet deb1d997d66d411b9175baf01eba5527 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:55.559610  2255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32dce47c7bca4ca9867196d40543c2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.570353  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c3f9ead2094675856fff4f3fdc8cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.574329  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d57bcd5dc1f4559959b6af08f31e9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.580077  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd662b171494cd18b261a83314083d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.584270  2480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c3f9ead2094675856fff4f3fdc8cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.590708  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d57bcd5dc1f4559959b6af08f31e9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.594648  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb1d997d66d411b9175baf01eba5527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.602619  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a388dcea8c964b44a75944b6a5e72c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.617853  2483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d485c05977430d926f04e26c16f267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.619931  2264 tablet_service.cc:1511] Processing CreateTablet for tablet deb1d997d66d411b9175baf01eba5527 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:55.621376  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb1d997d66d411b9175baf01eba5527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.622411  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6df690111e402c94e06d82cb995e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.624125  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da44ad18eaab4920bb17c257fe5ff546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.634294  2479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500e7e1147774338aa8067755a8dfcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.635916  2335 tablet_service.cc:1511] Processing CreateTablet for tablet dda6016d742d427295ff961579eb0adc (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:55.637530  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda6016d742d427295ff961579eb0adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.657876  2413 tablet_service.cc:1511] Processing CreateTablet for tablet 572f21ffe3d5423ab1708c3718752308 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:55.659423  2413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 572f21ffe3d5423ab1708c3718752308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.659682  2408 tablet_service.cc:1511] Processing CreateTablet for tablet bf6df690111e402c94e06d82cb995e45 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:55.661064  2408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6df690111e402c94e06d82cb995e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.663175  2412 tablet_service.cc:1511] Processing CreateTablet for tablet a388dcea8c964b44a75944b6a5e72c97 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:55.664769  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a388dcea8c964b44a75944b6a5e72c97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.664417  2406 tablet_service.cc:1511] Processing CreateTablet for tablet b0c3f9ead2094675856fff4f3fdc8cf9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:55.665887  2406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0c3f9ead2094675856fff4f3fdc8cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.669232  2330 tablet_service.cc:1511] Processing CreateTablet for tablet 6327d6ef6b3c494b9b70a426897e9121 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:55.669512  2409 tablet_service.cc:1511] Processing CreateTablet for tablet c9d485c05977430d926f04e26c16f267 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:55.670984  2409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d485c05977430d926f04e26c16f267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.667142  2411 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd662b171494cd18b261a83314083d3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:55.675575  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd662b171494cd18b261a83314083d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.668373  2410 tablet_service.cc:1511] Processing CreateTablet for tablet b1afd652caeb4870bc040ee85a68ee9f (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:55.668373  2404 tablet_service.cc:1511] Processing CreateTablet for tablet 32dce47c7bca4ca9867196d40543c2a9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:55.667142  2405 tablet_service.cc:1511] Processing CreateTablet for tablet 500e7e1147774338aa8067755a8dfcb0 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:55.663175  2407 tablet_service.cc:1511] Processing CreateTablet for tablet fa1e1d96a4584c249a551ed8c02cd932 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:55.680902  2410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1afd652caeb4870bc040ee85a68ee9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.689766  2407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa1e1d96a4584c249a551ed8c02cd932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.691453  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6327d6ef6b3c494b9b70a426897e9121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.694339  2404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32dce47c7bca4ca9867196d40543c2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.698318  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 500e7e1147774338aa8067755a8dfcb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.711176  2486 tablet_service.cc:1511] Processing CreateTablet for tablet 7775d57497934ba19aeb046609de5e25 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:55.712561  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7775d57497934ba19aeb046609de5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.711380  2336 tablet_service.cc:1511] Processing CreateTablet for tablet 595f4be17edb429fa78dad4b4a237fe5 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:55.718142  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f4be17edb429fa78dad4b4a237fe5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:55.726488  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:55.727421  2334 tablet_service.cc:1511] Processing CreateTablet for tablet 24353821c9e4434b957a5f26248d0b5a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:55.728780  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24353821c9e4434b957a5f26248d0b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.730428  2259 tablet_service.cc:1511] Processing CreateTablet for tablet 595f4be17edb429fa78dad4b4a237fe5 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:55.733287  2255 tablet_service.cc:1511] Processing CreateTablet for tablet 6327d6ef6b3c494b9b70a426897e9121 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:55.736457  2255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6327d6ef6b3c494b9b70a426897e9121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.736770  2485 tablet_service.cc:1511] Processing CreateTablet for tablet dda6016d742d427295ff961579eb0adc (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:55.601815  2339 tablet_service.cc:1511] Processing CreateTablet for tablet deb1d997d66d411b9175baf01eba5527 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:55.738109  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda6016d742d427295ff961579eb0adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.738796  2339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb1d997d66d411b9175baf01eba5527. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.740495  2264 tablet_service.cc:1511] Processing CreateTablet for tablet 401f4bd5793e424c8b248f0c7228ce2c (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:55.742295  2259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f4be17edb429fa78dad4b4a237fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.752368  2542 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:55.775866  2261 tablet_service.cc:1511] Processing CreateTablet for tablet 24353821c9e4434b957a5f26248d0b5a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:55.777396  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24353821c9e4434b957a5f26248d0b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.777539  2541 tablet_bootstrap.cc:492] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:55.779520  2479 tablet_service.cc:1511] Processing CreateTablet for tablet 595f4be17edb429fa78dad4b4a237fe5 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:55.763551  2258 tablet_service.cc:1511] Processing CreateTablet for tablet 7775d57497934ba19aeb046609de5e25 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:55.798249  2412 tablet_service.cc:1511] Processing CreateTablet for tablet 25f96db2fd0848edbbd0b74d46d285c8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:55.799679  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f96db2fd0848edbbd0b74d46d285c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.805384  2479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 595f4be17edb429fa78dad4b4a237fe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.694279  2337 tablet_service.cc:1511] Processing CreateTablet for tablet 25f96db2fd0848edbbd0b74d46d285c8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:55.811772  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f96db2fd0848edbbd0b74d46d285c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.813997  2541 tablet_bootstrap.cc:654] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.827560  2543 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:55.832722  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401f4bd5793e424c8b248f0c7228ce2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.838302  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7775d57497934ba19aeb046609de5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.845809  2405 tablet_service.cc:1511] Processing CreateTablet for tablet 7775d57497934ba19aeb046609de5e25 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:55.846215  2409 tablet_service.cc:1511] Processing CreateTablet for tablet dda6016d742d427295ff961579eb0adc (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:55.846545  2406 tablet_service.cc:1511] Processing CreateTablet for tablet 6327d6ef6b3c494b9b70a426897e9121 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:55.847504  2409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda6016d742d427295ff961579eb0adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.848779  2408 tablet_service.cc:1511] Processing CreateTablet for tablet 401f4bd5793e424c8b248f0c7228ce2c (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:55.850147  2408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401f4bd5793e424c8b248f0c7228ce2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.851970  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7775d57497934ba19aeb046609de5e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.851608  2481 tablet_service.cc:1511] Processing CreateTablet for tablet 401f4bd5793e424c8b248f0c7228ce2c (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:55.852924  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401f4bd5793e424c8b248f0c7228ce2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.859789  2486 tablet_service.cc:1511] Processing CreateTablet for tablet 25f96db2fd0848edbbd0b74d46d285c8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:55.861212  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25f96db2fd0848edbbd0b74d46d285c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.875298  2413 tablet_service.cc:1511] Processing CreateTablet for tablet 24353821c9e4434b957a5f26248d0b5a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:55.876943  2406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6327d6ef6b3c494b9b70a426897e9121. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.876798  2262 tablet_service.cc:1511] Processing CreateTablet for tablet 96d9df2600494490b900c0d25d88cd6a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:55.877770  2543 tablet_bootstrap.cc:654] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.878151  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d9df2600494490b900c0d25d88cd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.879429  2483 tablet_service.cc:1511] Processing CreateTablet for tablet 96d9df2600494490b900c0d25d88cd6a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:55.887409  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 96d9df2600494490b900c0d25d88cd6a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:55.894124  2413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24353821c9e4434b957a5f26248d0b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.898322  2544 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:55.906651  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d9df2600494490b900c0d25d88cd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.906442  2256 tablet_service.cc:1511] Processing CreateTablet for tablet 086b4a405c1a426a9dfd410277309eb8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:55.907871  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086b4a405c1a426a9dfd410277309eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.921792  2483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d9df2600494490b900c0d25d88cd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.924654  2299 heartbeater.cc:499] Master 127.27.229.126:46147 was elected leader, sending a full tablet report...
I20260709 13:12:55.926054  2478 tablet_service.cc:1511] Processing CreateTablet for tablet 086b4a405c1a426a9dfd410277309eb8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:55.927526  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086b4a405c1a426a9dfd410277309eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.935060  2411 tablet_service.cc:1511] Processing CreateTablet for tablet 086b4a405c1a426a9dfd410277309eb8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:55.937214  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 086b4a405c1a426a9dfd410277309eb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.938508  2542 tablet_bootstrap.cc:654] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.942098  2337 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5033c63fb34bddaa116c59c67d0032 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:55.951565  2541 tablet_bootstrap.cc:492] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:55.957572  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5033c63fb34bddaa116c59c67d0032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.958830  2541 ts_tablet_manager.cc:1403] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.008s
I20260709 13:12:55.962735  2544 tablet_bootstrap.cc:654] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.963444  2541 raft_consensus.cc:359] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:55.974540  2541 raft_consensus.cc:385] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.978765  2541 raft_consensus.cc:740] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.980770  2541 consensus_queue.cc:260] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:55.991245  2406 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5033c63fb34bddaa116c59c67d0032 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:55.991560  2485 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5033c63fb34bddaa116c59c67d0032 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:55.992681  2406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5033c63fb34bddaa116c59c67d0032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.993129  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5033c63fb34bddaa116c59c67d0032. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.008338  2264 tablet_service.cc:1511] Processing CreateTablet for tablet 98cc21fae71c4267b5b185563944dcd9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:56.009768  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cc21fae71c4267b5b185563944dcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.019658  2330 tablet_service.cc:1511] Processing CreateTablet for tablet 98cc21fae71c4267b5b185563944dcd9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:56.021112  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cc21fae71c4267b5b185563944dcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.021683  2374 heartbeater.cc:499] Master 127.27.229.126:46147 was elected leader, sending a full tablet report...
I20260709 13:12:56.024302  2541 ts_tablet_manager.cc:1434] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.005s
I20260709 13:12:56.033456  2543 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:56.034248  2543 ts_tablet_manager.cc:1403] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.207s	user 0.012s	sys 0.021s
I20260709 13:12:56.036736  2262 tablet_service.cc:1511] Processing CreateTablet for tablet d1bf4527355144469770b9b84ae9a88a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:56.038403  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bf4527355144469770b9b84ae9a88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.038939  2334 tablet_service.cc:1511] Processing CreateTablet for tablet d1bf4527355144469770b9b84ae9a88a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:56.040288  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bf4527355144469770b9b84ae9a88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.042897  2413 tablet_service.cc:1511] Processing CreateTablet for tablet 98cc21fae71c4267b5b185563944dcd9 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:56.044353  2413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98cc21fae71c4267b5b185563944dcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.050642  2544 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:56.051337  2544 ts_tablet_manager.cc:1403] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.004s
I20260709 13:12:56.053589  2541 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:56.062628  2543 raft_consensus.cc:359] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.063377  2543 raft_consensus.cc:385] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.063688  2543 raft_consensus.cc:740] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.064563  2543 consensus_queue.cc:260] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.070027  2548 raft_consensus.cc:493] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.070665  2548 raft_consensus.cc:515] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.073402  2548 leader_election.cc:290] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:56.075385  2541 tablet_bootstrap.cc:654] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.080127  2486 tablet_service.cc:1511] Processing CreateTablet for tablet d1bf4527355144469770b9b84ae9a88a (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:56.081766  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1bf4527355144469770b9b84ae9a88a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.085216  2542 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:56.086009  2542 ts_tablet_manager.cc:1403] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.334s	user 0.033s	sys 0.020s
I20260709 13:12:56.088927  2544 raft_consensus.cc:359] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.089847  2544 raft_consensus.cc:385] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.090238  2544 raft_consensus.cc:740] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.091084  2544 consensus_queue.cc:260] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.100818  2412 tablet_service.cc:1511] Processing CreateTablet for tablet e6dd644561b24709b20fcb3ae2e883e8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:56.102430  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6dd644561b24709b20fcb3ae2e883e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.107724  2483 tablet_service.cc:1511] Processing CreateTablet for tablet e6dd644561b24709b20fcb3ae2e883e8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:56.109205  2483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6dd644561b24709b20fcb3ae2e883e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.111444  2256 tablet_service.cc:1511] Processing CreateTablet for tablet e6dd644561b24709b20fcb3ae2e883e8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:56.112843  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6dd644561b24709b20fcb3ae2e883e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.118969  2405 tablet_service.cc:1511] Processing CreateTablet for tablet 80a8678d891d4cfd999693b186227d40 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:56.122394  2337 tablet_service.cc:1511] Processing CreateTablet for tablet 80a8678d891d4cfd999693b186227d40 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:56.123850  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a8678d891d4cfd999693b186227d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.124361  2448 heartbeater.cc:499] Master 127.27.229.126:46147 was elected leader, sending a full tablet report...
I20260709 13:12:56.122911  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a8678d891d4cfd999693b186227d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.144418  2544 ts_tablet_manager.cc:1434] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.006s
I20260709 13:12:56.123936  2478 tablet_service.cc:1511] Processing CreateTablet for tablet 80a8678d891d4cfd999693b186227d40 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:56.146500  2264 tablet_service.cc:1511] Processing CreateTablet for tablet c2bd883297624b7eb3b686e8c91fa005 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:56.148116  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2bd883297624b7eb3b686e8c91fa005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.156380  2334 tablet_service.cc:1511] Processing CreateTablet for tablet c2bd883297624b7eb3b686e8c91fa005 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:56.146450  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a8678d891d4cfd999693b186227d40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.157794  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2bd883297624b7eb3b686e8c91fa005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.161082  2411 tablet_service.cc:1511] Processing CreateTablet for tablet c2bd883297624b7eb3b686e8c91fa005 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:56.162497  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2bd883297624b7eb3b686e8c91fa005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.164881  2262 tablet_service.cc:1511] Processing CreateTablet for tablet 2a981f697d3849b8bf1f6d21f6ee49a6 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:56.166328  2544 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:56.168484  2550 raft_consensus.cc:493] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.169034  2550 raft_consensus.cc:515] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.169785  2522 heartbeater.cc:499] Master 127.27.229.126:46147 was elected leader, sending a full tablet report...
I20260709 13:12:56.170681  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 2a981f697d3849b8bf1f6d21f6ee49a6 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:56.172056  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a981f697d3849b8bf1f6d21f6ee49a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.166360  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a981f697d3849b8bf1f6d21f6ee49a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.196511  2542 raft_consensus.cc:359] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.197347  2542 raft_consensus.cc:385] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.197649  2541 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:56.198226  2541 ts_tablet_manager.cc:1403] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.169s	user 0.016s	sys 0.007s
I20260709 13:12:56.198922  2485 tablet_service.cc:1511] Processing CreateTablet for tablet 2a981f697d3849b8bf1f6d21f6ee49a6 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:56.200309  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a981f697d3849b8bf1f6d21f6ee49a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.201224  2541 raft_consensus.cc:359] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.202011  2541 raft_consensus.cc:385] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.202310  2541 raft_consensus.cc:740] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.203070  2541 consensus_queue.cc:260] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.205204  2541 ts_tablet_manager.cc:1434] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:56.197666  2542 raft_consensus.cc:740] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.206022  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:56.206943  2542 consensus_queue.cc:260] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
W20260709 13:12:56.215728  2315 leader_election.cc:343] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.214051  2548 raft_consensus.cc:493] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.217432  2548 raft_consensus.cc:515] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.219622  2550 leader_election.cc:290] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:56.220559  2541 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:56.235467  2543 ts_tablet_manager.cc:1434] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.201s	user 0.008s	sys 0.013s
I20260709 13:12:56.236693  2543 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:56.247951  2256 tablet_service.cc:1511] Processing CreateTablet for tablet e0205f70184949afaacd77d16dc39833 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:56.249531  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0205f70184949afaacd77d16dc39833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.255970  2330 tablet_service.cc:1511] Processing CreateTablet for tablet 186ff068763e4792881c144c673946ac (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:12:56.257061  2375 tablet.cc:2406] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:56.257526  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186ff068763e4792881c144c673946ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.228880  2406 tablet_service.cc:1511] Processing CreateTablet for tablet e0205f70184949afaacd77d16dc39833 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:56.274585  2406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0205f70184949afaacd77d16dc39833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.278373  2548 leader_election.cc:290] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:56.281368  2541 tablet_bootstrap.cc:654] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.284435  2544 tablet_bootstrap.cc:654] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.300602  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:56.301242  2412 tablet_service.cc:1511] Processing CreateTablet for tablet 186ff068763e4792881c144c673946ac (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:56.302690  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186ff068763e4792881c144c673946ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.309978  2481 tablet_service.cc:1511] Processing CreateTablet for tablet e0205f70184949afaacd77d16dc39833 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:56.311667  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0205f70184949afaacd77d16dc39833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.315184  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:56.315969  2497 raft_consensus.cc:2468] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:56.315582  2484 tablet_service.cc:1511] Processing CreateTablet for tablet 186ff068763e4792881c144c673946ac (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:12:56.322157  2315 leader_election.cc:343] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.322698  2315 leader_election.cc:304] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:12:56.323587  2548 raft_consensus.cc:2749] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.324151  2315 leader_election.cc:304] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:56.325284  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186ff068763e4792881c144c673946ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.326980  2548 raft_consensus.cc:2804] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.327438  2548 raft_consensus.cc:493] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.327790  2548 raft_consensus.cc:3060] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.337355  2542 ts_tablet_manager.cc:1434] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.251s	user 0.005s	sys 0.019s
I20260709 13:12:56.339807  2336 tablet_service.cc:1511] Processing CreateTablet for tablet 51b37d5c87774ab0aadad534ab6a652b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:56.341233  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b37d5c87774ab0aadad534ab6a652b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.350085  2339 tablet_service.cc:1511] Processing CreateTablet for tablet e35b4b5dcc014c7488f8e250fc29cd28 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:56.351557  2339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35b4b5dcc014c7488f8e250fc29cd28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.354185  2413 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7fbb0337a84684b74dd9e6b31e2863 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:56.355721  2413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7fbb0337a84684b74dd9e6b31e2863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.354761  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7fbb0337a84684b74dd9e6b31e2863 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:56.358626  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7fbb0337a84684b74dd9e6b31e2863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.362239  2553 raft_consensus.cc:493] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.362826  2553 raft_consensus.cc:515] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.367873  2553 leader_election.cc:290] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:56.374121  2411 tablet_service.cc:1511] Processing CreateTablet for tablet 7c00e7b281c741edaba5be11f02f5685 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:56.376281  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:56.377130  2274 raft_consensus.cc:2468] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:56.375588  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c00e7b281c741edaba5be11f02f5685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.384757  2542 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:56.390275  2258 tablet_service.cc:1511] Processing CreateTablet for tablet 51b37d5c87774ab0aadad534ab6a652b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:56.426065  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b37d5c87774ab0aadad534ab6a652b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.426294  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:56.385347  2461 leader_election.cc:304] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:12:56.393656  2337 tablet_service.cc:1511] Processing CreateTablet for tablet 62d101e9e818491db6b36b9112b724f3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:12:56.429486  2461 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:40559, user_credentials={real_user=slave}} blocked reactor thread for 47721.5us
I20260709 13:12:56.430061  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d101e9e818491db6b36b9112b724f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.430256  2550 raft_consensus.cc:2804] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.430640  2550 raft_consensus.cc:493] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.430976  2550 raft_consensus.cc:3060] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.383082  2478 tablet_service.cc:1511] Processing CreateTablet for tablet e35b4b5dcc014c7488f8e250fc29cd28 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:56.397637  2409 tablet_service.cc:1511] Processing CreateTablet for tablet 62d101e9e818491db6b36b9112b724f3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:56.407670  2259 tablet_service.cc:1511] Processing CreateTablet for tablet 7c00e7b281c741edaba5be11f02f5685 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:56.442798  2409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d101e9e818491db6b36b9112b724f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.445070  2483 tablet_service.cc:1511] Processing CreateTablet for tablet e24620bfc0cd42408a861714b4aad2eb (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:56.409770  2261 tablet_service.cc:1511] Processing CreateTablet for tablet 62d101e9e818491db6b36b9112b724f3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:56.447218  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d101e9e818491db6b36b9112b724f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.448002  2548 raft_consensus.cc:515] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.449388  2349 raft_consensus.cc:2393] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:12:56.412671  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:56.451890  2274 raft_consensus.cc:2468] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:56.414595  2257 tablet_service.cc:1511] Processing CreateTablet for tablet e24620bfc0cd42408a861714b4aad2eb (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:56.453289  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24620bfc0cd42408a861714b4aad2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.442798  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35b4b5dcc014c7488f8e250fc29cd28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.415220  2331 tablet_service.cc:1511] Processing CreateTablet for tablet e24620bfc0cd42408a861714b4aad2eb (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:56.458798  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24620bfc0cd42408a861714b4aad2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.460906  2259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c00e7b281c741edaba5be11f02f5685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.462952  2550 raft_consensus.cc:515] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.466115  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:56.466739  2274 raft_consensus.cc:3060] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.470597  2550 leader_election.cc:290] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:56.471733  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:56.472592  2349 raft_consensus.cc:2393] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:12:56.478415  2274 raft_consensus.cc:2468] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:56.479336  2486 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7fbb0337a84684b74dd9e6b31e2863 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:56.479846  2461 leader_election.cc:304] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10
I20260709 13:12:56.481144  2486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7fbb0337a84684b74dd9e6b31e2863. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.420126  2404 tablet_service.cc:1511] Processing CreateTablet for tablet c3ba9973b45145b0a660d1a46ac9da53 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:56.495942  2404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ba9973b45145b0a660d1a46ac9da53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.496491  2481 tablet_service.cc:1511] Processing CreateTablet for tablet 7c00e7b281c741edaba5be11f02f5685 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:56.424139  2405 tablet_service.cc:1511] Processing CreateTablet for tablet 51b37d5c87774ab0aadad534ab6a652b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:56.499221  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51b37d5c87774ab0aadad534ab6a652b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.396886  2544 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:56.484087  2548 leader_election.cc:290] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:56.484604  2550 raft_consensus.cc:2804] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.484737  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:56.485954  2542 tablet_bootstrap.cc:654] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.420359  2543 tablet_bootstrap.cc:654] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.504035  2544 ts_tablet_manager.cc:1403] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.338s	user 0.016s	sys 0.009s
I20260709 13:12:56.512557  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 5f79bc0e1fbb4d32923d277db6baaa91 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:56.514003  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f79bc0e1fbb4d32923d277db6baaa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.516134  2544 raft_consensus.cc:359] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.516973  2544 raft_consensus.cc:385] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.517269  2544 raft_consensus.cc:740] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.505422  2479 tablet_service.cc:1511] Processing CreateTablet for tablet c3ba9973b45145b0a660d1a46ac9da53 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:56.510982  2550 raft_consensus.cc:697] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:12:56.519088  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:56.519526  2550 consensus_queue.cc:237] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.521373  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:12:56.521833  2389 leader_election.cc:343] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.522986  2411 tablet_service.cc:1511] Processing CreateTablet for tablet 5f79bc0e1fbb4d32923d277db6baaa91 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:56.524806  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f79bc0e1fbb4d32923d277db6baaa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.530020  2336 tablet_service.cc:1511] Processing CreateTablet for tablet da1c8eb5f0b9448c8761472608c325e3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:56.531438  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1c8eb5f0b9448c8761472608c325e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.527931  2544 consensus_queue.cc:260] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.532583  2256 tablet_service.cc:1511] Processing CreateTablet for tablet c3ba9973b45145b0a660d1a46ac9da53 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:56.535151  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0dbbafcfa9d45b8b88a1851186758d6" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:56.536013  2274 raft_consensus.cc:2393] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 1: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:12:56.536491  2541 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:56.536737  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ba9973b45145b0a660d1a46ac9da53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.537034  2541 ts_tablet_manager.cc:1403] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.327s	user 0.017s	sys 0.000s
I20260709 13:12:56.536134  2262 tablet_service.cc:1511] Processing CreateTablet for tablet da1c8eb5f0b9448c8761472608c325e3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:56.540220  2541 raft_consensus.cc:359] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:56.541052  2541 raft_consensus.cc:385] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.541411  2479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ba9973b45145b0a660d1a46ac9da53. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:56.523058  2387 leader_election.cc:343] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.545647  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1c8eb5f0b9448c8761472608c325e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.552547  2412 tablet_service.cc:1511] Processing CreateTablet for tablet da1c8eb5f0b9448c8761472608c325e3 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:56.554128  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da1c8eb5f0b9448c8761472608c325e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.556378  2544 ts_tablet_manager.cc:1434] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:12:56.557579  2544 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:56.562040  2387 leader_election.cc:304] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:56.562956  2553 raft_consensus.cc:2749] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.541359  2541 raft_consensus.cc:740] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.564556  2484 tablet_service.cc:1511] Processing CreateTablet for tablet 5f79bc0e1fbb4d32923d277db6baaa91 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:56.573453  2264 tablet_service.cc:1511] Processing CreateTablet for tablet e35b4b5dcc014c7488f8e250fc29cd28 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:56.575009  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e35b4b5dcc014c7488f8e250fc29cd28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.575559  2485 tablet_service.cc:1511] Processing CreateTablet for tablet d6ccc1fa5471499daebb6bfe28fe9eab (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:56.589123  2258 tablet_service.cc:1511] Processing CreateTablet for tablet d6ccc1fa5471499daebb6bfe28fe9eab (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:56.590659  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ccc1fa5471499daebb6bfe28fe9eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.565735  2541 consensus_queue.cc:260] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:56.598968  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c00e7b281c741edaba5be11f02f5685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.608911  2483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24620bfc0cd42408a861714b4aad2eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.615494  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f79bc0e1fbb4d32923d277db6baaa91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.616297  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ccc1fa5471499daebb6bfe28fe9eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.617077  2172 catalog_manager.cc:5697] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:56.621114  2542 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:56.621699  2542 ts_tablet_manager.cc:1403] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.251s	user 0.024s	sys 0.004s
I20260709 13:12:56.622134  2315 leader_election.cc:304] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:56.623443  2548 raft_consensus.cc:2749] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.630987  2331 tablet_service.cc:1511] Processing CreateTablet for tablet d6ccc1fa5471499daebb6bfe28fe9eab (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:56.632488  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6ccc1fa5471499daebb6bfe28fe9eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.633507  2413 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab2577017124173bbf7a9a3ccf1b044 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:56.635018  2413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab2577017124173bbf7a9a3ccf1b044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.637737  2542 raft_consensus.cc:359] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.638586  2542 raft_consensus.cc:385] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.638901  2542 raft_consensus.cc:740] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.644155  2257 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab2577017124173bbf7a9a3ccf1b044 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:56.645720  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab2577017124173bbf7a9a3ccf1b044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.647215  2542 consensus_queue.cc:260] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.654765  2406 tablet_service.cc:1511] Processing CreateTablet for tablet c9643f19185c4726ba1ddb57ca801a95 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:56.655467  2542 ts_tablet_manager.cc:1434] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:12:56.650967  2335 tablet_service.cc:1511] Processing CreateTablet for tablet c9643f19185c4726ba1ddb57ca801a95 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:56.656157  2406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9643f19185c4726ba1ddb57ca801a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.656734  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9643f19185c4726ba1ddb57ca801a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.650420  2541 ts_tablet_manager.cc:1434] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.113s	user 0.009s	sys 0.000s
I20260709 13:12:56.662740  2541 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:56.666517  2543 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:56.667157  2543 ts_tablet_manager.cc:1403] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.431s	user 0.010s	sys 0.007s
I20260709 13:12:56.670933  2478 tablet_service.cc:1511] Processing CreateTablet for tablet 9ab2577017124173bbf7a9a3ccf1b044 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:56.672367  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ab2577017124173bbf7a9a3ccf1b044. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.673319  2482 tablet_service.cc:1511] Processing CreateTablet for tablet c9643f19185c4726ba1ddb57ca801a95 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:56.674738  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9643f19185c4726ba1ddb57ca801a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.687443  2544 tablet_bootstrap.cc:654] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.698679  2543 raft_consensus.cc:359] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.699810  2543 raft_consensus.cc:385] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.700224  2543 raft_consensus.cc:740] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.701287  2543 consensus_queue.cc:260] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.704773  2543 ts_tablet_manager.cc:1434] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:12:56.705881  2543 tablet_bootstrap.cc:492] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:56.707615  2542 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:56.713827  2256 tablet_service.cc:1511] Processing CreateTablet for tablet 63b29c3e7d3b4be7aab7aa8cf53c04a8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:56.715224  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b29c3e7d3b4be7aab7aa8cf53c04a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.718890  2541 tablet_bootstrap.cc:654] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.719063  2543 tablet_bootstrap.cc:654] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:56.729120  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:56.730237  2548 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.730787  2548 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:56.732590  2543 tablet_bootstrap.cc:492] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:56.733122  2548 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:56.733529  2543 ts_tablet_manager.cc:1403] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.003s
I20260709 13:12:56.734210  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:56.735981  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
W20260709 13:12:56.737706  2315 leader_election.cc:343] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.738350  2543 raft_consensus.cc:359] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.739323  2543 raft_consensus.cc:385] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.739708  2543 raft_consensus.cc:740] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.739727  2336 tablet_service.cc:1511] Processing CreateTablet for tablet 63b29c3e7d3b4be7aab7aa8cf53c04a8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:56.742187  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b29c3e7d3b4be7aab7aa8cf53c04a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.743602  2411 tablet_service.cc:1511] Processing CreateTablet for tablet 63b29c3e7d3b4be7aab7aa8cf53c04a8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:56.744290  2544 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:56.744861  2544 ts_tablet_manager.cc:1403] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.188s	user 0.024s	sys 0.001s
I20260709 13:12:56.745012  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63b29c3e7d3b4be7aab7aa8cf53c04a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.742200  2543 consensus_queue.cc:260] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.747880  2543 ts_tablet_manager.cc:1434] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:12:56.749207  2561 raft_consensus.cc:493] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.754278  2561 raft_consensus.cc:515] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.756943  2561 leader_election.cc:290] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:56.759987  2542 tablet_bootstrap.cc:654] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:56.764441  2313 leader_election.cc:343] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.764995  2313 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:12:56.766185  2548 raft_consensus.cc:2749] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.767416  2541 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:56.767959  2541 ts_tablet_manager.cc:1403] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.105s	user 0.003s	sys 0.008s
I20260709 13:12:56.771328  2541 raft_consensus.cc:359] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:56.772151  2541 raft_consensus.cc:385] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.772465  2541 raft_consensus.cc:740] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.774335  2543 tablet_bootstrap.cc:492] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:56.779115  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 5f51c0624f6946a2871ddb439bf616e7 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:56.773471  2541 consensus_queue.cc:260] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:56.780526  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f51c0624f6946a2871ddb439bf616e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.780499  2264 tablet_service.cc:1511] Processing CreateTablet for tablet 5f51c0624f6946a2871ddb439bf616e7 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:56.782953  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f51c0624f6946a2871ddb439bf616e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.780551  2544 raft_consensus.cc:359] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.783922  2411 tablet_service.cc:1511] Processing CreateTablet for tablet b812b253535b4aeea1d25a2fd849a6ef (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:56.786075  2544 raft_consensus.cc:385] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.788309  2544 raft_consensus.cc:740] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.789197  2544 consensus_queue.cc:260] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.791386  2544 ts_tablet_manager.cc:1434] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.033s	user 0.001s	sys 0.005s
I20260709 13:12:56.794498  2543 tablet_bootstrap.cc:654] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.799549  2262 tablet_service.cc:1511] Processing CreateTablet for tablet b812b253535b4aeea1d25a2fd849a6ef (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:56.801012  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b812b253535b4aeea1d25a2fd849a6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.800854  2337 tablet_service.cc:1511] Processing CreateTablet for tablet 639b7a560e414c60a43f687a8eaf95f7 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:56.802220  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639b7a560e414c60a43f687a8eaf95f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.804764  2258 tablet_service.cc:1511] Processing CreateTablet for tablet f322094126754e8885c94371d6292e5b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:56.806178  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f322094126754e8885c94371d6292e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.806826  2339 tablet_service.cc:1511] Processing CreateTablet for tablet f322094126754e8885c94371d6292e5b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:56.808120  2339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f322094126754e8885c94371d6292e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.807976  2404 tablet_service.cc:1511] Processing CreateTablet for tablet 639b7a560e414c60a43f687a8eaf95f7 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:56.808029  2481 tablet_service.cc:1511] Processing CreateTablet for tablet 639b7a560e414c60a43f687a8eaf95f7 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:56.808900  2412 tablet_service.cc:1511] Processing CreateTablet for tablet f322094126754e8885c94371d6292e5b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:56.810075  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639b7a560e414c60a43f687a8eaf95f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.825150  2541 ts_tablet_manager.cc:1434] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.000s
I20260709 13:12:56.824355  2484 tablet_service.cc:1511] Processing CreateTablet for tablet 5f51c0624f6946a2871ddb439bf616e7 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:56.826431  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f51c0624f6946a2871ddb439bf616e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.833238  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d485c05977430d926f04e26c16f267" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:56.834051  2423 raft_consensus.cc:2468] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:56.835739  2550 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.836293  2550 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.837060  2240 leader_election.cc:304] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:56.837090  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b812b253535b4aeea1d25a2fd849a6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.838500  2541 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:56.840083  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:56.824265  2482 tablet_service.cc:1511] Processing CreateTablet for tablet b812b253535b4aeea1d25a2fd849a6ef (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:56.842278  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f322094126754e8885c94371d6292e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.843056  2404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639b7a560e414c60a43f687a8eaf95f7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:56.844576  2461 leader_election.cc:343] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.845089  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b812b253535b4aeea1d25a2fd849a6ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.845227  2550 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:56.846535  2561 raft_consensus.cc:2804] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.846940  2561 raft_consensus.cc:493] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.847292  2561 raft_consensus.cc:3060] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.855512  2561 raft_consensus.cc:515] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.857980  2485 tablet_service.cc:1511] Processing CreateTablet for tablet dca50cf726644de7a82745b940c12b8d (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:56.861825  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca50cf726644de7a82745b940c12b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.868610  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d485c05977430d926f04e26c16f267" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:12:56.870306  2240 leader_election.cc:343] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.870883  2542 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:56.871524  2542 ts_tablet_manager.cc:1403] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.006s
I20260709 13:12:56.873354  2550 raft_consensus.cc:493] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.873965  2550 raft_consensus.cc:515] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.875339  2544 tablet_bootstrap.cc:492] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:56.879654  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:56.884454  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d485c05977430d926f04e26c16f267" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:56.884999  2349 raft_consensus.cc:2468] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:56.885178  2423 raft_consensus.cc:3060] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.880668  2550 leader_election.cc:290] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:56.888708  2460 leader_election.cc:304] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:56.888875  2542 raft_consensus.cc:359] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:56.889631  2542 raft_consensus.cc:385] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.889981  2542 raft_consensus.cc:740] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.890218  2550 raft_consensus.cc:2804] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.890614  2550 raft_consensus.cc:493] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.891021  2550 raft_consensus.cc:3060] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.890753  2542 consensus_queue.cc:260] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:56.897557  2405 tablet_service.cc:1511] Processing CreateTablet for tablet 62a5d1b594b2484f9099f78faf6004e8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:56.898967  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a5d1b594b2484f9099f78faf6004e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.898626  2262 tablet_service.cc:1511] Processing CreateTablet for tablet dca50cf726644de7a82745b940c12b8d (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:56.900019  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca50cf726644de7a82745b940c12b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.899819  2478 tablet_service.cc:1511] Processing CreateTablet for tablet 62a5d1b594b2484f9099f78faf6004e8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:56.902484  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a5d1b594b2484f9099f78faf6004e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.913127  2258 tablet_service.cc:1511] Processing CreateTablet for tablet 62a5d1b594b2484f9099f78faf6004e8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:56.914639  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a5d1b594b2484f9099f78faf6004e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.919031  2423 raft_consensus.cc:2468] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:56.920614  2240 leader_election.cc:304] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:56.926576  2336 tablet_service.cc:1511] Processing CreateTablet for tablet dca50cf726644de7a82745b940c12b8d (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:56.928216  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca50cf726644de7a82745b940c12b8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.900619  2550 raft_consensus.cc:515] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.939771  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:56.940127  2339 tablet_service.cc:1511] Processing CreateTablet for tablet 87781f9dd28d4ae7bcf9a3daf87ed7f8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:56.940922  2553 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.941486  2339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87781f9dd28d4ae7bcf9a3daf87ed7f8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:56.942360  2463 leader_election.cc:343] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.941439  2553 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.945324  2553 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:56.948470  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:56.949020  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:56.949204  2497 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:12:56.948542  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
W20260709 13:12:56.950342  2387 leader_election.cc:343] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.950657  2423 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:56.951510  2389 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:56.951399  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d485c05977430d926f04e26c16f267" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:56.952215  2463 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
W20260709 13:12:56.953284  2240 leader_election.cc:343] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.953845  2553 raft_consensus.cc:2804] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.953639  2412 tablet_service.cc:1511] Processing CreateTablet for tablet 87781f9dd28d4ae7bcf9a3daf87ed7f8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:56.953227  2554 raft_consensus.cc:2804] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.954946  2554 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.954363  2553 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.955289  2554 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.955762  2553 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.955406  2412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87781f9dd28d4ae7bcf9a3daf87ed7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.957902  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:56.958580  2349 raft_consensus.cc:3060] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.936758  2561 leader_election.cc:290] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:56.963482  2581 raft_consensus.cc:493] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.964039  2581 raft_consensus.cc:515] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:56.970074  2544 tablet_bootstrap.cc:654] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.955276  2542 ts_tablet_manager.cc:1434] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.010s
I20260709 13:12:56.963900  2561 raft_consensus.cc:2804] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.976265  2543 tablet_bootstrap.cc:492] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:56.976784  2543 ts_tablet_manager.cc:1403] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.203s	user 0.028s	sys 0.019s
I20260709 13:12:56.981564  2550 leader_election.cc:290] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:56.982542  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:56.983126  2482 tablet_service.cc:1511] Processing CreateTablet for tablet 87781f9dd28d4ae7bcf9a3daf87ed7f8 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:56.984505  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87781f9dd28d4ae7bcf9a3daf87ed7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.980027  2543 raft_consensus.cc:359] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
W20260709 13:12:56.984074  2463 leader_election.cc:343] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.985540  2561 raft_consensus.cc:697] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:12:56.987857  2581 leader_election.cc:290] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:56.980022  2349 raft_consensus.cc:2468] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:56.989151  2257 tablet_service.cc:1511] Processing CreateTablet for tablet a38b520c4d354a30ab517a2539f0a42e (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:56.990506  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38b520c4d354a30ab517a2539f0a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.985600  2543 raft_consensus.cc:385] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.993739  2543 raft_consensus.cc:740] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.994766  2543 consensus_queue.cc:260] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:56.997254  2543 ts_tablet_manager.cc:1434] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:12:56.997701  2405 tablet_service.cc:1511] Processing CreateTablet for tablet a38b520c4d354a30ab517a2539f0a42e (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:56.999174  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38b520c4d354a30ab517a2539f0a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.980031  2553 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:56.984064  2554 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.003242  2336 tablet_service.cc:1511] Processing CreateTablet for tablet a38b520c4d354a30ab517a2539f0a42e (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:57.004611  2554 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:57.006032  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:12:57.007403  2461 leader_election.cc:343] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.006381  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a38b520c4d354a30ab517a2539f0a42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.009537  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.009822  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:12:57.010985  2387 leader_election.cc:343] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.011530  2543 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:57.012919  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:57.013783  2422 raft_consensus.cc:2393] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:12:57.016855  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:57.013688  2553 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:57.018184  2497 raft_consensus.cc:2393] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 in current term 1: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
W20260709 13:12:57.010993  2240 leader_election.cc:343] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.020538  2389 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:57.021205  2264 tablet_service.cc:1511] Processing CreateTablet for tablet eb7db953c1cb4d7282bfab9976f3998b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:57.022173  2463 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:12:57.022614  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7db953c1cb4d7282bfab9976f3998b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.023706  2553 raft_consensus.cc:2749] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.023504  2337 tablet_service.cc:1511] Processing CreateTablet for tablet eb7db953c1cb4d7282bfab9976f3998b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:57.024420  2542 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.025084  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7db953c1cb4d7282bfab9976f3998b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.023535  2541 tablet_bootstrap.cc:654] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.986598  2561 consensus_queue.cc:237] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.017642  2478 tablet_service.cc:1511] Processing CreateTablet for tablet eb7db953c1cb4d7282bfab9976f3998b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:57.034395  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7db953c1cb4d7282bfab9976f3998b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.036159  2554 consensus_queue.cc:1048] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:57.029892  2550 raft_consensus.cc:2749] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.039291  2544 tablet_bootstrap.cc:492] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:57.040210  2460 leader_election.cc:304] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: e98dadf6176848ef8893b68c45629066
I20260709 13:12:57.046281  2411 tablet_service.cc:1511] Processing CreateTablet for tablet ea5fb36d7bd44d7a8b073eae26ba8b23 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:57.056022  2586 raft_consensus.cc:2804] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.056679  2544 ts_tablet_manager.cc:1403] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.004s
I20260709 13:12:57.052055  2256 tablet_service.cc:1511] Processing CreateTablet for tablet ea5fb36d7bd44d7a8b073eae26ba8b23 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:57.053287  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 61e0b15b3c884b8e99633d52c01d1f64 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:57.061604  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5fb36d7bd44d7a8b073eae26ba8b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.061707  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e0b15b3c884b8e99633d52c01d1f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.056315  2485 tablet_service.cc:1511] Processing CreateTablet for tablet ea5fb36d7bd44d7a8b073eae26ba8b23 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:57.049901  2542 tablet_bootstrap.cc:654] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.070822  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5fb36d7bd44d7a8b073eae26ba8b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.056967  2543 tablet_bootstrap.cc:654] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.072630  2541 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:57.074239  2541 ts_tablet_manager.cc:1403] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.236s	user 0.013s	sys 0.000s
I20260709 13:12:57.070824  2485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5fb36d7bd44d7a8b073eae26ba8b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.086874  2544 raft_consensus.cc:359] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.087700  2544 raft_consensus.cc:385] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.087991  2544 raft_consensus.cc:740] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.088780  2544 consensus_queue.cc:260] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.099059  2544 ts_tablet_manager.cc:1434] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:12:57.107008  2544 tablet_bootstrap.cc:492] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:57.081084  2586 raft_consensus.cc:697] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:12:57.128404  2172 catalog_manager.cc:5697] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.137811  2484 tablet_service.cc:1511] Processing CreateTablet for tablet 61e0b15b3c884b8e99633d52c01d1f64 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:57.139542  2484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e0b15b3c884b8e99633d52c01d1f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.143108  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:12:57.144845  2237 leader_election.cc:343] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.145360  2237 leader_election.cc:304] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:12:57.146242  2561 raft_consensus.cc:2749] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.147534  2405 tablet_service.cc:1511] Processing CreateTablet for tablet 61e0b15b3c884b8e99633d52c01d1f64 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:57.148797  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61e0b15b3c884b8e99633d52c01d1f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.148954  2541 raft_consensus.cc:359] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.149874  2541 raft_consensus.cc:385] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.150251  2541 raft_consensus.cc:740] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.151163  2541 consensus_queue.cc:260] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.159957  2542 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:57.150104  2554 consensus_queue.cc:1048] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:12:57.160576  2542 ts_tablet_manager.cc:1403] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.187s	user 0.026s	sys 0.028s
I20260709 13:12:57.163936  2542 raft_consensus.cc:359] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.164791  2542 raft_consensus.cc:385] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.164605  2256 tablet_service.cc:1511] Processing CreateTablet for tablet f56b1f2e989a49adbbe3fda8fa181a98 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:57.165140  2542 raft_consensus.cc:740] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.166105  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56b1f2e989a49adbbe3fda8fa181a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.166262  2542 consensus_queue.cc:260] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.168633  2542 ts_tablet_manager.cc:1434] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:12:57.169778  2542 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.176627  2542 tablet_bootstrap.cc:654] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.185504  2541 ts_tablet_manager.cc:1434] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.111s	user 0.003s	sys 0.004s
I20260709 13:12:57.187058  2541 tablet_bootstrap.cc:492] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:57.192533  2544 tablet_bootstrap.cc:654] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.180220  2586 consensus_queue.cc:237] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.203397  2336 tablet_service.cc:1511] Processing CreateTablet for tablet f56b1f2e989a49adbbe3fda8fa181a98 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:57.205070  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56b1f2e989a49adbbe3fda8fa181a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.209283  2543 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:57.203965  2542 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:57.210227  2542 ts_tablet_manager.cc:1403] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.003s
I20260709 13:12:57.210704  2548 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.211344  2548 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.213413  2542 raft_consensus.cc:359] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.209892  2543 ts_tablet_manager.cc:1403] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.199s	user 0.016s	sys 0.015s
I20260709 13:12:57.217496  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:57.217821  2542 raft_consensus.cc:385] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.218067  2594 raft_consensus.cc:493] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.218408  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:57.218739  2542 raft_consensus.cc:740] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
W20260709 13:12:57.220883  2313 leader_election.cc:343] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:57.221571  2315 leader_election.cc:343] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.222051  2315 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:57.218614  2594 raft_consensus.cc:515] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.228518  2541 tablet_bootstrap.cc:654] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.213783  2548 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:57.230350  2548 raft_consensus.cc:2749] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.239326  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:12:57.241074  2460 leader_election.cc:343] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.244011  2482 tablet_service.cc:1511] Processing CreateTablet for tablet f1839fe9b25246a78f571eef32e6ef2b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:57.245440  2482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1839fe9b25246a78f571eef32e6ef2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.246302  2594 leader_election.cc:290] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:57.246878  2264 tablet_service.cc:1511] Processing CreateTablet for tablet f1839fe9b25246a78f571eef32e6ef2b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:57.247959  2543 raft_consensus.cc:359] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.248857  2543 raft_consensus.cc:385] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.249167  2543 raft_consensus.cc:740] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.249693  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.250131  2543 consensus_queue.cc:260] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:12:57.251838  2463 leader_election.cc:343] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.248072  2264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1839fe9b25246a78f571eef32e6ef2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.252283  2405 tablet_service.cc:1511] Processing CreateTablet for tablet f56b1f2e989a49adbbe3fda8fa181a98 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:57.256347  2411 tablet_service.cc:1511] Processing CreateTablet for tablet f6a7e2640e594f4c816e8bbfe035ea28 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:57.235986  2542 consensus_queue.cc:260] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.272769  2542 ts_tablet_manager.cc:1434] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:12:57.252382  2463 leader_election.cc:304] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:12:57.253866  2405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56b1f2e989a49adbbe3fda8fa181a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.276098  2478 tablet_service.cc:1511] Processing CreateTablet for tablet f6a7e2640e594f4c816e8bbfe035ea28 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:57.277508  2478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a7e2640e594f4c816e8bbfe035ea28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.281822  2543 ts_tablet_manager.cc:1434] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 13:12:57.282212  2594 raft_consensus.cc:2749] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:57.283066  2543 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:57.288136  2258 tablet_service.cc:1511] Processing CreateTablet for tablet f6a7e2640e594f4c816e8bbfe035ea28 (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:57.288995  2542 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.289846  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a7e2640e594f4c816e8bbfe035ea28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.294950  2337 tablet_service.cc:1511] Processing CreateTablet for tablet f1839fe9b25246a78f571eef32e6ef2b (DEFAULT_TABLE table=test-workload [id=e00919f2659b487b8b85334c6c2dbe6f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:57.296401  2337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1839fe9b25246a78f571eef32e6ef2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.302366  2411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6a7e2640e594f4c816e8bbfe035ea28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:57.304332  2542 tablet_bootstrap.cc:654] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:57.314338  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 93482.6us
I20260709 13:12:57.315861  2543 tablet_bootstrap.cc:654] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.315241  2171 catalog_manager.cc:5697] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.322245  2541 tablet_bootstrap.cc:492] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:57.322780  2541 ts_tablet_manager.cc:1403] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.011s
I20260709 13:12:57.329500  2541 raft_consensus.cc:359] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.330317  2541 raft_consensus.cc:385] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.330613  2541 raft_consensus.cc:740] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.331384  2541 consensus_queue.cc:260] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.335631  2542 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:57.338529  2542 ts_tablet_manager.cc:1403] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 13:12:57.343354  2544 tablet_bootstrap.cc:492] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:57.341100  2542 raft_consensus.cc:359] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.343894  2544 ts_tablet_manager.cc:1403] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.237s	user 0.012s	sys 0.038s
I20260709 13:12:57.344106  2542 raft_consensus.cc:385] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.344498  2542 raft_consensus.cc:740] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.346575  2541 ts_tablet_manager.cc:1434] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:12:57.347040  2544 raft_consensus.cc:359] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.347884  2544 raft_consensus.cc:385] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.348213  2544 raft_consensus.cc:740] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.348945  2541 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:57.347443  2542 consensus_queue.cc:260] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.349040  2544 consensus_queue.cc:260] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.358135  2543 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:57.358711  2543 ts_tablet_manager.cc:1403] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.076s	user 0.006s	sys 0.006s
I20260709 13:12:57.362110  2544 ts_tablet_manager.cc:1434] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:12:57.363183  2544 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:57.361897  2543 raft_consensus.cc:359] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.366909  2543 raft_consensus.cc:385] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.367192  2541 tablet_bootstrap.cc:654] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.367381  2543 raft_consensus.cc:740] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.368482  2543 consensus_queue.cc:260] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.372699  2544 tablet_bootstrap.cc:654] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.373960  2543 ts_tablet_manager.cc:1434] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:12:57.375226  2543 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:57.375312  2542 ts_tablet_manager.cc:1434] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.005s
I20260709 13:12:57.376515  2542 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.380486  2599 raft_consensus.cc:493] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.381167  2599 raft_consensus.cc:515] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.383205  2542 tablet_bootstrap.cc:654] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.383209  2543 tablet_bootstrap.cc:654] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.384645  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32dce47c7bca4ca9867196d40543c2a9" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:57.385396  2274 raft_consensus.cc:2468] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:57.385761  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32dce47c7bca4ca9867196d40543c2a9" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.386466  2599 leader_election.cc:290] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:57.386911  2313 leader_election.cc:304] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
W20260709 13:12:57.387781  2315 leader_election.cc:343] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.388949  2541 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:57.389559  2541 ts_tablet_manager.cc:1403] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.010s
I20260709 13:12:57.390997  2561 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.391525  2561 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.393698  2561 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:57.394976  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.395383  2599 raft_consensus.cc:2804] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.395789  2599 raft_consensus.cc:493] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.396124  2599 raft_consensus.cc:3060] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.397347  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:57.398049  2349 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:57.398447  2544 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:57.397908  2541 raft_consensus.cc:359] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.398862  2541 raft_consensus.cc:385] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.399179  2541 raft_consensus.cc:740] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.399636  2237 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:57.399777  2544 ts_tablet_manager.cc:1403] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.002s
I20260709 13:12:57.399981  2541 consensus_queue.cc:260] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:12:57.402016  2240 leader_election.cc:343] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.402415  2541 ts_tablet_manager.cc:1434] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:12:57.403061  2561 raft_consensus.cc:2804] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.403553  2561 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.405457  2561 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.406571  2544 raft_consensus.cc:359] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.407423  2544 raft_consensus.cc:385] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.407698  2544 raft_consensus.cc:740] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.408062  2541 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:57.404029  2599 raft_consensus.cc:515] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.409466  2544 consensus_queue.cc:260] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.412106  2599 leader_election.cc:290] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:57.415364  2544 ts_tablet_manager.cc:1434] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:12:57.416294  2542 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:57.416874  2542 ts_tablet_manager.cc:1403] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.004s
I20260709 13:12:57.417521  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32dce47c7bca4ca9867196d40543c2a9" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:57.415997  2561 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.419088  2543 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:57.419687  2543 ts_tablet_manager.cc:1403] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.006s
I20260709 13:12:57.420131  2561 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:57.421195  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32dce47c7bca4ca9867196d40543c2a9" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:57.421867  2274 raft_consensus.cc:3060] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.422338  2544 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
W20260709 13:12:57.419199  2315 leader_election.cc:343] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.422799  2542 raft_consensus.cc:359] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.423581  2542 raft_consensus.cc:385] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.423868  2542 raft_consensus.cc:740] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.425661  2543 raft_consensus.cc:359] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.426566  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:57.427193  2349 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.426829  2542 consensus_queue.cc:260] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.429595  2542 ts_tablet_manager.cc:1434] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:57.429788  2544 tablet_bootstrap.cc:654] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.430686  2542 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.433241  2541 tablet_bootstrap.cc:654] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.434266  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:57.440323  2542 tablet_bootstrap.cc:654] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:57.441258  2240 leader_election.cc:343] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.442344  2544 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:57.442932  2544 ts_tablet_manager.cc:1403] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:12:57.443038  2599 raft_consensus.cc:493] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.443625  2349 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:57.443591  2599 raft_consensus.cc:515] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.445149  2237 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: e98dadf6176848ef8893b68c45629066
I20260709 13:12:57.446919  2599 leader_election.cc:290] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:57.446560  2544 raft_consensus.cc:359] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.447474  2544 raft_consensus.cc:385] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.447871  2544 raft_consensus.cc:740] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.447712  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572f21ffe3d5423ab1708c3718752308" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.449513  2423 raft_consensus.cc:2468] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:57.450018  2544 consensus_queue.cc:260] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.450459  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572f21ffe3d5423ab1708c3718752308" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:57.450902  2541 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:57.451463  2541 ts_tablet_manager.cc:1403] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.003s
I20260709 13:12:57.451905  2315 leader_election.cc:304] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
W20260709 13:12:57.453240  2313 leader_election.cc:343] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.453420  2599 raft_consensus.cc:2804] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.453809  2599 raft_consensus.cc:493] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.453248  2561 raft_consensus.cc:2804] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.454296  2541 raft_consensus.cc:359] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.455116  2541 raft_consensus.cc:385] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.454169  2599 raft_consensus.cc:3060] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.455477  2541 raft_consensus.cc:740] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.456218  2541 consensus_queue.cc:260] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.457101  2544 ts_tablet_manager.cc:1434] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.007s
I20260709 13:12:57.458403  2544 tablet_bootstrap.cc:492] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:57.458523  2541 ts_tablet_manager.cc:1434] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:57.426576  2543 raft_consensus.cc:385] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.459482  2543 raft_consensus.cc:740] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.460592  2541 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:57.460417  2543 consensus_queue.cc:260] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.462834  2543 ts_tablet_manager.cc:1434] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:12:57.463925  2543 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
W20260709 13:12:57.466121  2240 consensus_peers.cc:597] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 -> Peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Couldn't send request to peer 7d612b55885c4aee87952bd05925f03b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:57.467226  2544 tablet_bootstrap.cc:654] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.467603  2542 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:57.468101  2542 ts_tablet_manager.cc:1403] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.004s
I20260709 13:12:57.456985  2274 raft_consensus.cc:2468] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:57.470953  2542 raft_consensus.cc:359] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.471757  2542 raft_consensus.cc:385] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.472028  2542 raft_consensus.cc:740] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.472798  2542 consensus_queue.cc:260] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.475389  2542 ts_tablet_manager.cc:1434] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:57.476476  2542 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.477772  2543 tablet_bootstrap.cc:654] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.482100  2548 raft_consensus.cc:493] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.482682  2548 raft_consensus.cc:515] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.484115  2541 tablet_bootstrap.cc:654] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.484957  2548 leader_election.cc:290] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:57.487053  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6df690111e402c94e06d82cb995e45" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:12:57.488711  2315 leader_election.cc:343] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.489557  2544 tablet_bootstrap.cc:492] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:57.455174  2561 raft_consensus.cc:697] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:12:57.490335  2544 ts_tablet_manager.cc:1403] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.008s
I20260709 13:12:57.490885  2561 consensus_queue.cc:237] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.492660  2541 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:57.493162  2541 ts_tablet_manager.cc:1403] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 13:12:57.493491  2544 raft_consensus.cc:359] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.489900  2313 leader_election.cc:304] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: e98dadf6176848ef8893b68c45629066
I20260709 13:12:57.495126  2548 raft_consensus.cc:2804] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.489979  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6df690111e402c94e06d82cb995e45" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.496136  2541 raft_consensus.cc:359] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.496363  2423 raft_consensus.cc:2468] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:57.496878  2541 raft_consensus.cc:385] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.497211  2541 raft_consensus.cc:740] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.497903  2541 consensus_queue.cc:260] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.498087  2315 leader_election.cc:304] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:12:57.500319  2599 raft_consensus.cc:515] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.494279  2544 raft_consensus.cc:385] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.504319  2544 raft_consensus.cc:740] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.505270  2544 consensus_queue.cc:260] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.507908  2544 ts_tablet_manager.cc:1434] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:57.488871  2542 tablet_bootstrap.cc:654] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.510736  2544 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:57.514787  2616 raft_consensus.cc:2804] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.515367  2616 raft_consensus.cc:493] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.515717  2616 raft_consensus.cc:3060] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.531303  2544 tablet_bootstrap.cc:654] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.530489  2172 catalog_manager.cc:5697] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.535941  2541 ts_tablet_manager.cc:1434] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.042s	user 0.014s	sys 0.014s
I20260709 13:12:57.536818  2541 tablet_bootstrap.cc:492] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:57.540843  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572f21ffe3d5423ab1708c3718752308" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:57.541522  2423 raft_consensus.cc:3060] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.546200  2616 raft_consensus.cc:515] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.549467  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6df690111e402c94e06d82cb995e45" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:57.551331  2616 leader_election.cc:290] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:57.552150  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "572f21ffe3d5423ab1708c3718752308" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:57.555657  2561 consensus_queue.cc:1048] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:57.557610  2274 raft_consensus.cc:3060] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.550829  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6df690111e402c94e06d82cb995e45" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:57.551314  2599 leader_election.cc:290] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:57.550289  2543 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
W20260709 13:12:57.565827  2315 leader_election.cc:343] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.566560  2543 ts_tablet_manager.cc:1403] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.006s
I20260709 13:12:57.569716  2543 raft_consensus.cc:359] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.570696  2543 raft_consensus.cc:385] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.570989  2543 raft_consensus.cc:740] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.562837  2548 raft_consensus.cc:697] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:57.556892  2422 raft_consensus.cc:3060] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.573345  2543 consensus_queue.cc:260] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.575850  2548 consensus_queue.cc:237] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.585592  2586 raft_consensus.cc:493] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.586328  2586 raft_consensus.cc:515] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.587224  2423 raft_consensus.cc:2468] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:57.588824  2315 leader_election.cc:304] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:57.589398  2543 ts_tablet_manager.cc:1434] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:12:57.589912  2615 raft_consensus.cc:2804] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.590482  2543 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:57.590701  2615 raft_consensus.cc:697] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:57.591606  2615 consensus_queue.cc:237] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.597411  2422 raft_consensus.cc:2468] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:57.598919  2315 leader_election.cc:304] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:12:57.599459  2541 tablet_bootstrap.cc:654] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.600198  2599 raft_consensus.cc:2804] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.600827  2599 raft_consensus.cc:697] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:57.597292  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb1d997d66d411b9175baf01eba5527" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:57.604676  2273 raft_consensus.cc:2468] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:57.605710  2586 leader_election.cc:290] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:57.595623  2274 raft_consensus.cc:2468] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:57.606309  2599 consensus_queue.cc:237] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.606937  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb1d997d66d411b9175baf01eba5527" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:57.607605  2461 leader_election.cc:304] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:12:57.608193  2542 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:57.608703  2542 ts_tablet_manager.cc:1403] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.132s	user 0.026s	sys 0.026s
W20260709 13:12:57.609952  2460 leader_election.cc:343] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.611512  2542 raft_consensus.cc:359] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.612215  2542 raft_consensus.cc:385] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.612485  2542 raft_consensus.cc:740] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.613165  2542 consensus_queue.cc:260] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.614274  2594 raft_consensus.cc:2804] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.614725  2594 raft_consensus.cc:493] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.615077  2594 raft_consensus.cc:3060] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.614951  2170 catalog_manager.cc:5697] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.621594  2542 ts_tablet_manager.cc:1434] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:12:57.622731  2542 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.632827  2421 raft_consensus.cc:3060] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.634572  2543 tablet_bootstrap.cc:654] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.646044  2544 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:57.646718  2544 ts_tablet_manager.cc:1403] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.018s
I20260709 13:12:57.654419  2553 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.655022  2553 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.655774  2594 raft_consensus.cc:515] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.659961  2553 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:57.660585  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb1d997d66d411b9175baf01eba5527" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:57.661103  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:57.661311  2274 raft_consensus.cc:3060] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.659950  2615 raft_consensus.cc:493] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.670892  2615 raft_consensus.cc:515] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.671501  2544 raft_consensus.cc:359] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.672318  2544 raft_consensus.cc:385] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.672585  2544 raft_consensus.cc:740] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.673169  2615 leader_election.cc:290] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:57.674122  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:57.675160  2599 raft_consensus.cc:493] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.696969  2553 raft_consensus.cc:493] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.697221  2599 raft_consensus.cc:515] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.676831  2544 consensus_queue.cc:260] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.677577  2272 raft_consensus.cc:2468] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:57.678574  2594 leader_election.cc:290] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:57.690177  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb1d997d66d411b9175baf01eba5527" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:57.701282  2599 leader_election.cc:290] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
W20260709 13:12:57.701570  2460 leader_election.cc:343] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.673693  2170 catalog_manager.cc:5697] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.698660  2541 tablet_bootstrap.cc:492] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:57.692045  2542 tablet_bootstrap.cc:654] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.703418  2553 raft_consensus.cc:515] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.704878  2541 ts_tablet_manager.cc:1403] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.168s	user 0.018s	sys 0.008s
I20260709 13:12:57.706277  2543 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:57.706720  2543 ts_tablet_manager.cc:1403] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.003s
I20260709 13:12:57.712092  2553 leader_election.cc:290] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:57.711553  2170 catalog_manager.cc:5697] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.707067  2313 leader_election.cc:304] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:57.712344  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d57bcd5dc1f4559959b6af08f31e9ad" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:57.713132  2497 raft_consensus.cc:2468] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:57.715555  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.716262  2422 raft_consensus.cc:2468] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:57.718956  2541 raft_consensus.cc:359] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.719653  2541 raft_consensus.cc:385] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.707371  2624 raft_consensus.cc:493] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.725178  2624 raft_consensus.cc:515] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.726877  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:57.722179  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d57bcd5dc1f4559959b6af08f31e9ad" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:57.722401  2594 consensus_queue.cc:1048] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.728084  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.728768  2422 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
W20260709 13:12:57.729128  2313 leader_election.cc:343] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.730122  2586 consensus_queue.cc:1048] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.727589  2497 raft_consensus.cc:2468] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:12:57.730266  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:57.726527  2543 raft_consensus.cc:359] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.731489  2543 raft_consensus.cc:385] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.731401  2240 leader_election.cc:304] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:57.732419  2581 raft_consensus.cc:2804] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.732808  2581 raft_consensus.cc:493] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.732726  2389 leader_election.cc:304] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:57.733362  2581 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.733853  2599 raft_consensus.cc:2804] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.734294  2599 raft_consensus.cc:493] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.734625  2599 raft_consensus.cc:3060] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.727530  2624 leader_election.cc:290] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:57.730780  2274 raft_consensus.cc:2468] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:57.736370  2553 raft_consensus.cc:2804] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:57.736816  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:57.737141  2553 raft_consensus.cc:493] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.737596  2553 raft_consensus.cc:3060] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.738516  2461 leader_election.cc:304] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10
I20260709 13:12:57.740343  2541 raft_consensus.cc:740] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.731976  2543 raft_consensus.cc:740] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.744611  2543 consensus_queue.cc:260] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.754580  2541 consensus_queue.cc:260] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.753000  2496 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:57.752993  2586 raft_consensus.cc:2804] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.758455  2586 raft_consensus.cc:697] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:12:57.761723  2631 raft_consensus.cc:493] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.762545  2631 raft_consensus.cc:515] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.766664  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:57.771132  2599 raft_consensus.cc:515] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.774513  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:57.775218  2586 consensus_queue.cc:237] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.782744  2541 ts_tablet_manager.cc:1434] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.000s
I20260709 13:12:57.783898  2561 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.775224  2274 raft_consensus.cc:3060] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.784237  2541 tablet_bootstrap.cc:492] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:57.789234  2544 ts_tablet_manager.cc:1434] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.142s	user 0.016s	sys 0.008s
I20260709 13:12:57.791360  2544 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:57.759311  2315 leader_election.cc:304] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:57.787918  2631 leader_election.cc:290] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:57.790088  2561 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:12:57.807075  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 57864.1us
I20260709 13:12:57.807411  2561 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:57.794122  2553 raft_consensus.cc:515] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.808910  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:57.809604  2348 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:57.809890  2553 leader_election.cc:290] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:57.810331  2542 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:57.810889  2542 ts_tablet_manager.cc:1403] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.019s
I20260709 13:12:57.807731  2615 raft_consensus.cc:2804] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.814437  2237 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:57.814903  2615 raft_consensus.cc:493] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.815454  2615 raft_consensus.cc:3060] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.816895  2561 raft_consensus.cc:2804] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:57.817327  2561 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:57.817673  2561 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.814468  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:57.819937  2497 raft_consensus.cc:3060] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.819720  2581 raft_consensus.cc:515] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.822450  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:57.823108  2423 raft_consensus.cc:3060] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.812521  2599 leader_election.cc:290] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:57.813148  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:12:57.829667  2240 leader_election.cc:343] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.830097  2586 raft_consensus.cc:493] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:57.830660  2586 raft_consensus.cc:515] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.832064  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:57.832787  2496 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.835898  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:57.836337  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:57.836977  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:57.838070  2586 leader_election.cc:290] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:57.836115  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:57.844888  2348 raft_consensus.cc:2393] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 in current term 1: Already voted for candidate b87f37ab7e614ece80499e3f25bc9ea3 in this term.
W20260709 13:12:57.838364  2386 leader_election.cc:343] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.840301  2581 leader_election.cc:290] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:57.838268  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:12:57.853077  2461 leader_election.cc:343] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.855857  2541 tablet_bootstrap.cc:654] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.859301  2496 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:57.851045  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:57.861575  2420 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.864439  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:57.867888  2497 raft_consensus.cc:2468] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:12:57.848973  2543 ts_tablet_manager.cc:1434] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.142s	user 0.006s	sys 0.020s
W20260709 13:12:57.851531  2386 leader_election.cc:343] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:57.853546  2542 raft_consensus.cc:359] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.871798  2542 raft_consensus.cc:385] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:57.872175  2542 raft_consensus.cc:740] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:57.873581  2543 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:57.876856  2495 raft_consensus.cc:3060] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.876456  2542 consensus_queue.cc:260] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.879235  2542 ts_tablet_manager.cc:1434] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:12:57.881131  2420 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:57.882686  2240 leader_election.cc:304] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:57.883329  2274 raft_consensus.cc:2468] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:57.884809  2313 leader_election.cc:304] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:57.885735  2599 raft_consensus.cc:2804] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.886245  2599 raft_consensus.cc:697] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:57.886497  2632 raft_consensus.cc:2804] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.887118  2632 raft_consensus.cc:697] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:12:57.887643  2561 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.888131  2632 consensus_queue.cc:237] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:57.888645  2389 leader_election.cc:304] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: cf33d724fb704d85ab3127e566123c10
I20260709 13:12:57.889735  2640 raft_consensus.cc:2804] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.890291  2640 raft_consensus.cc:697] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:12:57.884342  2172 catalog_manager.cc:5697] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.890573  2544 tablet_bootstrap.cc:654] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:57.891147  2640 consensus_queue.cc:237] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:57.892498  2423 raft_consensus.cc:2468] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:57.895510  2542 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:57.887042  2599 consensus_queue.cc:237] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:57.904670  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:57.898617  2561 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
W20260709 13:12:57.900655  2386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 49178.7us
I20260709 13:12:57.899750  2615 raft_consensus.cc:515] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.924639  2386 leader_election.cc:304] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:12:57.905885  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:57.940357  2642 raft_consensus.cc:2749] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:57.935814  2348 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:57.952957  2348 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:57.954113  2237 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:57.955339  2561 raft_consensus.cc:2804] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:57.955847  2561 raft_consensus.cc:697] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:12:57.956681  2561 consensus_queue.cc:237] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:57.960083  2542 tablet_bootstrap.cc:654] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:57.916312  2460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 89968.6us
W20260709 13:12:57.963824  2240 leader_election.cc:343] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:57.976598  2386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 52099.8us
I20260709 13:12:57.991421  2544 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:57.992090  2544 ts_tablet_manager.cc:1403] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.014s
I20260709 13:12:57.997586  2172 catalog_manager.cc:5697] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.002192  2632 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.002761  2632 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.005740  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.005143  2170 catalog_manager.cc:5697] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.006596  2422 raft_consensus.cc:2393] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:12:58.007730  2541 tablet_bootstrap.cc:492] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:58.008216  2541 ts_tablet_manager.cc:1403] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.224s	user 0.005s	sys 0.030s
I20260709 13:12:58.008570  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d57bcd5dc1f4559959b6af08f31e9ad" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:58.009258  2495 raft_consensus.cc:3060] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.009631  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.010485  2496 raft_consensus.cc:2393] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:12:58.014350  2541 raft_consensus.cc:359] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.014478  2240 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:12:58.015161  2541 raft_consensus.cc:385] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.015641  2581 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.015583  2561 consensus_queue.cc:1048] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.018916  2495 raft_consensus.cc:2468] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:58.020232  2315 leader_election.cc:304] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:58.016037  2544 raft_consensus.cc:359] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.021773  2544 raft_consensus.cc:385] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.016187  2541 raft_consensus.cc:740] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.023471  2541 consensus_queue.cc:260] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.025426  2548 raft_consensus.cc:2804] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.025996  2548 raft_consensus.cc:697] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:58.022078  2544 raft_consensus.cc:740] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.027069  2541 ts_tablet_manager.cc:1434] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.007s
I20260709 13:12:58.026826  2548 consensus_queue.cc:237] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.027555  2544 consensus_queue.cc:260] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.028056  2541 tablet_bootstrap.cc:492] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:58.031234  2581 raft_consensus.cc:2749] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.016043  2169 catalog_manager.cc:5697] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.029774  2544 ts_tablet_manager.cc:1434] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.005s
I20260709 13:12:58.041191  2544 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.043272  2543 tablet_bootstrap.cc:654] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.052021  2172 catalog_manager.cc:5697] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.996783  2386 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:12:58.062510  2640 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:58.062700  2386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 68222.8us
W20260709 13:12:58.064142  2463 leader_election.cc:343] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.064688  2463 leader_election.cc:304] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:12:58.067000  2644 raft_consensus.cc:2749] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.070539  2616 consensus_queue.cc:1048] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.039415  2632 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.079403  2616 raft_consensus.cc:493] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.079954  2616 raft_consensus.cc:515] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.083516  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.084322  2495 raft_consensus.cc:2393] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:12:58.085697  2616 leader_election.cc:290] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.092216  2615 leader_election.cc:290] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:58.092455  2616 consensus_queue.cc:1048] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.093430  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d57bcd5dc1f4559959b6af08f31e9ad" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:58.091085  2544 tablet_bootstrap.cc:654] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:58.097397  2313 leader_election.cc:343] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.103224  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "500e7e1147774338aa8067755a8dfcb0" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.103560  2542 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:58.113852  2542 ts_tablet_manager.cc:1403] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.219s	user 0.012s	sys 0.006s
I20260709 13:12:58.117326  2315 leader_election.cc:304] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:12:58.119518  2616 raft_consensus.cc:3060] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.120533  2640 raft_consensus.cc:2749] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.139253  2543 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:58.140044  2543 ts_tablet_manager.cc:1403] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.267s	user 0.013s	sys 0.004s
I20260709 13:12:58.140383  2541 tablet_bootstrap.cc:654] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.141173  2615 consensus_queue.cc:1048] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.143299  2640 raft_consensus.cc:493] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.143846  2624 consensus_queue.cc:1048] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.143833  2640 raft_consensus.cc:515] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.147831  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:12:58.149371  2389 leader_election.cc:343] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.151822  2543 raft_consensus.cc:359] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.152663  2543 raft_consensus.cc:385] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.153568  2640 leader_election.cc:290] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:58.154248  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:58.155295  2548 consensus_queue.cc:1048] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:58.156373  2387 leader_election.cc:343] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.156920  2387 leader_election.cc:304] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:58.155067  2543 raft_consensus.cc:740] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.158074  2543 consensus_queue.cc:260] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.158890  2640 raft_consensus.cc:2749] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.160148  2543 ts_tablet_manager.cc:1434] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:12:58.161610  2548 raft_consensus.cc:493] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:58.162063  2315 consensus_peers.cc:597] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.162179  2548 raft_consensus.cc:515] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.163432  2544 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.164281  2544 ts_tablet_manager.cc:1403] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.009s
I20260709 13:12:58.169209  2544 raft_consensus.cc:359] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.172029  2544 raft_consensus.cc:385] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.172405  2544 raft_consensus.cc:740] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.170308  2542 raft_consensus.cc:359] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.173264  2542 raft_consensus.cc:385] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.173602  2542 raft_consensus.cc:740] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.174356  2542 consensus_queue.cc:260] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.171675  2543 tablet_bootstrap.cc:492] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:58.179569  2542 ts_tablet_manager.cc:1434] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:12:58.175282  2544 consensus_queue.cc:260] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.164417  2548 leader_election.cc:290] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.189929  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda6016d742d427295ff961579eb0adc" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.191265  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda6016d742d427295ff961579eb0adc" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.195814  2544 ts_tablet_manager.cc:1434] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.003s
I20260709 13:12:58.197094  2542 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
W20260709 13:12:58.197458  2315 leader_election.cc:343] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:58.199542  2315 consensus_peers.cc:597] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 -> Peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Couldn't send request to peer 7d612b55885c4aee87952bd05925f03b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:58.200058  2315 leader_election.cc:343] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.200381  2315 leader_election.cc:304] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:12:58.200979  2548 raft_consensus.cc:2749] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.197713  2544 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.202068  2543 tablet_bootstrap.cc:654] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.207219  2544 tablet_bootstrap.cc:654] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.204628  2541 tablet_bootstrap.cc:492] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:58.208264  2541 ts_tablet_manager.cc:1403] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.180s	user 0.023s	sys 0.020s
I20260709 13:12:58.211315  2541 raft_consensus.cc:359] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.215688  2541 raft_consensus.cc:385] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.216030  2541 raft_consensus.cc:740] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.217059  2542 tablet_bootstrap.cc:654] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.217902  2636 consensus_queue.cc:1048] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.215055  2616 raft_consensus.cc:2749] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.219913  2541 consensus_queue.cc:260] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.227612  2543 tablet_bootstrap.cc:492] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:58.227569  2636 raft_consensus.cc:493] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.228366  2543 ts_tablet_manager.cc:1403] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.004s
I20260709 13:12:58.228338  2636 raft_consensus.cc:515] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.231559  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:12:58.233492  2461 leader_election.cc:343] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.238092  2544 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.238631  2544 ts_tablet_manager.cc:1403] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.022s
I20260709 13:12:58.240202  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:58.241468  2544 raft_consensus.cc:359] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
W20260709 13:12:58.241866  2460 leader_election.cc:343] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.242268  2544 raft_consensus.cc:385] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.242440  2541 ts_tablet_manager.cc:1434] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.002s
I20260709 13:12:58.242624  2544 raft_consensus.cc:740] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.231539  2543 raft_consensus.cc:359] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.240031  2170 catalog_manager.cc:5697] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.243539  2544 consensus_queue.cc:260] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.244866  2541 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:58.245992  2544 ts_tablet_manager.cc:1434] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:58.247028  2544 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.243577  2543 raft_consensus.cc:385] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.242395  2460 leader_election.cc:304] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:12:58.250906  2543 raft_consensus.cc:740] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.252162  2644 raft_consensus.cc:2749] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.252946  2544 tablet_bootstrap.cc:654] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.252853  2543 consensus_queue.cc:260] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.255277  2543 ts_tablet_manager.cc:1434] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:12:58.256556  2636 leader_election.cc:290] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:58.260516  2542 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:58.261243  2542 ts_tablet_manager.cc:1403] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.003s
I20260709 13:12:58.264655  2542 raft_consensus.cc:359] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:12:58.265285  2460 consensus_peers.cc:597] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.265574  2542 raft_consensus.cc:385] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.265964  2542 raft_consensus.cc:740] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.267139  2542 consensus_queue.cc:260] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.269768  2542 ts_tablet_manager.cc:1434] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:12:58.270965  2542 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:58.273305  2541 tablet_bootstrap.cc:654] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.277951  2542 tablet_bootstrap.cc:654] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.299899  2541 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:58.301046  2541 ts_tablet_manager.cc:1403] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.005s
I20260709 13:12:58.303902  2541 raft_consensus.cc:359] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.304760  2541 raft_consensus.cc:385] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.305075  2541 raft_consensus.cc:740] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.305895  2541 consensus_queue.cc:260] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.309640  2541 ts_tablet_manager.cc:1434] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:12:58.310700  2541 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:58.310935  2542 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:58.316087  2542 ts_tablet_manager.cc:1403] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.008s
I20260709 13:12:58.317180  2541 tablet_bootstrap.cc:654] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.320786  2640 consensus_queue.cc:1048] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.323418  2543 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:58.332499  2542 raft_consensus.cc:359] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.333221  2542 raft_consensus.cc:385] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.333505  2542 raft_consensus.cc:740] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.334196  2542 consensus_queue.cc:260] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.334813  2541 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:58.335384  2541 ts_tablet_manager.cc:1403] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.007s
I20260709 13:12:58.338404  2541 raft_consensus.cc:359] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.339160  2541 raft_consensus.cc:385] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.339346  2543 tablet_bootstrap.cc:654] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.339599  2541 raft_consensus.cc:740] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.340274  2544 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.340866  2544 ts_tablet_manager.cc:1403] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.094s	user 0.042s	sys 0.040s
I20260709 13:12:58.340451  2541 consensus_queue.cc:260] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.342753  2541 ts_tablet_manager.cc:1434] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:12:58.342978  2542 ts_tablet_manager.cc:1434] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:12:58.343748  2541 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:58.344447  2544 raft_consensus.cc:359] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.345187  2544 raft_consensus.cc:385] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.345516  2544 raft_consensus.cc:740] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.346415  2544 consensus_queue.cc:260] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.348997  2544 ts_tablet_manager.cc:1434] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:58.350073  2541 tablet_bootstrap.cc:654] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.350896  2544 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.351727  2664 consensus_queue.cc:1048] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.357439  2544 tablet_bootstrap.cc:654] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.362205  2542 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:58.369038  2624 consensus_queue.cc:1048] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.371341  2632 consensus_queue.cc:1048] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.375890  2642 consensus_queue.cc:1048] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.377434  2642 raft_consensus.cc:493] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.377980  2642 raft_consensus.cc:515] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.382015  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.382805  2495 raft_consensus.cc:2468] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:12:58.382099  2642 leader_election.cc:290] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:58.382017  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:12:58.385192  2387 leader_election.cc:343] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.386011  2389 leader_election.cc:304] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:58.387176  2642 raft_consensus.cc:2804] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.387578  2642 raft_consensus.cc:493] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.387907  2642 raft_consensus.cc:3060] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.396929  2632 raft_consensus.cc:493] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.397600  2632 raft_consensus.cc:515] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.399587  2624 consensus_queue.cc:1048] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.402163  2632 leader_election.cc:290] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:58.403017  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:12:58.404563  2237 leader_election.cc:343] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.408834  2642 raft_consensus.cc:515] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.409883  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.411820  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:58.412461  2495 raft_consensus.cc:3060] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:58.413110  2240 leader_election.cc:343] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.413770  2240 leader_election.cc:304] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:12:58.430935  2624 raft_consensus.cc:2749] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.420083  2495 raft_consensus.cc:2468] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:12:58.427502  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:58.428576  2642 leader_election.cc:290] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
W20260709 13:12:58.435590  2240 consensus_peers.cc:597] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 -> Peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Couldn't send request to peer 7d612b55885c4aee87952bd05925f03b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:58.429224  2542 tablet_bootstrap.cc:654] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:58.437076  2387 leader_election.cc:343] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.437852  2389 leader_election.cc:304] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:58.443748  2543 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:58.444375  2543 ts_tablet_manager.cc:1403] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.121s	user 0.008s	sys 0.002s
I20260709 13:12:58.448047  2543 raft_consensus.cc:359] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.448773  2543 raft_consensus.cc:385] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.449034  2543 raft_consensus.cc:740] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.449710  2553 raft_consensus.cc:2804] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.450350  2553 raft_consensus.cc:697] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:12:58.451251  2553 consensus_queue.cc:237] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.453212  2543 consensus_queue.cc:260] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.468082  2548 consensus_queue.cc:1048] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.476377  2543 ts_tablet_manager.cc:1434] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:12:58.477502  2543 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:58.484284  2272 raft_consensus.cc:3060] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.492393  2543 tablet_bootstrap.cc:654] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.498211  2541 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:58.499006  2541 ts_tablet_manager.cc:1403] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.155s	user 0.042s	sys 0.051s
I20260709 13:12:58.499917  2544 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.505609  2544 ts_tablet_manager.cc:1403] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.155s	user 0.027s	sys 0.022s
I20260709 13:12:58.506104  2548 consensus_queue.cc:1048] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.501204  2170 catalog_manager.cc:5697] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.501775  2541 raft_consensus.cc:359] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.507185  2541 raft_consensus.cc:385] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.507805  2542 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:58.508289  2542 ts_tablet_manager.cc:1403] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.003s
I20260709 13:12:58.507632  2541 raft_consensus.cc:740] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.512169  2541 consensus_queue.cc:260] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.516214  2544 raft_consensus.cc:359] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.516981  2544 raft_consensus.cc:385] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.517266  2544 raft_consensus.cc:740] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.517953  2544 consensus_queue.cc:260] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.519979  2544 ts_tablet_manager.cc:1434] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.002s
I20260709 13:12:58.520902  2544 tablet_bootstrap.cc:492] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.522876  2541 ts_tablet_manager.cc:1434] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:12:58.523965  2541 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:58.529618  2544 tablet_bootstrap.cc:654] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.530561  2541 tablet_bootstrap.cc:654] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.533382  2542 raft_consensus.cc:359] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.534056  2542 raft_consensus.cc:385] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.534272  2542 raft_consensus.cc:740] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.534942  2542 consensus_queue.cc:260] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.535435  2543 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:58.536079  2543 ts_tablet_manager.cc:1403] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.016s
I20260709 13:12:58.539578  2543 raft_consensus.cc:359] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.540283  2543 raft_consensus.cc:385] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.540303  2542 ts_tablet_manager.cc:1434] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:12:58.541563  2542 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:58.540627  2543 raft_consensus.cc:740] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.544224  2543 consensus_queue.cc:260] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.550366  2544 tablet_bootstrap.cc:492] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.550907  2544 ts_tablet_manager.cc:1403] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.001s
I20260709 13:12:58.553609  2544 raft_consensus.cc:359] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.554296  2544 raft_consensus.cc:385] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.554560  2544 raft_consensus.cc:740] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.555202  2544 consensus_queue.cc:260] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.559413  2544 ts_tablet_manager.cc:1434] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:58.559860  2543 ts_tablet_manager.cc:1434] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:58.560367  2544 tablet_bootstrap.cc:492] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.559443  2624 raft_consensus.cc:493] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.564337  2541 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:58.564967  2541 ts_tablet_manager.cc:1403] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.016s
I20260709 13:12:58.567312  2544 tablet_bootstrap.cc:654] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.567901  2541 raft_consensus.cc:359] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.568706  2541 raft_consensus.cc:385] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.569041  2541 raft_consensus.cc:740] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.570079  2541 consensus_queue.cc:260] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.572588  2541 ts_tablet_manager.cc:1434] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:58.573704  2541 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:58.578034  2664 raft_consensus.cc:493] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.578794  2544 tablet_bootstrap.cc:492] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.578585  2664 raft_consensus.cc:515] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.579308  2544 ts_tablet_manager.cc:1403] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:12:58.579949  2541 tablet_bootstrap.cc:654] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.580906  2664 leader_election.cc:290] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:58.582168  2544 raft_consensus.cc:359] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.582684  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:58.587246  2544 raft_consensus.cc:385] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.587617  2544 raft_consensus.cc:740] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.588299  2544 consensus_queue.cc:260] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
W20260709 13:12:58.588531  2313 leader_election.cc:343] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.585345  2543 tablet_bootstrap.cc:492] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:58.590479  2544 ts_tablet_manager.cc:1434] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:58.591243  2544 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.595665  2544 tablet_bootstrap.cc:654] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.598230  2543 tablet_bootstrap.cc:654] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.602010  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.602769  2495 raft_consensus.cc:2468] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:58.604403  2541 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:58.604689  2599 consensus_queue.cc:1048] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:58.604977  2541 ts_tablet_manager.cc:1403] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.004s
I20260709 13:12:58.608210  2541 raft_consensus.cc:359] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.609136  2541 raft_consensus.cc:385] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.611636  2541 raft_consensus.cc:740] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.612427  2541 consensus_queue.cc:260] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.611310  2543 tablet_bootstrap.cc:492] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:58.613633  2543 ts_tablet_manager.cc:1403] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.001s
I20260709 13:12:58.563741  2624 raft_consensus.cc:515] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.615876  2624 leader_election.cc:290] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:58.617273  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.618018  2422 raft_consensus.cc:2468] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:58.619326  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:58.619490  2240 leader_election.cc:304] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:58.620039  2347 raft_consensus.cc:2468] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:58.620671  2664 raft_consensus.cc:493] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.621176  2664 raft_consensus.cc:515] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.622210  2543 raft_consensus.cc:359] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.622972  2543 raft_consensus.cc:385] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.623230  2543 raft_consensus.cc:740] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.623524  2544 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.624239  2544 ts_tablet_manager.cc:1403] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.012s
I20260709 13:12:58.623847  2543 consensus_queue.cc:260] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.626380  2599 raft_consensus.cc:493] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.626921  2599 raft_consensus.cc:515] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.629966  2599 leader_election.cc:290] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:58.630373  2543 ts_tablet_manager.cc:1434] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:58.629081  2544 raft_consensus.cc:359] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.631146  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb1d997d66d411b9175baf01eba5527" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:58.635725  2494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb1d997d66d411b9175baf01eba5527" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.646080  2636 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.667428  2544 raft_consensus.cc:385] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.668601  2544 raft_consensus.cc:740] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.637775  2624 raft_consensus.cc:2804] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.631363  2543 tablet_bootstrap.cc:492] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:58.668421  2636 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.623445  2664 leader_election.cc:290] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.670077  2624 raft_consensus.cc:493] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.633802  2315 leader_election.cc:304] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:58.670522  2544 consensus_queue.cc:260] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.671725  2624 raft_consensus.cc:3060] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.672546  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:58.673025  2616 raft_consensus.cc:2804] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.672956  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:58.673565  2616 raft_consensus.cc:493] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.674013  2616 raft_consensus.cc:3060] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.674986  2460 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:12:58.675940  2644 raft_consensus.cc:2749] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.676721  2636 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:58.681910  2624 raft_consensus.cc:515] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.683563  2543 tablet_bootstrap.cc:654] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.684939  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:58.631762  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.685599  2347 raft_consensus.cc:3060] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.676858  2544 ts_tablet_manager.cc:1434] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.010s
I20260709 13:12:58.686995  2544 tablet_bootstrap.cc:492] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.632588  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.688829  2421 raft_consensus.cc:2468] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:58.632265  2495 raft_consensus.cc:3060] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.693941  2544 tablet_bootstrap.cc:654] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.695497  2543 tablet_bootstrap.cc:492] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:58.696121  2543 ts_tablet_manager.cc:1403] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.002s
I20260709 13:12:58.696518  2347 raft_consensus.cc:2468] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:58.698024  2237 leader_election.cc:304] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:58.699172  2632 raft_consensus.cc:2804] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.699676  2632 raft_consensus.cc:697] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:12:58.700033  2543 raft_consensus.cc:359] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.700491  2632 consensus_queue.cc:237] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.700966  2543 raft_consensus.cc:385] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.701354  2543 raft_consensus.cc:740] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.701727  2599 raft_consensus.cc:493] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.635030  2422 raft_consensus.cc:3060] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.702226  2599 raft_consensus.cc:515] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.702421  2543 consensus_queue.cc:260] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.705040  2599 leader_election.cc:290] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:58.707604  2543 ts_tablet_manager.cc:1434] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:58.721951  2640 raft_consensus.cc:493] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.722616  2543 tablet_bootstrap.cc:492] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:58.722576  2640 raft_consensus.cc:515] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.722281  2496 raft_consensus.cc:2468] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:58.726082  2640 leader_election.cc:290] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:58.726142  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:58.726986  2272 raft_consensus.cc:2468] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:12:58.727656  2581 raft_consensus.cc:493] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.728232  2581 raft_consensus.cc:515] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.728967  2387 leader_election.cc:304] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:58.730118  2543 tablet_bootstrap.cc:654] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.730655  2541 ts_tablet_manager.cc:1434] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.000s
I20260709 13:12:58.731659  2541 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:58.734304  2581 leader_election.cc:290] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.737100  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.737469  2640 raft_consensus.cc:2804] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.737980  2640 raft_consensus.cc:493] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.738332  2640 raft_consensus.cc:3060] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.738765  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.739565  2420 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:58.740918  2240 leader_election.cc:304] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:58.742041  2561 raft_consensus.cc:2804] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.742475  2561 raft_consensus.cc:493] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.742841  2561 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.743192  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:58.743853  2421 raft_consensus.cc:3060] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.746434  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:12:58.747906  2313 leader_election.cc:343] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.748540  2599 raft_consensus.cc:493] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:58.748824  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:58.754818  2599 raft_consensus.cc:515] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.757944  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:58.758709  2272 raft_consensus.cc:2468] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:12:58.760229  2313 leader_election.cc:304] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:58.761157  2615 raft_consensus.cc:2804] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.761610  2615 raft_consensus.cc:493] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.762008  2615 raft_consensus.cc:3060] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.768714  2561 raft_consensus.cc:515] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.726900  2616 raft_consensus.cc:515] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.772183  2616 leader_election.cc:290] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:58.778438  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:12:58.780241  2313 leader_election.cc:343] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.784778  2615 raft_consensus.cc:515] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.788090  2315 leader_election.cc:304] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:58.788678  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:12:58.789494  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 73714.4us
I20260709 13:12:58.791705  2494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:58.792336  2494 raft_consensus.cc:3060] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.792215  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:58.789446  2272 raft_consensus.cc:3060] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.793437  2347 raft_consensus.cc:2393] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:12:58.792454  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.797456  2347 raft_consensus.cc:3060] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.738003  2496 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:12:58.801518  2541 tablet_bootstrap.cc:654] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.803395  2640 raft_consensus.cc:515] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.806105  2624 leader_election.cc:290] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:58.807479  2599 leader_election.cc:290] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:58.792166  2315 leader_election.cc:304] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:58.809986  2494 raft_consensus.cc:2468] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:58.809851  2548 raft_consensus.cc:2804] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:58.810923  2548 raft_consensus.cc:493] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:58.811295  2548 raft_consensus.cc:3060] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.819271  2315 leader_election.cc:304] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:58.820456  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:58.821079  2420 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.821491  2548 raft_consensus.cc:515] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.825160  2616 raft_consensus.cc:2804] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.826407  2616 raft_consensus.cc:697] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:58.827255  2616 consensus_queue.cc:237] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.829108  2420 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:58.829540  2548 leader_election.cc:290] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.832576  2542 tablet_bootstrap.cc:654] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.835032  2553 raft_consensus.cc:493] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf33d724fb704d85ab3127e566123c10)
I20260709 13:12:58.835592  2553 raft_consensus.cc:515] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.830845  2615 leader_election.cc:290] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:58.831453  2240 leader_election.cc:304] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:58.845578  2632 raft_consensus.cc:2804] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.846189  2632 raft_consensus.cc:697] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:12:58.846527  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:58.847474  2561 leader_election.cc:290] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.847131  2632 consensus_queue.cc:237] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:58.848363  2553 leader_election.cc:290] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:58.848696  2494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:58.849309  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32dce47c7bca4ca9867196d40543c2a9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:58.849318  2494 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.849542  2171 catalog_manager.cc:5697] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:58.857581  2272 raft_consensus.cc:2468] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:58.861409  2313 leader_election.cc:304] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:58.862324  2615 raft_consensus.cc:2804] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.862825  2615 raft_consensus.cc:697] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:58.863899  2615 consensus_queue.cc:237] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:58.866417  2494 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:58.859164  2421 raft_consensus.cc:2468] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:12:58.892036  2636 raft_consensus.cc:493] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf33d724fb704d85ab3127e566123c10)
I20260709 13:12:58.892642  2636 raft_consensus.cc:515] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.893114  2543 tablet_bootstrap.cc:492] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:58.894632  2543 ts_tablet_manager.cc:1403] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.172s	user 0.023s	sys 0.030s
I20260709 13:12:58.897737  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6df690111e402c94e06d82cb995e45" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:58.898437  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:58.899065  2422 raft_consensus.cc:3060] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:58.902015  2315 leader_election.cc:343] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:58.902263  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:58.902565  2315 leader_election.cc:304] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:12:58.897356  2543 raft_consensus.cc:359] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.904469  2543 raft_consensus.cc:385] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.904760  2543 raft_consensus.cc:740] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.903590  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32dce47c7bca4ca9867196d40543c2a9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:58.905440  2543 consensus_queue.cc:260] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.903486  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6df690111e402c94e06d82cb995e45" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:58.912268  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:58.918222  2496 raft_consensus.cc:3060] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.911195  2548 raft_consensus.cc:2749] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.920367  2542 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:58.920902  2542 ts_tablet_manager.cc:1403] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.380s	user 0.019s	sys 0.000s
I20260709 13:12:58.921937  2463 leader_election.cc:304] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:12:58.924793  2543 ts_tablet_manager.cc:1434] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:12:58.890666  2640 leader_election.cc:290] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:58.906530  2636 leader_election.cc:290] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:58.930580  2172 catalog_manager.cc:5697] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:58.931792  2386 leader_election.cc:304] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:12:58.933387  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:58.933758  2642 raft_consensus.cc:2749] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.934717  2543 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:58.935873  2544 tablet_bootstrap.cc:492] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:58.936383  2544 ts_tablet_manager.cc:1403] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.250s	user 0.007s	sys 0.006s
I20260709 13:12:58.928422  2664 raft_consensus.cc:2749] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:58.933131  2386 leader_election.cc:304] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:12:58.941445  2543 tablet_bootstrap.cc:654] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.941787  2642 raft_consensus.cc:2749] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.946270  2420 raft_consensus.cc:2393] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:12:58.929589  2706 raft_consensus.cc:2749] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:58.947372  2544 raft_consensus.cc:359] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.948190  2544 raft_consensus.cc:385] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.948499  2544 raft_consensus.cc:740] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.953298  2422 raft_consensus.cc:2468] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:58.953799  2496 raft_consensus.cc:2468] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:12:58.949262  2544 consensus_queue.cc:260] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.955384  2640 consensus_queue.cc:1048] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:58.956377  2544 ts_tablet_manager.cc:1434] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:12:58.957492  2544 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:58.958375  2315 leader_election.cc:304] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:58.959404  2599 raft_consensus.cc:2804] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.959964  2599 raft_consensus.cc:697] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:12:58.954569  2542 raft_consensus.cc:359] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.960824  2599 consensus_queue.cc:237] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.960860  2542 raft_consensus.cc:385] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.962080  2542 raft_consensus.cc:740] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.963137  2542 consensus_queue.cc:260] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:58.965466  2542 ts_tablet_manager.cc:1434] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:12:58.966856  2542 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:58.972539  2640 raft_consensus.cc:493] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:58.973124  2640 raft_consensus.cc:515] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:58.976329  2640 leader_election.cc:290] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:58.978093  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda6016d742d427295ff961579eb0adc" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:58.926435  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24353821c9e4434b957a5f26248d0b5a" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:59.003974  2544 tablet_bootstrap.cc:654] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:59.011293  2387 consensus_peers.cc:597] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:59.003264  2495 raft_consensus.cc:2468] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:12:59.013837  2541 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.014468  2541 ts_tablet_manager.cc:1403] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.283s	user 0.016s	sys 0.016s
I20260709 13:12:59.015080  2389 leader_election.cc:304] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:59.017140  2541 raft_consensus.cc:359] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.017860  2541 raft_consensus.cc:385] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.018186  2541 raft_consensus.cc:740] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.019811  2542 tablet_bootstrap.cc:654] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.020670  2541 consensus_queue.cc:260] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.022893  2421 raft_consensus.cc:2393] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:12:59.021559  2640 raft_consensus.cc:2804] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.029564  2541 ts_tablet_manager.cc:1434] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:59.031312  2640 raft_consensus.cc:493] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.035133  2541 tablet_bootstrap.cc:492] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.039783  2495 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.033710  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda6016d742d427295ff961579eb0adc" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:59.041563  2347 raft_consensus.cc:2468] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:12:59.035705  2640 raft_consensus.cc:3060] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.049746  2541 tablet_bootstrap.cc:654] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.061249  2543 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:59.061960  2543 ts_tablet_manager.cc:1403] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.133s	user 0.019s	sys 0.043s
I20260709 13:12:59.065547  2544 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:59.066221  2544 ts_tablet_manager.cc:1403] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.109s	user 0.014s	sys 0.001s
I20260709 13:12:59.068729  2170 catalog_manager.cc:5697] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.071262  2632 raft_consensus.cc:493] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.071056  2170 catalog_manager.cc:5697] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.072055  2632 raft_consensus.cc:515] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.074312  2632 leader_election.cc:290] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:59.075518  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:59.076304  2640 raft_consensus.cc:515] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.077940  2544 raft_consensus.cc:359] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.078617  2640 leader_election.cc:290] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:59.078768  2544 raft_consensus.cc:385] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.079216  2544 raft_consensus.cc:740] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.079952  2544 consensus_queue.cc:260] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.081106  2494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "595f4be17edb429fa78dad4b4a237fe5" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:59.081295  2543 raft_consensus.cc:359] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.082109  2543 raft_consensus.cc:385] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.082417  2543 raft_consensus.cc:740] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.083105  2543 consensus_queue.cc:260] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.085222  2543 ts_tablet_manager.cc:1434] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.002s
I20260709 13:12:59.087177  2543 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:59.087261  2544 ts_tablet_manager.cc:1434] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:12:59.082104  2494 raft_consensus.cc:2393] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:12:59.088425  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda6016d742d427295ff961579eb0adc" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:12:59.089186  2497 raft_consensus.cc:3060] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.092808  2544 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:59.095330  2543 tablet_bootstrap.cc:654] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.098696  2240 leader_election.cc:304] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:12:59.100028  2632 raft_consensus.cc:3060] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.101622  2544 tablet_bootstrap.cc:654] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.088568  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda6016d742d427295ff961579eb0adc" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:59.109232  2347 raft_consensus.cc:3060] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.114311  2706 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.114918  2706 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.118495  2170 catalog_manager.cc:5697] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.121558  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:59.122455  2272 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:59.124840  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:59.125291  2542 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:59.125936  2542 ts_tablet_manager.cc:1403] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.022s
I20260709 13:12:59.128154  2461 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:12:59.129227  2644 raft_consensus.cc:2804] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:59.130143  2644 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.130483  2644 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.130661  2636 raft_consensus.cc:493] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.131165  2636 raft_consensus.cc:515] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.133272  2636 leader_election.cc:290] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:59.133997  2421 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:59.135057  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5033c63fb34bddaa116c59c67d0032" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:12:59.136754  2460 leader_election.cc:343] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.138667  2640 raft_consensus.cc:493] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.139251  2640 raft_consensus.cc:515] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.140905  2644 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.144205  2640 leader_election.cc:290] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:59.150995  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5033c63fb34bddaa116c59c67d0032" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:59.151778  2421 raft_consensus.cc:2468] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:59.154196  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:59.154395  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:59.133131  2706 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:59.155651  2463 leader_election.cc:304] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: cf33d724fb704d85ab3127e566123c10
I20260709 13:12:59.156888  2636 raft_consensus.cc:2804] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.157281  2636 raft_consensus.cc:493] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.157683  2636 raft_consensus.cc:3060] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.158839  2387 leader_election.cc:343] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.135059  2632 raft_consensus.cc:2749] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.157418  2542 raft_consensus.cc:359] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.161235  2542 raft_consensus.cc:385] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.161525  2542 raft_consensus.cc:740] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.162065  2640 raft_consensus.cc:493] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.162536  2640 raft_consensus.cc:515] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.163815  2542 consensus_queue.cc:260] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.166020  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086b4a405c1a426a9dfd410277309eb8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:12:59.167358  2387 leader_election.cc:343] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.168022  2494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086b4a405c1a426a9dfd410277309eb8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:59.166289  2542 ts_tablet_manager.cc:1434] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
W20260709 13:12:59.169190  2389 leader_election.cc:343] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.169695  2389 leader_election.cc:304] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:59.170312  2542 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:59.170538  2642 raft_consensus.cc:2749] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.129204  2497 raft_consensus.cc:2468] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:12:59.154928  2348 raft_consensus.cc:2468] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:12:59.174870  2386 leader_election.cc:304] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:59.175704  2642 raft_consensus.cc:2804] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.176113  2642 raft_consensus.cc:493] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.176455  2642 raft_consensus.cc:3060] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.177538  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:59.178293  2272 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.179905  2389 leader_election.cc:304] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:59.180843  2553 raft_consensus.cc:2804] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.182483  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:59.183123  2421 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.184814  2644 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:59.185341  2640 leader_election.cc:290] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:59.184844  2347 raft_consensus.cc:2468] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:12:59.188153  2272 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:12:59.196610  2543 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:59.197242  2543 ts_tablet_manager.cc:1403] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.046s
I20260709 13:12:59.190928  2542 tablet_bootstrap.cc:654] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.191396  2636 raft_consensus.cc:515] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.203088  2553 raft_consensus.cc:697] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:12:59.207955  2541 tablet_bootstrap.cc:492] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.209201  2541 ts_tablet_manager.cc:1403] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.174s	user 0.014s	sys 0.035s
I20260709 13:12:59.205458  2421 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:12:59.209942  2461 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:12:59.214790  2553 consensus_queue.cc:237] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.222764  2642 raft_consensus.cc:515] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.222994  2543 raft_consensus.cc:359] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.224502  2543 raft_consensus.cc:385] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.224817  2543 raft_consensus.cc:740] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.225559  2543 consensus_queue.cc:260] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.226809  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:59.230396  2544 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:59.230965  2544 ts_tablet_manager.cc:1403] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.138s	user 0.029s	sys 0.037s
I20260709 13:12:59.234608  2544 raft_consensus.cc:359] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.236320  2544 raft_consensus.cc:385] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.236670  2544 raft_consensus.cc:740] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.237478  2544 consensus_queue.cc:260] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:12:59.236052  2387 leader_election.cc:343] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.240177  2544 ts_tablet_manager.cc:1434] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:59.240852  2636 leader_election.cc:290] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:59.235566  2541 raft_consensus.cc:359] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.241402  2541 raft_consensus.cc:385] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.241657  2544 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:59.245959  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5033c63fb34bddaa116c59c67d0032" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:59.241979  2541 raft_consensus.cc:740] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.246579  2421 raft_consensus.cc:3060] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.241519  2718 raft_consensus.cc:2804] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.248450  2541 consensus_queue.cc:260] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.250254  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5033c63fb34bddaa116c59c67d0032" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:59.250440  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:59.250957  2642 leader_election.cc:290] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:59.256948  2636 raft_consensus.cc:493] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.258615  2542 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:59.259148  2542 ts_tablet_manager.cc:1403] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.007s
I20260709 13:12:59.257506  2636 raft_consensus.cc:515] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.263926  2541 ts_tablet_manager.cc:1434] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:12:59.262372  2348 raft_consensus.cc:3060] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.266727  2541 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.268249  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:59.271373  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:59.272100  2346 raft_consensus.cc:2468] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:59.261829  2347 raft_consensus.cc:3060] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.274605  2168 catalog_manager.cc:5697] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.273823  2541 tablet_bootstrap.cc:654] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.273579  2460 leader_election.cc:304] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
W20260709 13:12:59.283018  2461 leader_election.cc:343] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.285321  2706 raft_consensus.cc:2804] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.279392  2636 leader_election.cc:290] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:59.289958  2632 consensus_queue.cc:1048] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.290798  2542 raft_consensus.cc:359] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.291626  2542 raft_consensus.cc:385] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.291903  2542 raft_consensus.cc:740] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.292559  2542 consensus_queue.cc:260] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.293591  2347 raft_consensus.cc:2468] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:59.285780  2706 raft_consensus.cc:493] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.294477  2706 raft_consensus.cc:3060] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.294939  2460 leader_election.cc:304] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:12:59.304462  2720 raft_consensus.cc:2804] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.305040  2720 raft_consensus.cc:697] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:12:59.307374  2348 raft_consensus.cc:2468] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:12:59.308765  2386 leader_election.cc:304] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:59.308985  2615 consensus_queue.cc:1048] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.310024  2642 raft_consensus.cc:2804] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.310563  2642 raft_consensus.cc:697] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:12:59.310696  2615 consensus_queue.cc:1048] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.311498  2642 consensus_queue.cc:237] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.318794  2542 ts_tablet_manager.cc:1434] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:12:59.320029  2542 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:59.334249  2718 raft_consensus.cc:697] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:12:59.337738  2718 consensus_queue.cc:237] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.338250  2543 ts_tablet_manager.cc:1434] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.141s	user 0.039s	sys 0.045s
I20260709 13:12:59.339490  2543 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:59.356272  2632 consensus_queue.cc:1048] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.357385  2544 tablet_bootstrap.cc:654] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.361300  2543 tablet_bootstrap.cc:654] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.319141  2720 consensus_queue.cc:237] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.345448  2421 raft_consensus.cc:2468] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:59.366148  2632 consensus_queue.cc:1048] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:59.343878  2706 raft_consensus.cc:515] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.372861  2615 consensus_queue.cc:1048] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:59.376295  2706 leader_election.cc:290] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:12:59.377530  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:12:59.377391  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:59.380708  2273 raft_consensus.cc:3060] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.379972  2347 raft_consensus.cc:3060] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.408788  2548 consensus_queue.cc:1048] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.410605  2642 raft_consensus.cc:493] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.412657  2541 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.411188  2642 raft_consensus.cc:515] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.418546  2541 ts_tablet_manager.cc:1403] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.021s
I20260709 13:12:59.439286  2542 tablet_bootstrap.cc:654] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.473698  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dd644561b24709b20fcb3ae2e883e8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:59.452335  2642 leader_election.cc:290] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:59.476022  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dd644561b24709b20fcb3ae2e883e8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:59.478222  2273 raft_consensus.cc:2468] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
W20260709 13:12:59.493829  2389 leader_election.cc:343] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.497851  2744 raft_consensus.cc:493] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:59.512130  2726 log.cc:927] Time spent T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:12:59.538305  2744 raft_consensus.cc:515] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.475857  2168 catalog_manager.cc:5697] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.540560  2744 leader_election.cc:290] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:12:59.513628  2541 raft_consensus.cc:359] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.541977  2541 raft_consensus.cc:385] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.542343  2541 raft_consensus.cc:740] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.543088  2541 consensus_queue.cc:260] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.545534  2541 ts_tablet_manager.cc:1434] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.000s
W20260709 13:12:59.514129  2387 leader_election.cc:343] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.549868  2387 leader_election.cc:304] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
W20260709 13:12:59.551137  2387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:40559, user_credentials={real_user=slave}} blocked reactor thread for 57318.7us
I20260709 13:12:59.552551  2720 raft_consensus.cc:493] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.553236  2720 raft_consensus.cc:515] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.553885  2642 raft_consensus.cc:2749] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.555724  2720 leader_election.cc:290] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
W20260709 13:12:59.514436  2724 log.cc:927] Time spent T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:12:59.517241  2544 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:59.558552  2544 ts_tablet_manager.cc:1403] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.318s	user 0.022s	sys 0.010s
I20260709 13:12:59.525826  2543 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:59.560770  2543 ts_tablet_manager.cc:1403] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.002s
I20260709 13:12:59.525583  2548 consensus_queue.cc:1048] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.531773  2461 leader_election.cc:304] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:12:59.532020  2347 raft_consensus.cc:2468] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:59.561269  2541 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.568326  2720 raft_consensus.cc:2804] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.575461  2544 raft_consensus.cc:359] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.567588  2271 raft_consensus.cc:3060] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.576474  2544 raft_consensus.cc:385] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.577405  2544 raft_consensus.cc:740] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.580109  2544 consensus_queue.cc:260] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
W20260709 13:12:59.569777  2240 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 70894.9us
I20260709 13:12:59.584772  2544 ts_tablet_manager.cc:1434] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 13:12:59.590035  2544 tablet_bootstrap.cc:492] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:59.578061  2720 raft_consensus.cc:697] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:12:59.594699  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086b4a405c1a426a9dfd410277309eb8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:59.583351  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086b4a405c1a426a9dfd410277309eb8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:59.595490  2421 raft_consensus.cc:2468] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:59.599288  2543 raft_consensus.cc:359] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:12:59.597486  2461 leader_election.cc:343] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.595148  2541 tablet_bootstrap.cc:654] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.600396  2599 consensus_queue.cc:1048] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.601023  2463 leader_election.cc:304] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:59.596664  2720 consensus_queue.cc:237] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.602718  2718 raft_consensus.cc:2804] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.603181  2718 raft_consensus.cc:493] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.603555  2718 raft_consensus.cc:3060] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.606834  2544 tablet_bootstrap.cc:654] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.600039  2543 raft_consensus.cc:385] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.611050  2543 raft_consensus.cc:740] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.611819  2543 consensus_queue.cc:260] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.613909  2543 ts_tablet_manager.cc:1434] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.000s
I20260709 13:12:59.614903  2543 tablet_bootstrap.cc:492] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:59.629946  2642 consensus_queue.cc:1048] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.630354  2170 catalog_manager.cc:5697] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 2, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 2 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.658543  2542 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:59.659222  2542 ts_tablet_manager.cc:1403] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.339s	user 0.009s	sys 0.011s
I20260709 13:12:59.665011  2541 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.665607  2541 ts_tablet_manager.cc:1403] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.105s	user 0.007s	sys 0.027s
I20260709 13:12:59.668215  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:59.673365  2541 raft_consensus.cc:359] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.674177  2541 raft_consensus.cc:385] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.674445  2541 raft_consensus.cc:740] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.674710  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7775d57497934ba19aeb046609de5e25" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:12:59.675001  2733 consensus_queue.cc:1048] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.675053  2541 consensus_queue.cc:260] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.677320  2640 consensus_queue.cc:1048] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.678719  2543 tablet_bootstrap.cc:654] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.686070  2240 leader_election.cc:304] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:12:59.687745  2541 ts_tablet_manager.cc:1434] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:12:59.688580  2541 tablet_bootstrap.cc:492] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.695739  2542 raft_consensus.cc:359] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.698170  2542 raft_consensus.cc:385] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.698480  2542 raft_consensus.cc:740] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.699258  2542 consensus_queue.cc:260] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.677784  2718 raft_consensus.cc:515] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.716787  2541 tablet_bootstrap.cc:654] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.720450  2542 ts_tablet_manager.cc:1434] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.003s
I20260709 13:12:59.721292  2542 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:59.728739  2422 raft_consensus.cc:1275] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:59.737373  2544 tablet_bootstrap.cc:492] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:59.737998  2544 ts_tablet_manager.cc:1403] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.010s
I20260709 13:12:59.739256  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086b4a405c1a426a9dfd410277309eb8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:12:59.740016  2421 raft_consensus.cc:3060] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.742887  2543 tablet_bootstrap.cc:492] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:59.743415  2543 ts_tablet_manager.cc:1403] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.129s	user 0.002s	sys 0.015s
I20260709 13:12:59.743968  2720 consensus_queue.cc:1048] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:59.744647  2387 consensus_peers.cc:597] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:59.741659  2544 raft_consensus.cc:359] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.745317  2544 raft_consensus.cc:385] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.745450  2733 raft_consensus.cc:2749] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.745648  2544 raft_consensus.cc:740] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.746047  2543 raft_consensus.cc:359] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.746737  2543 raft_consensus.cc:385] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.746590  2544 consensus_queue.cc:260] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.747059  2543 raft_consensus.cc:740] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.747999  2543 consensus_queue.cc:260] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.750427  2543 ts_tablet_manager.cc:1434] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:12:59.754745  2543 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:59.760202  2544 ts_tablet_manager.cc:1434] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:12:59.760614  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "086b4a405c1a426a9dfd410277309eb8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:12:59.761291  2274 raft_consensus.cc:3060] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.761405  2544 tablet_bootstrap.cc:492] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:59.768402  2544 tablet_bootstrap.cc:654] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.770030  2720 consensus_queue.cc:1048] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.772591  2274 raft_consensus.cc:2468] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:59.774850  2461 leader_election.cc:304] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:12:59.776346  2720 raft_consensus.cc:2804] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.777221  2720 raft_consensus.cc:697] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:12:59.778352  2720 consensus_queue.cc:237] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.783524  2171 catalog_manager.cc:5697] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.777232  2542 tablet_bootstrap.cc:654] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.758601  2718 leader_election.cc:290] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:59.779139  2421 raft_consensus.cc:2468] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:12:59.785480  2171 catalog_manager.cc:5697] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.818920  2599 raft_consensus.cc:493] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.822636  2599 raft_consensus.cc:515] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.824920  2599 leader_election.cc:290] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:12:59.825129  2543 tablet_bootstrap.cc:654] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.835807  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:12:59.837124  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:12:59.837628  2313 leader_election.cc:343] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.849416  2541 tablet_bootstrap.cc:492] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.849545  2544 tablet_bootstrap.cc:492] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:59.850178  2544 ts_tablet_manager.cc:1403] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.038s
I20260709 13:12:59.850854  2541 ts_tablet_manager.cc:1403] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.162s	user 0.017s	sys 0.002s
I20260709 13:12:59.853147  2544 raft_consensus.cc:359] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.853480  2541 raft_consensus.cc:359] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.853979  2544 raft_consensus.cc:385] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.854244  2541 raft_consensus.cc:385] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.854748  2541 raft_consensus.cc:740] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.854348  2544 raft_consensus.cc:740] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.855530  2541 consensus_queue.cc:260] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.859495  2544 consensus_queue.cc:260] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.865482  2541 ts_tablet_manager.cc:1434] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:12:59.865765  2544 ts_tablet_manager.cc:1434] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:59.866482  2541 tablet_bootstrap.cc:492] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.850020  2720 consensus_queue.cc:1048] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:12:59.875423  2271 raft_consensus.cc:1275] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:59.880107  2541 tablet_bootstrap.cc:654] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.890733  2723 consensus_queue.cc:1048] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.898370  2543 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:12:59.898895  2543 ts_tablet_manager.cc:1403] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.012s
I20260709 13:12:59.902824  2541 tablet_bootstrap.cc:492] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.903402  2541 ts_tablet_manager.cc:1403] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.014s
I20260709 13:12:59.906267  2541 raft_consensus.cc:359] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.906978  2541 raft_consensus.cc:385] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.907243  2541 raft_consensus.cc:740] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.907918  2541 consensus_queue.cc:260] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
W20260709 13:12:59.908852  2315 leader_election.cc:343] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.909406  2315 leader_election.cc:304] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:12:59.910037  2541 ts_tablet_manager.cc:1434] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:59.910423  2615 raft_consensus.cc:2749] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.911068  2541 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.903030  2543 raft_consensus.cc:359] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.913264  2543 raft_consensus.cc:385] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.913545  2543 raft_consensus.cc:740] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.914204  2543 consensus_queue.cc:260] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:12:59.917526  2541 tablet_bootstrap.cc:654] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.916602  2543 ts_tablet_manager.cc:1434] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:12:59.918593  2542 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:12:59.918897  2543 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:12:59.919109  2542 ts_tablet_manager.cc:1403] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.198s	user 0.019s	sys 0.011s
I20260709 13:12:59.920651  2544 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:59.923110  2542 raft_consensus.cc:359] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.923866  2542 raft_consensus.cc:385] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.924185  2542 raft_consensus.cc:740] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.927040  2544 tablet_bootstrap.cc:654] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.929937  2541 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.930483  2541 ts_tablet_manager.cc:1403] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:12:59.931149  2542 consensus_queue.cc:260] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.934523  2543 tablet_bootstrap.cc:654] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.934159  2541 raft_consensus.cc:359] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.934952  2541 raft_consensus.cc:385] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.935271  2541 raft_consensus.cc:740] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.936059  2541 consensus_queue.cc:260] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.937626  2640 consensus_queue.cc:1048] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.938459  2541 ts_tablet_manager.cc:1434] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:59.939476  2541 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.945465  2541 tablet_bootstrap.cc:654] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.946135  2718 raft_consensus.cc:493] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.946671  2718 raft_consensus.cc:515] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:12:59.948815  2718 leader_election.cc:290] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:12:59.951197  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a8678d891d4cfd999693b186227d40" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:12:59.952047  2420 raft_consensus.cc:2468] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:59.953490  2463 leader_election.cc:304] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:12:59.954530  2718 raft_consensus.cc:2804] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.954988  2718 raft_consensus.cc:493] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.955328  2718 raft_consensus.cc:3060] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.957831  2541 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:12:59.958505  2541 ts_tablet_manager.cc:1403] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 13:12:59.960691  2544 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:12:59.961243  2544 ts_tablet_manager.cc:1403] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.002s
I20260709 13:12:59.963681  2542 ts_tablet_manager.cc:1434] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.000s
I20260709 13:12:59.965247  2544 raft_consensus.cc:359] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.968902  2544 raft_consensus.cc:385] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.969228  2544 raft_consensus.cc:740] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.971004  2544 consensus_queue.cc:260] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:12:59.971276  2541 raft_consensus.cc:359] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.972062  2541 raft_consensus.cc:385] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.972638  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a8678d891d4cfd999693b186227d40" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:12:59.973397  2348 raft_consensus.cc:2468] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:12:59.975147  2541 raft_consensus.cc:740] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.975364  2544 ts_tablet_manager.cc:1434] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:12:59.976019  2541 consensus_queue.cc:260] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:12:59.978260  2541 ts_tablet_manager.cc:1434] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:12:59.978564  2544 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:12:59.979244  2541 tablet_bootstrap.cc:492] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:12:59.985708  2541 tablet_bootstrap.cc:654] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.991226  2544 tablet_bootstrap.cc:654] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.991437  2542 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:12:59.999483  2718 raft_consensus.cc:515] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.003546  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a8678d891d4cfd999693b186227d40" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:00.004307  2347 raft_consensus.cc:3060] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.007469  2725 raft_consensus.cc:493] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.008212  2725 raft_consensus.cc:515] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:13:00.018031  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:00.022220  2725 leader_election.cc:290] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.034603  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dd644561b24709b20fcb3ae2e883e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.035535  2420 raft_consensus.cc:2468] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:00.036722  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dd644561b24709b20fcb3ae2e883e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:00.042093  2171 catalog_manager.cc:5697] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:00.044720  2461 leader_election.cc:343] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.047258  2640 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.047556  2463 leader_election.cc:304] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.048134  2640 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.049535  2725 raft_consensus.cc:2804] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.050032  2725 raft_consensus.cc:493] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.050408  2725 raft_consensus.cc:3060] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.050738  2640 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.051594  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:00.053046  2387 leader_election.cc:343] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.063454  2347 raft_consensus.cc:2468] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:00.065014  2460 leader_election.cc:304] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:00.065840  2616 raft_consensus.cc:493] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.065994  2723 raft_consensus.cc:2804] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.066617  2723 raft_consensus.cc:697] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:00.067515  2723 consensus_queue.cc:237] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.069823  2616 raft_consensus.cc:515] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.072052  2616 leader_election.cc:290] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:00.073777  2543 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:00.074446  2543 ts_tablet_manager.cc:1403] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.027s
I20260709 13:13:00.083273  2544 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.084923  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a8678d891d4cfd999693b186227d40" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:00.079437  2718 leader_election.cc:290] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:00.085640  2420 raft_consensus.cc:3060] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.085798  2544 ts_tablet_manager.cc:1403] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.046s
I20260709 13:13:00.088600  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186ff068763e4792881c144c673946ac" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.089442  2542 tablet_bootstrap.cc:654] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:00.090449  2315 leader_election.cc:343] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.091265  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186ff068763e4792881c144c673946ac" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.091970  2423 raft_consensus.cc:2468] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:00.094617  2315 leader_election.cc:304] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:13:00.103111  2766 consensus_queue.cc:1048] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:00.095947  2544 raft_consensus.cc:359] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.105728  2544 raft_consensus.cc:385] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.106184  2544 raft_consensus.cc:740] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.107050  2544 consensus_queue.cc:260] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.108580  2548 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.112154  2548 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.114406  2548 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:00.115445  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:00.111004  2615 raft_consensus.cc:2804] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.116329  2615 raft_consensus.cc:493] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.116721  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:00.118486  2541 tablet_bootstrap.cc:492] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:00.118723  2544 ts_tablet_manager.cc:1434] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
W20260709 13:13:00.118391  2313 leader_election.cc:343] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.119241  2541 ts_tablet_manager.cc:1403] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.140s	user 0.031s	sys 0.048s
I20260709 13:13:00.119917  2544 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.119037  2347 raft_consensus.cc:2468] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:13:00.116724  2615 raft_consensus.cc:3060] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.122656  2541 raft_consensus.cc:359] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.123327  2541 raft_consensus.cc:385] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.123097  2543 raft_consensus.cc:359] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.123697  2541 raft_consensus.cc:740] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.123904  2543 raft_consensus.cc:385] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.124291  2541 consensus_queue.cc:260] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.126467  2664 raft_consensus.cc:493] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.124876  2543 raft_consensus.cc:740] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.121668  2725 raft_consensus.cc:515] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.127249  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.127985  2423 raft_consensus.cc:2468] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:00.127147  2664 raft_consensus.cc:515] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.126688  2386 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.130134  2543 consensus_queue.cc:260] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.130298  2615 raft_consensus.cc:515] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.132303  2553 raft_consensus.cc:2804] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.132737  2553 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.132810  2664 leader_election.cc:290] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.133127  2553 raft_consensus.cc:3060] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.118395  2420 raft_consensus.cc:2468] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:00.136173  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.139171  2541 ts_tablet_manager.cc:1434] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:13:00.140331  2541 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:00.140367  2725 leader_election.cc:290] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.147861  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:00.149812  2313 leader_election.cc:343] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.151808  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dd644561b24709b20fcb3ae2e883e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.151808  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6dd644561b24709b20fcb3ae2e883e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:00.153716  2423 raft_consensus.cc:3060] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.155623  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186ff068763e4792881c144c673946ac" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:00.156286  2420 raft_consensus.cc:3060] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.158259  2544 tablet_bootstrap.cc:654] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.158465  2553 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
W20260709 13:13:00.159471  2461 leader_election.cc:343] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.161375  2733 raft_consensus.cc:493] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.165132  2543 ts_tablet_manager.cc:1434] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.003s
I20260709 13:13:00.161909  2733 raft_consensus.cc:515] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.170830  2615 leader_election.cc:290] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:00.171486  2553 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.171617  2733 leader_election.cc:290] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:00.173506  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.174453  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98cc21fae71c4267b5b185563944dcd9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:00.176645  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.178287  2718 raft_consensus.cc:493] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.178858  2718 raft_consensus.cc:515] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.180688  2240 leader_election.cc:304] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:00.181303  2718 leader_election.cc:290] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.182701  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:00.184886  2541 tablet_bootstrap.cc:654] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.183081  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:00.187767  2461 leader_election.cc:343] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.185072  2347 raft_consensus.cc:2468] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:00.183247  2733 raft_consensus.cc:2749] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.190567  2420 raft_consensus.cc:2468] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:00.189538  2460 leader_election.cc:304] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.181993  2718 consensus_queue.cc:1048] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:13:00.184172  2387 leader_election.cc:343] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.193221  2718 raft_consensus.cc:2804] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.193621  2718 raft_consensus.cc:493] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.194007  2718 raft_consensus.cc:3060] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.170204  2315 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.196496  2548 raft_consensus.cc:2804] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.196950  2548 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.197270  2168 catalog_manager.cc:5697] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.199256  2423 raft_consensus.cc:2468] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:00.200364  2543 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:00.197276  2548 raft_consensus.cc:3060] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:00.196270  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 44841.3us
I20260709 13:13:00.212880  2541 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:00.213543  2541 ts_tablet_manager.cc:1403] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.003s
I20260709 13:13:00.216225  2542 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:00.216770  2542 ts_tablet_manager.cc:1403] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.226s	user 0.007s	sys 0.010s
I20260709 13:13:00.216949  2541 raft_consensus.cc:359] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.217833  2541 raft_consensus.cc:385] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.218210  2541 raft_consensus.cc:740] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.205070  2463 leader_election.cc:304] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.219012  2541 consensus_queue.cc:260] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.227816  2543 tablet_bootstrap.cc:654] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.237993  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:00.238729  2542 raft_consensus.cc:359] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.239460  2542 raft_consensus.cc:385] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.239743  2542 raft_consensus.cc:740] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.241648  2542 consensus_queue.cc:260] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.222867  2548 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.248080  2548 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:00.248865  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.249507  2541 ts_tablet_manager.cc:1434] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:13:00.250600  2541 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:00.224303  2723 raft_consensus.cc:2804] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:00.254673  2313 leader_election.cc:343] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.256168  2348 raft_consensus.cc:2393] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:13:00.259654  2718 raft_consensus.cc:515] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.264652  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.265316  2272 raft_consensus.cc:3060] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:00.239953  2315 leader_election.cc:343] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.270213  2315 leader_election.cc:304] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.271090  2548 raft_consensus.cc:2749] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.271219  2541 tablet_bootstrap.cc:654] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.274214  2386 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:00.273228  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186ff068763e4792881c144c673946ac" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:00.275719  2542 ts_tablet_manager.cc:1434] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.002s
I20260709 13:13:00.276273  2272 raft_consensus.cc:2468] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:00.276166  2640 raft_consensus.cc:2749] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.278200  2461 leader_election.cc:304] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:00.278676  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:00.279413  2348 raft_consensus.cc:3060] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.279701  2706 raft_consensus.cc:2804] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.280213  2706 raft_consensus.cc:697] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:00.281064  2706 consensus_queue.cc:237] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.282528  2543 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:00.283164  2543 ts_tablet_manager.cc:1403] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.019s
I20260709 13:13:00.276772  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:00.284878  2420 raft_consensus.cc:2393] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:13:00.286176  2543 raft_consensus.cc:359] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.286926  2543 raft_consensus.cc:385] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.287192  2543 raft_consensus.cc:740] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.287870  2543 consensus_queue.cc:260] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.276832  2542 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:00.293264  2348 raft_consensus.cc:2468] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:00.295174  2718 leader_election.cc:290] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.274372  2723 raft_consensus.cc:697] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:00.295730  2640 raft_consensus.cc:493] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.297968  2315 leader_election.cc:304] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:00.278591  2544 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.300981  2640 raft_consensus.cc:515] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.301898  2544 ts_tablet_manager.cc:1403] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.182s	user 0.017s	sys 0.001s
I20260709 13:13:00.302505  2315 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:13:00.303380  2664 raft_consensus.cc:2804] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.303898  2664 raft_consensus.cc:697] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
W20260709 13:13:00.304253  2315 leader_election.cc:343] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.304574  2615 raft_consensus.cc:2749] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.305015  2640 leader_election.cc:290] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.300326  2543 ts_tablet_manager.cc:1434] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:00.306030  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0205f70184949afaacd77d16dc39833" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.306727  2496 raft_consensus.cc:2468] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:13:00.298632  2542 tablet_bootstrap.cc:654] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.304756  2664 consensus_queue.cc:237] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.307749  2543 tablet_bootstrap.cc:492] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:00.300432  2706 consensus_queue.cc:1048] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:13:00.309999  2723 consensus_queue.cc:237] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.310743  2389 leader_election.cc:304] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:00.304798  2544 raft_consensus.cc:359] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.312301  2544 raft_consensus.cc:385] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.312565  2544 raft_consensus.cc:740] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.313252  2640 raft_consensus.cc:2804] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.313680  2640 raft_consensus.cc:493] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.314090  2640 raft_consensus.cc:3060] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.314520  2543 tablet_bootstrap.cc:654] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.303401  2541 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:00.315704  2541 ts_tablet_manager.cc:1403] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.007s
I20260709 13:13:00.318699  2541 raft_consensus.cc:359] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.319455  2541 raft_consensus.cc:385] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.319718  2541 raft_consensus.cc:740] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.320509  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0205f70184949afaacd77d16dc39833" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:00.320400  2541 consensus_queue.cc:260] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.321676  2544 consensus_queue.cc:260] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
W20260709 13:13:00.323029  2387 leader_election.cc:343] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.324973  2541 ts_tablet_manager.cc:1434] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:00.326237  2541 tablet_bootstrap.cc:492] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:00.331357  2544 ts_tablet_manager.cc:1434] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:13:00.339345  2544 tablet_bootstrap.cc:492] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.340937  2553 raft_consensus.cc:493] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.350984  2542 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:00.354365  2706 consensus_queue.cc:1048] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.354875  2542 ts_tablet_manager.cc:1403] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.004s
I20260709 13:13:00.375051  2542 raft_consensus.cc:359] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.377099  2553 raft_consensus.cc:515] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.381139  2541 tablet_bootstrap.cc:654] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.411402  2553 leader_election.cc:290] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.396220  2271 raft_consensus.cc:3060] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.413467  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:00.415146  2387 leader_election.cc:343] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.393910  2640 raft_consensus.cc:515] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.400705  2544 tablet_bootstrap.cc:654] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.419024  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0205f70184949afaacd77d16dc39833" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.423725  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:13:00.425724  2386 leader_election.cc:343] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:00.426333  2387 leader_election.cc:343] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.426317  2386 leader_election.cc:304] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:00.427343  2541 tablet_bootstrap.cc:492] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:00.427922  2541 ts_tablet_manager.cc:1403] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.003s
I20260709 13:13:00.427942  2553 raft_consensus.cc:2749] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.427132  2171 catalog_manager.cc:5697] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.430754  2541 raft_consensus.cc:359] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.431486  2541 raft_consensus.cc:385] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.431902  2541 raft_consensus.cc:740] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.433305  2542 raft_consensus.cc:385] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.433445  2541 consensus_queue.cc:260] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.435014  2542 raft_consensus.cc:740] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.443570  2543 tablet_bootstrap.cc:492] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:00.444106  2543 ts_tablet_manager.cc:1403] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.038s
I20260709 13:13:00.444891  2168 catalog_manager.cc:5697] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.447813  2168 catalog_manager.cc:5697] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.448904  2542 consensus_queue.cc:260] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.432650  2640 leader_election.cc:290] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.453140  2541 ts_tablet_manager.cc:1434] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:13:00.454164  2541 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:00.456207  2542 ts_tablet_manager.cc:1434] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.000s
I20260709 13:13:00.459044  2542 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:00.460136  2544 tablet_bootstrap.cc:492] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.460598  2544 ts_tablet_manager.cc:1403] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.005s
I20260709 13:13:00.462075  2543 raft_consensus.cc:359] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.462808  2543 raft_consensus.cc:385] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.463110  2543 raft_consensus.cc:740] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.463716  2543 consensus_queue.cc:260] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.465608  2543 ts_tablet_manager.cc:1434] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:13:00.466585  2543 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:00.472307  2543 tablet_bootstrap.cc:654] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.475116  2542 tablet_bootstrap.cc:654] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.475782  2544 raft_consensus.cc:359] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.479807  2544 raft_consensus.cc:385] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.480204  2544 raft_consensus.cc:740] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.480981  2544 consensus_queue.cc:260] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.483541  2544 ts_tablet_manager.cc:1434] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:13:00.484678  2544 tablet_bootstrap.cc:492] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.490898  2548 raft_consensus.cc:493] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.491503  2548 raft_consensus.cc:515] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.493762  2548 leader_election.cc:290] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:00.502708  2544 tablet_bootstrap.cc:654] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.496088  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b37d5c87774ab0aadad534ab6a652b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:00.509066  2313 leader_election.cc:343] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.510063  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b37d5c87774ab0aadad534ab6a652b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
W20260709 13:13:00.512001  2315 leader_election.cc:343] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.512537  2315 leader_election.cc:304] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:13:00.513844  2664 raft_consensus.cc:2749] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.520980  2616 raft_consensus.cc:493] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.521410  2616 raft_consensus.cc:515] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
W20260709 13:13:00.498935  2389 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 93450.1us
I20260709 13:13:00.537911  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.540488  2419 raft_consensus.cc:2468] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:00.541543  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0205f70184949afaacd77d16dc39833" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:00.542222  2497 raft_consensus.cc:3060] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.542783  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.535943  2616 leader_election.cc:290] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:00.546486  2541 tablet_bootstrap.cc:654] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.549355  2542 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:00.549789  2542 ts_tablet_manager.cc:1403] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.007s
W20260709 13:13:00.555334  2315 leader_election.cc:343] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.555721  2766 raft_consensus.cc:493] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.556263  2766 raft_consensus.cc:515] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.547710  2793 raft_consensus.cc:493] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.557279  2793 raft_consensus.cc:515] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.557974  2315 leader_election.cc:304] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:13:00.559268  2664 raft_consensus.cc:2804] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.559684  2664 raft_consensus.cc:493] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.560012  2664 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.560582  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:00.562157  2387 leader_election.cc:343] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.567749  2766 leader_election.cc:290] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.561708  2542 raft_consensus.cc:359] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.570096  2543 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:00.570096  2542 raft_consensus.cc:385] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.571607  2542 raft_consensus.cc:740] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.569145  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:00.572844  2348 raft_consensus.cc:2468] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:00.569768  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:00.574259  2460 leader_election.cc:304] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:00.575544  2723 raft_consensus.cc:2804] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.575947  2723 raft_consensus.cc:493] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.576282  2723 raft_consensus.cc:3060] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:00.576821  2461 leader_election.cc:343] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.579430  2543 ts_tablet_manager.cc:1403] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.113s	user 0.015s	sys 0.017s
I20260709 13:13:00.582290  2543 raft_consensus.cc:359] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.583006  2543 raft_consensus.cc:385] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.583283  2543 raft_consensus.cc:740] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.568439  2793 leader_election.cc:290] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.585484  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.586680  2544 tablet_bootstrap.cc:492] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.587231  2544 ts_tablet_manager.cc:1403] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.016s
I20260709 13:13:00.584167  2542 consensus_queue.cc:260] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.587949  2723 raft_consensus.cc:515] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.589390  2542 ts_tablet_manager.cc:1434] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.039s	user 0.003s	sys 0.003s
I20260709 13:13:00.589833  2543 consensus_queue.cc:260] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.590288  2544 raft_consensus.cc:359] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.591078  2544 raft_consensus.cc:385] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.591585  2544 raft_consensus.cc:740] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
W20260709 13:13:00.592041  2389 leader_election.cc:343] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.592538  2544 consensus_queue.cc:260] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.591061  2664 raft_consensus.cc:515] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.598636  2766 raft_consensus.cc:493] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.599037  2664 leader_election.cc:290] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:00.568084  2497 raft_consensus.cc:2468] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:13:00.599221  2766 raft_consensus.cc:515] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.592530  2389 leader_election.cc:304] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.601894  2723 leader_election.cc:290] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.602531  2793 raft_consensus.cc:2749] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.603080  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:00.603374  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:00.603739  2347 raft_consensus.cc:3060] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.603935  2419 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.604436  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186ff068763e4792881c144c673946ac" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:00.606753  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:00.611994  2419 raft_consensus.cc:2468] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:00.613312  2315 leader_election.cc:304] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:00.613476  2347 raft_consensus.cc:2468] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
W20260709 13:13:00.614394  2315 leader_election.cc:343] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.615600  2544 ts_tablet_manager.cc:1434] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:13:00.615792  2766 leader_election.cc:290] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:00.616210  2664 raft_consensus.cc:2804] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.617211  2389 leader_election.cc:304] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.617238  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186ff068763e4792881c144c673946ac" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.618109  2793 raft_consensus.cc:2804] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.618722  2793 raft_consensus.cc:697] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:00.619088  2544 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.619592  2793 consensus_queue.cc:237] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.620224  2543 ts_tablet_manager.cc:1434] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.002s
I20260709 13:13:00.621246  2543 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:00.621531  2664 raft_consensus.cc:697] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:00.618291  2419 raft_consensus.cc:2393] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:13:00.624125  2664 consensus_queue.cc:237] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.626094  2463 leader_election.cc:304] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:00.618196  2460 leader_election.cc:304] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:00.627547  2766 raft_consensus.cc:3060] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.628711  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.627219  2548 raft_consensus.cc:493] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.631839  2543 tablet_bootstrap.cc:654] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.631503  2548 raft_consensus.cc:515] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.631871  2723 raft_consensus.cc:2804] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.634507  2723 raft_consensus.cc:697] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:00.634287  2548 leader_election.cc:290] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.632052  2706 consensus_queue.cc:1048] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.635426  2723 consensus_queue.cc:237] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.637744  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:00.638209  2461 leader_election.cc:343] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:00.640935  2313 leader_election.cc:343] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.641601  2548 raft_consensus.cc:493] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.642155  2548 raft_consensus.cc:515] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:00.642204  2542 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:00.651764  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.652448  2541 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:00.652956  2541 ts_tablet_manager.cc:1403] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.199s	user 0.018s	sys 0.008s
W20260709 13:13:00.653298  2315 leader_election.cc:343] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.656030  2548 leader_election.cc:290] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:00.652804  2766 raft_consensus.cc:2749] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.656931  2718 consensus_queue.cc:1048] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:00.657155  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.659801  2544 tablet_bootstrap.cc:654] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:00.660921  2315 leader_election.cc:343] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.661514  2315 leader_election.cc:304] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:13:00.664572  2616 raft_consensus.cc:2749] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.669692  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.672592  2497 raft_consensus.cc:2468] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:00.677793  2543 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:00.678467  2543 ts_tablet_manager.cc:1403] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.005s
I20260709 13:13:00.671139  2544 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.679188  2544 ts_tablet_manager.cc:1403] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.001s
I20260709 13:13:00.682600  2544 raft_consensus.cc:359] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.683295  2544 raft_consensus.cc:385] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.683565  2544 raft_consensus.cc:740] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.684672  2315 leader_election.cc:304] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.685374  2664 raft_consensus.cc:493] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.686232  2664 raft_consensus.cc:515] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.671558  2542 tablet_bootstrap.cc:654] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.693113  2548 raft_consensus.cc:2804] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.693590  2548 raft_consensus.cc:493] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.694079  2548 raft_consensus.cc:3060] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.684389  2544 consensus_queue.cc:260] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.696254  2544 ts_tablet_manager.cc:1434] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:13:00.697244  2544 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.696415  2169 catalog_manager.cc:5697] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.688608  2543 raft_consensus.cc:359] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.688841  2168 catalog_manager.cc:5697] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.699141  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:00.699312  2733 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.655923  2541 raft_consensus.cc:359] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.693481  2664 leader_election.cc:290] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.699856  2733 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.700831  2543 raft_consensus.cc:385] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.701413  2543 raft_consensus.cc:740] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.702186  2543 consensus_queue.cc:260] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.704644  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:00.705533  2419 raft_consensus.cc:2393] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
W20260709 13:13:00.700675  2313 leader_election.cc:343] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.706995  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.707420  2733 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:00.711265  2544 tablet_bootstrap.cc:654] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.715939  2548 raft_consensus.cc:515] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.717864  2542 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:00.726562  2542 ts_tablet_manager.cc:1403] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.004s
I20260709 13:13:00.718286  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:00.704648  2543 ts_tablet_manager.cc:1434] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:13:00.730412  2542 raft_consensus.cc:359] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.731029  2543 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:00.731263  2542 raft_consensus.cc:385] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.732167  2346 raft_consensus.cc:2393] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:13:00.722532  2497 raft_consensus.cc:2468] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:00.733779  2237 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:00.736239  2733 raft_consensus.cc:3060] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.731645  2542 raft_consensus.cc:740] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.739046  2542 consensus_queue.cc:260] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.740451  2315 leader_election.cc:304] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.700628  2541 raft_consensus.cc:385] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.741297  2541 raft_consensus.cc:740] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.741874  2542 ts_tablet_manager.cc:1434] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:13:00.742537  2172 catalog_manager.cc:5697] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.743019  2541 consensus_queue.cc:260] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.746212  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:00.746862  2495 raft_consensus.cc:3060] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.757134  2495 raft_consensus.cc:2468] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:00.758878  2718 consensus_queue.cc:1048] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.760630  2315 leader_election.cc:304] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:00.762702  2616 raft_consensus.cc:2804] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:00.763178  2616 raft_consensus.cc:493] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:00.763504  2616 raft_consensus.cc:3060] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.770056  2616 raft_consensus.cc:515] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.773571  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.775520  2664 raft_consensus.cc:2804] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.776275  2664 raft_consensus.cc:697] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:00.777151  2548 leader_election.cc:290] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.777222  2664 consensus_queue.cc:237] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:13:00.775826  2313 leader_election.cc:343] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.781138  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:00.781445  2544 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.778316  2541 ts_tablet_manager.cc:1434] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.002s
I20260709 13:13:00.782123  2544 ts_tablet_manager.cc:1403] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.085s	user 0.034s	sys 0.037s
I20260709 13:13:00.782754  2718 consensus_queue.cc:1048] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:00.783532  2313 leader_election.cc:343] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.782754  2541 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:00.785076  2544 raft_consensus.cc:359] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.785846  2544 raft_consensus.cc:385] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.786183  2544 raft_consensus.cc:740] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.787058  2544 consensus_queue.cc:260] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.789207  2544 ts_tablet_manager.cc:1434] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:00.790328  2544 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.796301  2544 tablet_bootstrap.cc:654] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.797662  2541 tablet_bootstrap.cc:654] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.797430  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:00.800824  2495 raft_consensus.cc:3060] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.801378  2733 raft_consensus.cc:2749] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.775624  2616 leader_election.cc:290] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.809605  2542 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:00.824178  2274 raft_consensus.cc:3060] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.828528  2793 raft_consensus.cc:493] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.832787  2793 raft_consensus.cc:515] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.850327  2169 catalog_manager.cc:5697] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.853076  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab2577017124173bbf7a9a3ccf1b044" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:00.855173  2389 leader_election.cc:343] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.857292  2664 consensus_queue.cc:1048] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:00.858646  2723 consensus_queue.cc:1048] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.860945  2793 leader_election.cc:290] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:00.861429  2664 consensus_queue.cc:1048] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.863147  2541 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:00.863832  2541 ts_tablet_manager.cc:1403] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.000s
I20260709 13:13:00.867399  2495 raft_consensus.cc:2468] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:00.868155  2541 raft_consensus.cc:359] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.868904  2541 raft_consensus.cc:385] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.869174  2541 raft_consensus.cc:740] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.869529  2315 leader_election.cc:304] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.870297  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab2577017124173bbf7a9a3ccf1b044" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:00.871107  2543 tablet_bootstrap.cc:654] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.871466  2616 raft_consensus.cc:2804] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:00.872031  2616 raft_consensus.cc:697] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:00.872877  2616 consensus_queue.cc:237] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:13:00.874269  2387 leader_election.cc:343] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:00.874684  2544 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.875201  2544 ts_tablet_manager.cc:1403] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.085s	user 0.029s	sys 0.025s
I20260709 13:13:00.874848  2387 leader_election.cc:304] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:00.880118  2542 tablet_bootstrap.cc:654] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.880466  2793 raft_consensus.cc:2749] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.882153  2544 raft_consensus.cc:359] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.882936  2544 raft_consensus.cc:385] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.883241  2544 raft_consensus.cc:740] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.883951  2544 consensus_queue.cc:260] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:00.886206  2544 ts_tablet_manager.cc:1434] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:00.890926  2544 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.878047  2541 consensus_queue.cc:260] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.898154  2541 ts_tablet_manager.cc:1434] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:13:00.898311  2723 consensus_queue.cc:1048] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:00.900720  2544 tablet_bootstrap.cc:654] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.915062  2746 raft_consensus.cc:493] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:00.915663  2746 raft_consensus.cc:515] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:00.916390  2541 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:00.919724  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:00.920739  2346 raft_consensus.cc:2393] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:13:00.922557  2746 leader_election.cc:290] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:00.924861  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a981f697d3849b8bf1f6d21f6ee49a6" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:00.927099  2240 leader_election.cc:304] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:00.928658  2746 raft_consensus.cc:3060] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:00.938442  2746 raft_consensus.cc:2749] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:00.954713  2543 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:00.955245  2543 ts_tablet_manager.cc:1403] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.225s	user 0.012s	sys 0.028s
I20260709 13:13:00.956115  2544 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:00.956661  2544 ts_tablet_manager.cc:1403] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.015s
I20260709 13:13:00.958029  2543 raft_consensus.cc:359] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.958788  2543 raft_consensus.cc:385] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.959056  2543 raft_consensus.cc:740] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.959273  2544 raft_consensus.cc:359] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.960042  2544 raft_consensus.cc:385] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.959906  2543 consensus_queue.cc:260] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.960372  2544 raft_consensus.cc:740] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.961122  2544 consensus_queue.cc:260] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.962186  2543 ts_tablet_manager.cc:1434] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:00.966246  2543 tablet_bootstrap.cc:492] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:00.968933  2169 catalog_manager.cc:5697] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.972276  2543 tablet_bootstrap.cc:654] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.974818  2542 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:00.975481  2542 ts_tablet_manager.cc:1403] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.000s
I20260709 13:13:00.978737  2542 raft_consensus.cc:359] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:00.984406  2544 ts_tablet_manager.cc:1434] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:13:00.989725  2544 tablet_bootstrap.cc:492] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:00.995618  2544 tablet_bootstrap.cc:654] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:00.997498  2542 raft_consensus.cc:385] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:00.997952  2542 raft_consensus.cc:740] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:00.998773  2543 tablet_bootstrap.cc:492] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:00.999477  2543 ts_tablet_manager.cc:1403] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.001s
I20260709 13:13:00.998852  2542 consensus_queue.cc:260] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.002231  2543 raft_consensus.cc:359] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.002938  2543 raft_consensus.cc:385] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.003190  2543 raft_consensus.cc:740] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.003947  2543 consensus_queue.cc:260] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.017033  2543 ts_tablet_manager.cc:1434] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:13:01.017666  2541 tablet_bootstrap.cc:654] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.018599  2543 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:01.018399  2542 ts_tablet_manager.cc:1434] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:13:01.020422  2542 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:01.021334  2544 tablet_bootstrap.cc:492] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:01.024417  2544 ts_tablet_manager.cc:1403] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.009s
I20260709 13:13:01.027158  2543 tablet_bootstrap.cc:654] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.021725  2723 raft_consensus.cc:493] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.030510  2723 raft_consensus.cc:515] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.032701  2723 leader_election.cc:290] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:01.037611  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ba9973b45145b0a660d1a46ac9da53" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.038403  2420 raft_consensus.cc:2468] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:01.039750  2463 leader_election.cc:304] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:01.040776  2723 raft_consensus.cc:2804] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:01.041213  2723 raft_consensus.cc:493] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.041553  2723 raft_consensus.cc:3060] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.042462  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ba9973b45145b0a660d1a46ac9da53" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:01.044689  2461 leader_election.cc:343] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.048135  2496 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.051527  2544 raft_consensus.cc:359] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.051692  2723 raft_consensus.cc:515] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.056550  2542 tablet_bootstrap.cc:654] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.058033  2544 raft_consensus.cc:385] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.058421  2544 raft_consensus.cc:740] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.054082  2792 raft_consensus.cc:493] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.059230  2544 consensus_queue.cc:260] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.059867  2792 raft_consensus.cc:515] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.060679  2723 leader_election.cc:290] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:01.064296  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.066296  2664 raft_consensus.cc:493] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.066958  2664 raft_consensus.cc:515] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.069417  2664 leader_election.cc:290] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:01.072700  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:01.074611  2313 leader_election.cc:343] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.075661  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ba9973b45145b0a660d1a46ac9da53" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:01.077050  2544 ts_tablet_manager.cc:1434] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.003s
W20260709 13:13:01.077477  2461 leader_election.cc:343] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.082147  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:01.087944  2548 consensus_queue.cc:1048] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:01.088763  2544 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:01.094552  2616 raft_consensus.cc:493] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.078975  2792 leader_election.cc:290] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
W20260709 13:13:01.079231  2386 leader_election.cc:343] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.080303  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.095131  2616 raft_consensus.cc:515] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:01.097064  2420 raft_consensus.cc:2468] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
W20260709 13:13:01.100072  2389 leader_election.cc:343] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.102339  2389 leader_election.cc:304] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:01.108076  2315 leader_election.cc:304] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.109995  2718 raft_consensus.cc:493] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.110683  2718 raft_consensus.cc:515] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.113116  2718 leader_election.cc:290] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:01.114441  2615 raft_consensus.cc:2804] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:01.114970  2615 raft_consensus.cc:493] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.115196  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.115341  2615 raft_consensus.cc:3060] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.118170  2725 consensus_queue.cc:1048] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:01.119946  2642 raft_consensus.cc:2749] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:01.122216  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.123034  2419 raft_consensus.cc:2468] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:01.123138  2642 raft_consensus.cc:493] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.123732  2642 raft_consensus.cc:515] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.124826  2463 leader_election.cc:304] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: cf33d724fb704d85ab3127e566123c10
I20260709 13:13:01.126360  2725 raft_consensus.cc:2804] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:01.126952  2725 raft_consensus.cc:493] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.126633  2615 raft_consensus.cc:515] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.127455  2642 leader_election.cc:290] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:01.110248  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ba9973b45145b0a660d1a46ac9da53" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:01.126858  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b37d5c87774ab0aadad534ab6a652b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:01.133424  2420 raft_consensus.cc:3060] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:01.134383  2387 leader_election.cc:343] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.131023  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:01.136173  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:13:01.137669  2313 leader_election.cc:343] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.138773  2615 leader_election.cc:290] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:01.127470  2725 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.130800  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:01.147221  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
W20260709 13:13:01.144577  2315 leader_election.cc:343] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:01.148190  2313 leader_election.cc:343] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.148661  2313 leader_election.cc:304] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.128978  2616 leader_election.cc:290] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:01.154528  2423 raft_consensus.cc:3060] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.155186  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b37d5c87774ab0aadad534ab6a652b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.155956  2348 raft_consensus.cc:2468] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:13:01.156934  2642 raft_consensus.cc:493] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.157472  2642 raft_consensus.cc:515] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.149471  2615 raft_consensus.cc:2749] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:01.160532  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:01.162081  2387 leader_election.cc:343] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.164413  2386 leader_election.cc:304] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.165417  2792 raft_consensus.cc:2804] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:01.165866  2792 raft_consensus.cc:493] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.166249  2792 raft_consensus.cc:3060] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.168623  2733 raft_consensus.cc:493] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.169226  2733 raft_consensus.cc:515] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.171797  2733 leader_election.cc:290] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:01.173226  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0205f70184949afaacd77d16dc39833" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:01.174968  2497 raft_consensus.cc:2393] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:13:01.178750  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:13:01.180401  2386 leader_election.cc:343] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.180914  2386 leader_election.cc:304] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:01.181753  2793 raft_consensus.cc:2749] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:01.184579  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0205f70184949afaacd77d16dc39833" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.186640  2240 leader_election.cc:304] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
W20260709 13:13:01.186857  2313 consensus_peers.cc:597] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:01.190290  2642 leader_election.cc:290] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:01.195364  2792 raft_consensus.cc:515] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.195613  2616 consensus_queue.cc:1048] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:01.187399  2718 consensus_queue.cc:1048] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:13:01.200505  2544 tablet_bootstrap.cc:654] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.198323  2733 raft_consensus.cc:3060] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.164312  2423 raft_consensus.cc:2468] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:01.197715  2642 consensus_queue.cc:1048] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:01.197196  2420 raft_consensus.cc:2468] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:01.206830  2541 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:01.207409  2541 ts_tablet_manager.cc:1403] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.291s	user 0.013s	sys 0.003s
I20260709 13:13:01.210850  2315 leader_election.cc:304] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.213644  2543 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:01.214262  2543 ts_tablet_manager.cc:1403] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.196s	user 0.091s	sys 0.085s
I20260709 13:13:01.214623  2541 raft_consensus.cc:359] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.215890  2541 raft_consensus.cc:385] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.213665  2615 raft_consensus.cc:2804] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:01.217108  2615 raft_consensus.cc:697] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:01.218008  2615 consensus_queue.cc:237] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.216095  2541 raft_consensus.cc:740] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.220927  2541 consensus_queue.cc:260] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.221858  2542 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:01.222396  2542 ts_tablet_manager.cc:1403] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.202s	user 0.046s	sys 0.023s
I20260709 13:13:01.225232  2541 ts_tablet_manager.cc:1434] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:01.227473  2541 tablet_bootstrap.cc:492] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:01.234304  2543 raft_consensus.cc:359] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:01.234910  2543 raft_consensus.cc:385] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.234558  2542 raft_consensus.cc:359] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.235284  2542 raft_consensus.cc:385] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.235569  2542 raft_consensus.cc:740] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.237206  2792 leader_election.cc:290] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:01.235148  2543 raft_consensus.cc:740] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.239308  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b37d5c87774ab0aadad534ab6a652b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:01.239799  2543 consensus_queue.cc:260] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:13:01.242437  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:01.231426  2725 raft_consensus.cc:515] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.245062  2496 raft_consensus.cc:1240] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Rejecting Update request from peer cf33d724fb704d85ab3127e566123c10 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:13:01.244405  2542 consensus_queue.cc:260] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.252624  2274 raft_consensus.cc:3060] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.253988  2542 ts_tablet_manager.cc:1434] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:13:01.256734  2542 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:01.262836  2544 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:01.263386  2544 ts_tablet_manager.cc:1403] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.007s
I20260709 13:13:01.266283  2543 ts_tablet_manager.cc:1434] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:13:01.230324  2463 leader_election.cc:304] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.278493  2274 raft_consensus.cc:2468] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
W20260709 13:13:01.278537  2463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 58148.7us
I20260709 13:13:01.267295  2543 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:01.267622  2733 raft_consensus.cc:2749] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:01.268981  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51b37d5c87774ab0aadad534ab6a652b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:01.270464  2168 catalog_manager.cc:5697] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.281772  2347 raft_consensus.cc:3060] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.279079  2725 leader_election.cc:290] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:01.283520  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:01.280529  2718 raft_consensus.cc:2804] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:01.288292  2718 raft_consensus.cc:697] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:01.289263  2718 consensus_queue.cc:237] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.286057  2615 consensus_queue.cc:1059] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:01.292292  2543 tablet_bootstrap.cc:654] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.298339  2616 raft_consensus.cc:3055] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:01.298766  2616 raft_consensus.cc:740] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:01.301066  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:01.303757  2616 consensus_queue.cc:260] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.305075  2616 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:01.314281  2387 leader_election.cc:304] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:01.319909  2642 raft_consensus.cc:2804] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:01.320518  2642 raft_consensus.cc:697] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:01.321362  2642 consensus_queue.cc:237] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.326277  2541 tablet_bootstrap.cc:654] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.315733  2544 raft_consensus.cc:359] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.332113  2544 raft_consensus.cc:385] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.332417  2544 raft_consensus.cc:740] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.345597  2544 consensus_queue.cc:260] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.363611  2463 leader_election.cc:304] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:01.365577  2542 tablet_bootstrap.cc:654] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.366906  2725 raft_consensus.cc:2749] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.370628  2642 consensus_queue.cc:1048] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:01.375792  2168 catalog_manager.cc:5697] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.377499  2347 raft_consensus.cc:2468] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:13:01.392021  2664 consensus_queue.cc:1048] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:01.390074  2544 ts_tablet_manager.cc:1434] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.126s	user 0.009s	sys 0.000s
I20260709 13:13:01.395327  2544 tablet_bootstrap.cc:492] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:01.397861  2543 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:01.398694  2543 ts_tablet_manager.cc:1403] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.132s	user 0.023s	sys 0.000s
I20260709 13:13:01.406886  2543 raft_consensus.cc:359] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.407631  2543 raft_consensus.cc:385] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.407896  2543 raft_consensus.cc:740] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.408382  2544 tablet_bootstrap.cc:654] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.415567  2543 consensus_queue.cc:260] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:13:01.431525  2313 consensus_peers.cc:597] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:01.432087  2615 consensus_queue.cc:1048] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:01.447600  2170 catalog_manager.cc:5697] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:01.449611  2792 raft_consensus.cc:493] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.451009  2792 raft_consensus.cc:515] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.460314  2541 tablet_bootstrap.cc:492] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:01.460893  2541 ts_tablet_manager.cc:1403] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.234s	user 0.050s	sys 0.007s
I20260709 13:13:01.420748  2543 ts_tablet_manager.cc:1434] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:13:01.465607  2543 tablet_bootstrap.cc:492] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:01.472337  2543 tablet_bootstrap.cc:654] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.459761  2792 leader_election.cc:290] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:01.473343  2616 raft_consensus.cc:493] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.473961  2616 raft_consensus.cc:515] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.475891  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:01.475996  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.477033  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:01.478334  2313 leader_election.cc:343] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.491695  2542 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:01.492281  2542 ts_tablet_manager.cc:1403] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.005s
I20260709 13:13:01.477066  2347 raft_consensus.cc:2468] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:13:01.498734  2542 raft_consensus.cc:359] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.505066  2616 leader_election.cc:290] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:01.507866  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.508513  2542 raft_consensus.cc:385] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.508608  2423 raft_consensus.cc:2468] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:01.509406  2542 raft_consensus.cc:740] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.510713  2718 raft_consensus.cc:493] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.511245  2718 raft_consensus.cc:515] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:01.513769  2718 leader_election.cc:290] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:01.515399  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:01.515745  2315 leader_election.cc:304] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
W20260709 13:13:01.517982  2461 leader_election.cc:343] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.518561  2542 consensus_queue.cc:260] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.518975  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.521906  2541 raft_consensus.cc:359] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.520123  2347 raft_consensus.cc:2468] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:01.523730  2541 raft_consensus.cc:385] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.524226  2541 raft_consensus.cc:740] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.524960  2541 consensus_queue.cc:260] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.526727  2460 leader_election.cc:304] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.527196  2541 ts_tablet_manager.cc:1434] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:13:01.527134  2386 leader_election.cc:304] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:01.527746  2718 raft_consensus.cc:2804] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:01.528126  2718 raft_consensus.cc:493] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.528298  2541 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:01.520358  2615 raft_consensus.cc:2804] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:01.529606  2615 raft_consensus.cc:493] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.530628  2615 raft_consensus.cc:3060] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.534991  2541 tablet_bootstrap.cc:654] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.534914  2544 tablet_bootstrap.cc:492] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:01.535715  2544 ts_tablet_manager.cc:1403] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.009s
I20260709 13:13:01.538389  2544 raft_consensus.cc:359] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.539242  2544 raft_consensus.cc:385] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.539535  2544 raft_consensus.cc:740] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.540230  2544 consensus_queue.cc:260] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.535187  2718 raft_consensus.cc:3060] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:01.554334  2389 leader_election.cc:343] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.562438  2615 raft_consensus.cc:515] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.572819  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:01.573009  2615 leader_election.cc:290] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
W20260709 13:13:01.574452  2313 leader_election.cc:343] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.577306  2542 ts_tablet_manager.cc:1434] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.000s
I20260709 13:13:01.578699  2542 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:01.580708  2725 raft_consensus.cc:493] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.581306  2725 raft_consensus.cc:515] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:13:01.581619  2386 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 54568.7us
I20260709 13:13:01.583453  2725 leader_election.cc:290] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:01.585085  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:01.585739  2419 raft_consensus.cc:3060] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.586690  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.587385  2423 raft_consensus.cc:2468] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:01.581715  2793 raft_consensus.cc:2804] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:01.588547  2793 raft_consensus.cc:493] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.588927  2793 raft_consensus.cc:3060] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.590019  2544 ts_tablet_manager.cc:1434] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:13:01.590986  2544 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:01.588617  2463 leader_election.cc:304] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:01.592099  2725 raft_consensus.cc:2804] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:01.592518  2725 raft_consensus.cc:493] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:01.592912  2725 raft_consensus.cc:3060] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.600313  2725 raft_consensus.cc:515] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.599534  2718 raft_consensus.cc:515] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:01.604342  2793 raft_consensus.cc:515] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.603485  2419 raft_consensus.cc:2468] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:01.602587  2543 tablet_bootstrap.cc:492] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:01.605482  2544 tablet_bootstrap.cc:654] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.606045  2543 ts_tablet_manager.cc:1403] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.000s
I20260709 13:13:01.607065  2793 leader_election.cc:290] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:01.607630  2541 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:01.607574  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:01.608361  2541 ts_tablet_manager.cc:1403] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.039s
W20260709 13:13:01.609742  2389 leader_election.cc:343] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.611142  2543 raft_consensus.cc:359] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.611995  2543 raft_consensus.cc:385] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.607681  2542 tablet_bootstrap.cc:654] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.611413  2718 leader_election.cc:290] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:01.612371  2543 raft_consensus.cc:740] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.613680  2725 leader_election.cc:290] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:01.611487  2541 raft_consensus.cc:359] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.614418  2541 raft_consensus.cc:385] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.613456  2543 consensus_queue.cc:260] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.614722  2541 raft_consensus.cc:740] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.616685  2543 ts_tablet_manager.cc:1434] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:01.616734  2541 consensus_queue.cc:260] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.617509  2544 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:01.618036  2544 ts_tablet_manager.cc:1403] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 13:13:01.618177  2543 tablet_bootstrap.cc:492] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:01.618702  2542 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:01.619184  2541 ts_tablet_manager.cc:1434] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:01.619233  2542 ts_tablet_manager.cc:1403] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.000s
I20260709 13:13:01.659240  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:01.662112  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:01.668926  2315 leader_election.cc:304] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.669291  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:01.670569  2419 raft_consensus.cc:3060] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.673178  2542 raft_consensus.cc:359] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:01.674578  2542 raft_consensus.cc:385] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.674912  2542 raft_consensus.cc:740] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.675086  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:01.676241  2348 raft_consensus.cc:3060] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.620221  2541 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:01.703866  2541 tablet_bootstrap.cc:654] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.704279  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:01.705291  2347 raft_consensus.cc:3060] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.706007  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:13:01.712999  2461 leader_election.cc:343] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.719551  2616 raft_consensus.cc:2804] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:01.722301  2461 leader_election.cc:343] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.723489  2616 raft_consensus.cc:697] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:01.726805  2616 consensus_queue.cc:237] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
W20260709 13:13:01.734716  2461 leader_election.cc:343] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:01.721271  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 52809.9us
I20260709 13:13:01.738559  2766 consensus_queue.cc:1048] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:01.748142  2544 raft_consensus.cc:359] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.749117  2544 raft_consensus.cc:385] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:01.749439  2544 raft_consensus.cc:740] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:01.750099  2544 consensus_queue.cc:260] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.724293  2542 consensus_queue.cc:260] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:01.760705  2271 raft_consensus.cc:3060] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:01.762866  2845 raft_consensus.cc:493] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.763902  2845 raft_consensus.cc:515] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.765786  2542 ts_tablet_manager.cc:1434] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.005s
I20260709 13:13:01.767563  2542 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:01.768891  2548 consensus_queue.cc:1048] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:01.771584  2845 leader_election.cc:290] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:01.774436  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:01.775342  2461 consensus_peers.cc:597] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:01.779912  2348 raft_consensus.cc:2468] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:13:01.781170  2544 ts_tablet_manager.cc:1434] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.163s	user 0.011s	sys 0.000s
W20260709 13:13:01.804039  2387 leader_election.cc:343] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.826749  2544 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:01.843245  2419 raft_consensus.cc:2468] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:01.847213  2542 tablet_bootstrap.cc:654] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.851366  2543 tablet_bootstrap.cc:654] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.851620  2849 raft_consensus.cc:493] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.852432  2849 raft_consensus.cc:515] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.854442  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.864620  2849 leader_election.cc:290] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:01.865103  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:01.865902  2793 raft_consensus.cc:493] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.866576  2793 raft_consensus.cc:515] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
W20260709 13:13:01.866902  2313 leader_election.cc:343] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.869181  2793 leader_election.cc:290] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:01.870714  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:01.872913  2389 leader_election.cc:343] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.878971  2386 leader_election.cc:304] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:13:01.882233  2793 raft_consensus.cc:2804] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:01.883071  2793 raft_consensus.cc:697] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:01.882664  2171 catalog_manager.cc:5697] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:01.882385  2463 leader_election.cc:304] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.884263  2793 consensus_queue.cc:237] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.886452  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.887450  2347 raft_consensus.cc:2468] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:01.893015  2852 raft_consensus.cc:493] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:01.893535  2544 tablet_bootstrap.cc:654] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:01.894016  2766 raft_consensus.cc:2804] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:01.894574  2766 raft_consensus.cc:697] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:01.895808  2766 consensus_queue.cc:237] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:01.901537  2460 leader_election.cc:304] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:01.905012  2706 raft_consensus.cc:2804] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:01.905612  2706 raft_consensus.cc:697] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:01.906873  2706 consensus_queue.cc:237] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:01.893684  2852 raft_consensus.cc:515] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:01.919294  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.919711  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d101e9e818491db6b36b9112b724f3" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:01.922873  2237 leader_election.cc:304] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:01.923947  2746 raft_consensus.cc:2749] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:01.931937  2616 consensus_queue.cc:1048] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:01.917790  2852 leader_election.cc:290] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:01.953814  2541 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:01.970551  2846 consensus_queue.cc:1048] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:01.981040  2616 raft_consensus.cc:493] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:01.989945  2315 leader_election.cc:343] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:01.990545  2315 leader_election.cc:304] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:13:01.981365  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:01.984838  2616 raft_consensus.cc:515] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:01.995322  2664 raft_consensus.cc:2749] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:01.996984  2616 leader_election.cc:290] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:01.999377  2542 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:01.999555  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:01.999961  2542 ts_tablet_manager.cc:1403] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.233s	user 0.031s	sys 0.027s
W20260709 13:13:02.001121  2315 leader_election.cc:343] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.001875  2171 catalog_manager.cc:5697] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.003189  2542 raft_consensus.cc:359] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.003933  2542 raft_consensus.cc:385] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.004315  2542 raft_consensus.cc:740] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.008380  2542 consensus_queue.cc:260] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.003862  2169 catalog_manager.cc:5697] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.011046  2542 ts_tablet_manager.cc:1434] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:02.012338  2542 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:02.019169  2541 ts_tablet_manager.cc:1403] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.399s	user 0.013s	sys 0.017s
I20260709 13:13:02.025236  2274 raft_consensus.cc:3060] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.031443  2543 tablet_bootstrap.cc:492] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:02.033792  2846 raft_consensus.cc:493] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.034992  2846 raft_consensus.cc:515] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.037473  2543 ts_tablet_manager.cc:1403] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.420s	user 0.025s	sys 0.000s
I20260709 13:13:02.039108  2495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:02.039322  2846 leader_election.cc:290] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:02.040632  2543 raft_consensus.cc:359] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.041636  2725 raft_consensus.cc:493] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.052960  2725 raft_consensus.cc:515] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.055125  2725 leader_election.cc:290] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
W20260709 13:13:02.048540  2389 leader_election.cc:343] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.051386  2541 raft_consensus.cc:359] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.055858  2541 raft_consensus.cc:385] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.056146  2541 raft_consensus.cc:740] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.057137  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:02.057993  2348 raft_consensus.cc:2393] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 1: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:13:02.058314  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.059396  2543 raft_consensus.cc:385] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.059729  2543 raft_consensus.cc:740] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
W20260709 13:13:02.059928  2387 leader_election.cc:343] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.060441  2387 leader_election.cc:304] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:02.056891  2541 consensus_queue.cc:260] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.061780  2793 raft_consensus.cc:2749] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.060550  2543 consensus_queue.cc:260] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.064389  2544 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:02.064827  2543 ts_tablet_manager.cc:1434] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.005s
I20260709 13:13:02.064944  2544 ts_tablet_manager.cc:1403] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.239s	user 0.018s	sys 0.000s
I20260709 13:13:02.066816  2543 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:02.073208  2544 raft_consensus.cc:359] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.080120  2544 raft_consensus.cc:385] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.077178  2171 catalog_manager.cc:5697] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.082649  2541 ts_tablet_manager.cc:1434] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.003s
I20260709 13:13:02.080403  2544 raft_consensus.cc:740] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.084357  2544 consensus_queue.cc:260] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.086084  2542 tablet_bootstrap.cc:654] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.086633  2544 ts_tablet_manager.cc:1434] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:13:02.087028  2543 tablet_bootstrap.cc:654] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.098798  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.100689  2419 raft_consensus.cc:2468] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:02.125902  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f79bc0e1fbb4d32923d277db6baaa91" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
W20260709 13:13:02.130231  2386 leader_election.cc:343] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.139461  2386 leader_election.cc:304] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
W20260709 13:13:02.140838  2386 leader_election.cc:343] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.141307  2386 leader_election.cc:304] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:02.139001  2544 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:02.142076  2846 raft_consensus.cc:2749] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.142753  2846 raft_consensus.cc:2749] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.147214  2548 raft_consensus.cc:493] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.147791  2548 raft_consensus.cc:515] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.148872  2541 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:02.151870  2494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:02.153491  2315 leader_election.cc:343] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.154587  2548 leader_election.cc:290] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:02.177026  2315 leader_election.cc:304] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:13:02.181300  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.177634  2542 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:02.182500  2542 ts_tablet_manager.cc:1403] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.171s	user 0.007s	sys 0.023s
I20260709 13:13:02.172653  2543 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:02.183787  2543 ts_tablet_manager.cc:1403] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.010s
I20260709 13:13:02.184664  2548 raft_consensus.cc:2804] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:02.185137  2548 raft_consensus.cc:493] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.185500  2548 raft_consensus.cc:3060] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:02.184270  2313 leader_election.cc:343] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.186899  2313 leader_election.cc:304] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:02.189097  2543 raft_consensus.cc:359] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.189246  2541 tablet_bootstrap.cc:654] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.186450  2542 raft_consensus.cc:359] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.190508  2542 raft_consensus.cc:385] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.190717  2542 raft_consensus.cc:740] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.191366  2542 consensus_queue.cc:260] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.192824  2664 raft_consensus.cc:2749] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.189852  2543 raft_consensus.cc:385] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.193744  2543 raft_consensus.cc:740] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.194450  2543 consensus_queue.cc:260] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.195591  2542 ts_tablet_manager.cc:1434] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:13:02.196758  2542 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:02.183399  2463 leader_election.cc:304] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:02.200536  2271 raft_consensus.cc:3060] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.205868  2616 consensus_queue.cc:1048] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:02.210403  2541 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:02.211009  2541 ts_tablet_manager.cc:1403] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.007s
I20260709 13:13:02.215001  2543 ts_tablet_manager.cc:1434] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:13:02.216164  2725 raft_consensus.cc:3060] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.216711  2542 tablet_bootstrap.cc:654] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.216301  2543 tablet_bootstrap.cc:492] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:02.220255  2548 raft_consensus.cc:515] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.214190  2718 raft_consensus.cc:493] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.223924  2718 raft_consensus.cc:515] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.224737  2544 tablet_bootstrap.cc:654] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.226754  2543 tablet_bootstrap.cc:654] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.227255  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:02.228129  2347 raft_consensus.cc:2393] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 1: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:13:02.214057  2541 raft_consensus.cc:359] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.234720  2541 raft_consensus.cc:385] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.235081  2541 raft_consensus.cc:740] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.235486  2846 consensus_queue.cc:1048] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:02.235816  2541 consensus_queue.cc:260] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.243096  2548 leader_election.cc:290] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:02.261775  2725 raft_consensus.cc:2749] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.272281  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:02.276644  2541 ts_tablet_manager.cc:1434] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.003s
I20260709 13:13:02.286731  2541 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:02.270763  2494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:02.287461  2494 raft_consensus.cc:3060] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.266808  2718 leader_election.cc:290] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.273093  2421 raft_consensus.cc:3060] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.293532  2541 tablet_bootstrap.cc:654] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.286795  2833 raft_consensus.cc:493] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.298804  2833 raft_consensus.cc:515] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.301345  2833 leader_election.cc:290] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:02.282953  2846 raft_consensus.cc:493] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.310209  2706 consensus_queue.cc:1048] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:02.310050  2846 raft_consensus.cc:515] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.311236  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9643f19185c4726ba1ddb57ca801a95" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.312575  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.313472  2418 raft_consensus.cc:2393] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:13:02.315419  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.310477  2274 raft_consensus.cc:3060] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.319042  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c00e7b281c741edaba5be11f02f5685" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:02.320935  2240 leader_election.cc:304] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
W20260709 13:13:02.321561  2387 leader_election.cc:343] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:02.315425  2313 consensus_peers.cc:597] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:02.326247  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:02.327134  2346 raft_consensus.cc:2468] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:13:02.329773  2386 leader_election.cc:304] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:02.330675  2793 raft_consensus.cc:2804] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:02.331061  2793 raft_consensus.cc:493] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.331424  2793 raft_consensus.cc:3060] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.333074  2544 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:02.333703  2544 ts_tablet_manager.cc:1403] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.228s	user 0.019s	sys 0.000s
I20260709 13:13:02.313344  2846 leader_election.cc:290] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:02.340597  2544 raft_consensus.cc:359] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.343736  2766 consensus_queue.cc:1048] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:02.346459  2544 raft_consensus.cc:385] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.346849  2544 raft_consensus.cc:740] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.347503  2544 consensus_queue.cc:260] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.352236  2543 tablet_bootstrap.cc:492] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:02.352771  2543 ts_tablet_manager.cc:1403] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.026s
I20260709 13:13:02.355948  2543 raft_consensus.cc:359] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.356827  2543 raft_consensus.cc:385] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.337524  2463 leader_election.cc:304] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:02.357160  2543 raft_consensus.cc:740] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.358057  2543 consensus_queue.cc:260] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.360023  2543 ts_tablet_manager.cc:1434] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:02.360252  2845 consensus_queue.cc:1048] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:02.363829  2494 raft_consensus.cc:2468] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:02.364490  2706 raft_consensus.cc:2749] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.361653  2542 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:02.368762  2542 ts_tablet_manager.cc:1403] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.172s	user 0.015s	sys 0.011s
I20260709 13:13:02.370193  2421 raft_consensus.cc:2468] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:02.370493  2733 raft_consensus.cc:2749] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.371012  2706 consensus_queue.cc:1048] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:02.368075  2846 consensus_queue.cc:1048] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:02.371615  2543 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:02.373576  2315 leader_election.cc:304] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:02.378176  2548 raft_consensus.cc:2804] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:02.378891  2548 raft_consensus.cc:697] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:02.379675  2548 consensus_queue.cc:237] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.381225  2544 ts_tablet_manager.cc:1434] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:13:02.380465  2542 raft_consensus.cc:359] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.383715  2542 raft_consensus.cc:385] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.384052  2542 raft_consensus.cc:740] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.398890  2542 consensus_queue.cc:260] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.401376  2543 tablet_bootstrap.cc:654] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.381577  2793 raft_consensus.cc:515] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.412187  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:02.409610  2793 leader_election.cc:290] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:02.418036  2542 ts_tablet_manager.cc:1434] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:13:02.422482  2542 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:02.429159  2541 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:02.429786  2541 ts_tablet_manager.cc:1403] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.143s	user 0.021s	sys 0.002s
I20260709 13:13:02.431632  2544 tablet_bootstrap.cc:492] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
W20260709 13:13:02.421265  2387 leader_election.cc:343] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.433801  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:02.434556  2348 raft_consensus.cc:3060] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.438377  2542 tablet_bootstrap.cc:654] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.451114  2725 raft_consensus.cc:493] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.451758  2725 raft_consensus.cc:515] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.454604  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab2577017124173bbf7a9a3ccf1b044" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.454823  2725 leader_election.cc:290] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:02.455369  2423 raft_consensus.cc:2468] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:02.456526  2463 leader_election.cc:304] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:02.456658  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab2577017124173bbf7a9a3ccf1b044" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.457376  2725 raft_consensus.cc:2804] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:02.457791  2725 raft_consensus.cc:493] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.458238  2725 raft_consensus.cc:3060] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:02.459625  2461 leader_election.cc:343] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.461591  2544 tablet_bootstrap.cc:654] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.461733  2664 raft_consensus.cc:493] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.462358  2664 raft_consensus.cc:515] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.464454  2664 leader_election.cc:290] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:02.469595  2725 raft_consensus.cc:515] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.476323  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:02.477115  2497 raft_consensus.cc:2468] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 2.
I20260709 13:13:02.479168  2315 leader_election.cc:304] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:02.480225  2615 raft_consensus.cc:2804] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:13:02.480623  2615 raft_consensus.cc:493] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.480985  2615 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.480672  2348 raft_consensus.cc:2468] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:13:02.483676  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.486510  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab2577017124173bbf7a9a3ccf1b044" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:02.509490  2725 leader_election.cc:290] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:02.512452  2423 raft_consensus.cc:3060] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.526243  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ab2577017124173bbf7a9a3ccf1b044" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:02.528290  2386 leader_election.cc:304] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:02.529294  2846 raft_consensus.cc:2804] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:02.529791  2846 raft_consensus.cc:697] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:02.530673  2846 consensus_queue.cc:237] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.585292  2543 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:02.586014  2543 ts_tablet_manager.cc:1403] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.215s	user 0.028s	sys 0.009s
I20260709 13:13:02.562930  2793 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.598145  2884 log.cc:927] Time spent T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:13:02.623441  2542 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:02.624135  2542 ts_tablet_manager.cc:1403] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.202s	user 0.015s	sys 0.004s
I20260709 13:13:02.629704  2541 raft_consensus.cc:359] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.630579  2541 raft_consensus.cc:385] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.630872  2541 raft_consensus.cc:740] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.631556  2541 consensus_queue.cc:260] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.624868  2793 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.640374  2616 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.651777  2897 raft_consensus.cc:493] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.647315  2833 raft_consensus.cc:493] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.678835  2423 raft_consensus.cc:2468] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:02.661384  2897 raft_consensus.cc:515] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.688318  2463 leader_election.cc:304] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:02.662519  2616 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.691845  2543 raft_consensus.cc:359] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.692596  2543 raft_consensus.cc:385] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.692809  2543 raft_consensus.cc:740] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.669632  2833 raft_consensus.cc:515] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.701059  2541 ts_tablet_manager.cc:1434] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.271s	user 0.006s	sys 0.011s
I20260709 13:13:02.701079  2543 consensus_queue.cc:260] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.707310  2616 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.707731  2876 raft_consensus.cc:2804] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:02.704471  2461 leader_election.cc:343] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.712286  2542 raft_consensus.cc:359] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.722399  2542 raft_consensus.cc:385] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.722793  2542 raft_consensus.cc:740] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.724817  2274 raft_consensus.cc:3060] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.714027  2876 raft_consensus.cc:697] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:02.711872  2793 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:02.729619  2541 tablet_bootstrap.cc:492] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:02.714792  2543 ts_tablet_manager.cc:1434] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.128s	user 0.006s	sys 0.000s
I20260709 13:13:02.731449  2544 tablet_bootstrap.cc:492] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:02.754112  2544 ts_tablet_manager.cc:1403] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.337s	user 0.016s	sys 0.005s
I20260709 13:13:02.751855  2542 consensus_queue.cc:260] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.759790  2616 raft_consensus.cc:493] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.762512  2616 raft_consensus.cc:515] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:02.738241  2833 leader_election.cc:290] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:02.731285  2897 leader_election.cc:290] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.771708  2544 raft_consensus.cc:359] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.728801  2348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:02.772475  2544 raft_consensus.cc:385] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.772796  2544 raft_consensus.cc:740] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.772850  2348 raft_consensus.cc:2468] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:13:02.774253  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.774987  2418 raft_consensus.cc:2468] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:02.775511  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:02.776919  2616 leader_election.cc:290] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
W20260709 13:13:02.741742  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:02.741533  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6ccc1fa5471499daebb6bfe28fe9eab" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:02.729786  2876 consensus_queue.cc:237] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.782245  2901 raft_consensus.cc:493] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.782835  2901 raft_consensus.cc:515] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:02.718611  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.711493  2615 raft_consensus.cc:515] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.785792  2315 leader_election.cc:304] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:02.787178  2386 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:02.773507  2544 consensus_queue.cc:260] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.795589  2548 raft_consensus.cc:2804] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:02.796084  2548 raft_consensus.cc:493] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.796447  2548 raft_consensus.cc:3060] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.798004  2419 raft_consensus.cc:2468] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:02.807277  2901 leader_election.cc:290] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:02.807981  2497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:02.808305  2898 raft_consensus.cc:2804] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.808830  2898 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.809142  2898 raft_consensus.cc:3060] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.809975  2615 leader_election.cc:290] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 3 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:02.810307  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.811702  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:02.811714  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.812765  2541 tablet_bootstrap.cc:654] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.812978  2273 raft_consensus.cc:2468] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:02.814389  2493 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:02.815124  2389 leader_election.cc:343] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.815762  2544 ts_tablet_manager.cc:1434] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:13:02.816903  2544 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:02.818552  2315 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:02.819376  2615 raft_consensus.cc:2804] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:02.819798  2615 raft_consensus.cc:493] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.820453  2615 raft_consensus.cc:3060] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.821149  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:02.821791  2706 consensus_queue.cc:1048] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:02.823877  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:02.826066  2313 leader_election.cc:343] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.827163  2898 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.827526  2706 raft_consensus.cc:493] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:02.827797  2313 leader_election.cc:343] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:02.795715  2387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:40559, user_credentials={real_user=slave}} blocked reactor thread for 116515us
I20260709 13:13:02.840024  2543 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:02.843818  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.844583  2269 raft_consensus.cc:2468] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:13:02.845853  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:02.837415  2845 raft_consensus.cc:493] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf33d724fb704d85ab3127e566123c10)
I20260709 13:13:02.847607  2845 raft_consensus.cc:515] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.851310  2544 tablet_bootstrap.cc:654] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.856086  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:02.857481  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:02.859627  2493 raft_consensus.cc:2468] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 3.
I20260709 13:13:02.869848  2240 leader_election.cc:304] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:02.870800  2733 raft_consensus.cc:2749] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:02.873596  2387 leader_election.cc:343] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.874183  2387 leader_election.cc:304] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:02.875617  2846 raft_consensus.cc:2749] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.830407  2706 raft_consensus.cc:515] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.879722  2706 leader_election.cc:290] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.880311  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7fbb0337a84684b74dd9e6b31e2863" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:02.880506  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:13:02.881737  2460 leader_election.cc:343] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.882100  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.882885  2418 raft_consensus.cc:2468] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:02.883029  2347 raft_consensus.cc:2368] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 for earlier term 2. Current term is 3.
I20260709 13:13:02.885082  2463 leader_election.cc:304] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: cf33d724fb704d85ab3127e566123c10
W20260709 13:13:02.877887  2917 log.cc:927] Time spent T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 13:13:02.886821  2315 leader_election.cc:343] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.887826  2315 leader_election.cc:304] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:02.890013  2548 raft_consensus.cc:515] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.851066  2845 leader_election.cc:290] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:02.895510  2315 leader_election.cc:304] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: e98dadf6176848ef8893b68c45629066
I20260709 13:13:02.896945  2899 raft_consensus.cc:2749] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.896488  2171 catalog_manager.cc:5697] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:02.896806  2849 consensus_queue.cc:1048] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:02.893890  2615 raft_consensus.cc:515] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.891150  2725 raft_consensus.cc:2804] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:02.900324  2548 leader_election.cc:290] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.903258  2542 ts_tablet_manager.cc:1434] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.279s	user 0.011s	sys 0.012s
I20260709 13:13:02.907783  2902 raft_consensus.cc:2804] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:02.908383  2902 raft_consensus.cc:697] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:02.909240  2902 consensus_queue.cc:237] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.909740  2898 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:02.911265  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:02.910283  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:02.911921  2418 raft_consensus.cc:3060] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.902799  2725 raft_consensus.cc:493] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:02.912497  2725 raft_consensus.cc:3060] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.914330  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:02.921566  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:02.922278  2271 raft_consensus.cc:3060] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:02.930246  2386 leader_election.cc:400] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Vote denied by peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949) with higher term. Message: Invalid argument: T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 for earlier term 2. Current term is 3.
W20260709 13:13:02.930526  2313 leader_election.cc:343] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:02.930940  2349 raft_consensus.cc:2393] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 in current term 2: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:13:02.932446  2386 leader_election.cc:403] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:13:02.934556  2898 raft_consensus.cc:3060] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:13:02.944125  2896 consensus_queue.cc:1048] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:02.946899  2541 tablet_bootstrap.cc:492] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:02.947535  2541 ts_tablet_manager.cc:1403] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.218s	user 0.015s	sys 0.009s
I20260709 13:13:02.944593  2898 raft_consensus.cc:2749] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949) with higher term. Message: Invalid argument: T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e98dadf6176848ef8893b68c45629066 for earlier term 2. Current term is 3.
I20260709 13:13:02.961777  2543 tablet_bootstrap.cc:654] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.963869  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:02.969000  2725 raft_consensus.cc:515] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.957422  2541 raft_consensus.cc:359] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.970460  2541 raft_consensus.cc:385] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.970714  2541 raft_consensus.cc:740] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.971252  2541 consensus_queue.cc:260] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:02.974709  2542 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:02.980490  2541 ts_tablet_manager.cc:1434] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:13:02.981244  2915 raft_consensus.cc:493] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:02.981879  2541 tablet_bootstrap.cc:492] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:02.981789  2915 raft_consensus.cc:515] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:02.984215  2915 leader_election.cc:290] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.984807  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2bd883297624b7eb3b686e8c91fa005" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:02.985353  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:02.985622  2423 raft_consensus.cc:2393] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 2: Already voted for candidate e98dadf6176848ef8893b68c45629066 in this term.
I20260709 13:13:02.988873  2544 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:02.989405  2544 ts_tablet_manager.cc:1403] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.173s	user 0.010s	sys 0.005s
I20260709 13:13:02.990242  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da1c8eb5f0b9448c8761472608c325e3" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:02.990933  2315 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:13:02.991964  2237 leader_election.cc:304] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:02.992251  2896 raft_consensus.cc:2749] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:02.993284  2915 raft_consensus.cc:2749] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:02.994441  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:02.995101  2347 raft_consensus.cc:3060] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.995718  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:02.996011  2271 raft_consensus.cc:2468] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:02.996351  2423 raft_consensus.cc:3060] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:02.977056  2615 leader_election.cc:290] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.997139  2387 leader_election.cc:304] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: cf33d724fb704d85ab3127e566123c10
I20260709 13:13:02.999075  2845 raft_consensus.cc:2804] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:02.999641  2845 raft_consensus.cc:697] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:03.000526  2845 consensus_queue.cc:237] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.001730  2347 raft_consensus.cc:2468] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:02.993350  2725 leader_election.cc:290] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:02.999748  2541 tablet_bootstrap.cc:654] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.004132  2460 leader_election.cc:304] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:03.013170  2423 raft_consensus.cc:2468] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:02.992093  2418 raft_consensus.cc:2468] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:03.015331  2315 leader_election.cc:304] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:03.015762  2718 raft_consensus.cc:2804] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.019057  2544 raft_consensus.cc:359] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.019922  2544 raft_consensus.cc:385] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.020190  2544 raft_consensus.cc:740] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.016325  2718 raft_consensus.cc:697] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:03.020993  2544 consensus_queue.cc:260] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.022040  2718 consensus_queue.cc:237] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.023736  2544 ts_tablet_manager.cc:1434] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 13:13:03.029243  2542 tablet_bootstrap.cc:654] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.018281  2615 raft_consensus.cc:2804] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.037847  2615 raft_consensus.cc:697] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:03.038280  2544 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:03.039000  2615 consensus_queue.cc:237] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.047039  2168 catalog_manager.cc:5697] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.052412  2544 tablet_bootstrap.cc:654] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.053396  2898 raft_consensus.cc:493] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.053960  2898 raft_consensus.cc:515] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.065851  2898 leader_election.cc:290] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:03.073776  2543 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:03.074493  2543 ts_tablet_manager.cc:1403] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.243s	user 0.010s	sys 0.013s
I20260709 13:13:03.075994  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:13:03.077781  2386 leader_election.cc:343] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.077548  2543 raft_consensus.cc:359] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.078454  2543 raft_consensus.cc:385] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.078765  2543 raft_consensus.cc:740] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.079670  2543 consensus_queue.cc:260] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.081884  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:03.083380  2543 ts_tablet_manager.cc:1434] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
W20260709 13:13:03.083359  2389 leader_election.cc:343] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.084079  2389 leader_election.cc:304] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:03.084729  2543 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:03.086841  2845 raft_consensus.cc:2749] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.088696  2542 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:03.091737  2542 ts_tablet_manager.cc:1403] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.004s
I20260709 13:13:03.094954  2541 tablet_bootstrap.cc:492] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:03.095531  2541 ts_tablet_manager.cc:1403] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.005s
I20260709 13:13:03.096437  2542 raft_consensus.cc:359] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.099062  2542 raft_consensus.cc:385] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.099123  2544 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:03.099802  2542 raft_consensus.cc:740] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.100176  2544 ts_tablet_manager.cc:1403] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.006s
I20260709 13:13:03.100656  2542 consensus_queue.cc:260] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.098313  2541 raft_consensus.cc:359] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.101696  2541 raft_consensus.cc:385] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.102003  2541 raft_consensus.cc:740] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.102758  2543 tablet_bootstrap.cc:654] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.094179  2170 catalog_manager.cc:5697] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.109215  2542 ts_tablet_manager.cc:1434] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:13:03.110411  2542 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:03.102834  2541 consensus_queue.cc:260] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.117245  2541 ts_tablet_manager.cc:1434] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:13:03.117440  2169 catalog_manager.cc:5697] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.119441  2725 raft_consensus.cc:493] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.120589  2725 raft_consensus.cc:515] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.118952  2544 raft_consensus.cc:359] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.123353  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:03.123778  2544 raft_consensus.cc:385] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.124070  2423 raft_consensus.cc:2468] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:03.124238  2544 raft_consensus.cc:740] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.125452  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:03.125607  2463 leader_election.cc:304] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:03.126714  2894 raft_consensus.cc:2804] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.127147  2894 raft_consensus.cc:493] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.119724  2169 catalog_manager.cc:5697] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:03.127022  2461 leader_election.cc:343] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.127635  2894 raft_consensus.cc:3060] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.128121  2541 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:03.132499  2615 raft_consensus.cc:493] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.133073  2615 raft_consensus.cc:515] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.127643  2725 leader_election.cc:290] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:03.134950  2615 leader_election.cc:290] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:03.136348  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:03.138607  2315 leader_election.cc:343] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.137848  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:03.139629  2423 raft_consensus.cc:2468] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:03.138010  2542 tablet_bootstrap.cc:654] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.140939  2315 leader_election.cc:304] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:13:03.142325  2615 raft_consensus.cc:2804] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.142689  2615 raft_consensus.cc:493] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.142980  2615 raft_consensus.cc:3060] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.143354  2541 tablet_bootstrap.cc:654] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.145162  2894 raft_consensus.cc:515] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.128089  2544 consensus_queue.cc:260] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.148335  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:03.148970  2423 raft_consensus.cc:3060] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.152195  2544 ts_tablet_manager.cc:1434] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
I20260709 13:13:03.153362  2544 tablet_bootstrap.cc:492] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:03.156396  2898 raft_consensus.cc:493] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.156961  2898 raft_consensus.cc:515] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.158041  2168 catalog_manager.cc:5697] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 2, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.159438  2898 leader_election.cc:290] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:03.161182  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:03.161494  2544 tablet_bootstrap.cc:654] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.162904  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:13:03.165282  2386 leader_election.cc:343] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.166121  2423 raft_consensus.cc:2468] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
W20260709 13:13:03.166139  2387 leader_election.cc:343] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.167959  2387 leader_election.cc:304] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:03.167500  2463 leader_election.cc:304] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:03.171172  2169 catalog_manager.cc:5697] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.168772  2615 raft_consensus.cc:515] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.174533  2718 raft_consensus.cc:2804] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.175102  2718 raft_consensus.cc:697] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:03.175925  2718 consensus_queue.cc:237] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.178027  2898 raft_consensus.cc:2749] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.183692  2915 raft_consensus.cc:493] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.184371  2915 raft_consensus.cc:515] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.173195  2725 raft_consensus.cc:493] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.186389  2725 raft_consensus.cc:515] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.189459  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:03.190260  2423 raft_consensus.cc:2468] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:03.193169  2463 leader_election.cc:304] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:03.194895  2909 raft_consensus.cc:2804] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.195300  2909 raft_consensus.cc:493] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.195636  2909 raft_consensus.cc:3060] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.195791  2543 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:03.196161  2915 leader_election.cc:290] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:03.196760  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:03.197211  2725 leader_election.cc:290] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:03.198843  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:03.200320  2461 leader_election.cc:343] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.200300  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:03.201231  2423 raft_consensus.cc:3060] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.202701  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:03.204144  2240 leader_election.cc:304] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:03.205310  2915 raft_consensus.cc:2749] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.210588  2909 raft_consensus.cc:515] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.213243  2542 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:03.213769  2542 ts_tablet_manager.cc:1403] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.000s
I20260709 13:13:03.216563  2542 raft_consensus.cc:359] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.217273  2542 raft_consensus.cc:385] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.209985  2615 leader_election.cc:290] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:03.217478  2909 leader_election.cc:290] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:03.217532  2542 raft_consensus.cc:740] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.220546  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:03.220329  2542 consensus_queue.cc:260] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.221165  2421 raft_consensus.cc:3060] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.221807  2271 raft_consensus.cc:3060] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.222723  2542 ts_tablet_manager.cc:1434] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:03.224334  2542 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:03.229333  2898 consensus_queue.cc:1048] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.230504  2542 tablet_bootstrap.cc:654] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:03.235586  2387 consensus_peers.cc:597] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.238014  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
W20260709 13:13:03.240970  2315 leader_election.cc:343] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.248356  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:03.249987  2543 ts_tablet_manager.cc:1403] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.003s
I20260709 13:13:03.252948  2543 raft_consensus.cc:359] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.253645  2543 raft_consensus.cc:385] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.258819  2541 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:03.259451  2541 ts_tablet_manager.cc:1403] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.132s	user 0.017s	sys 0.000s
W20260709 13:13:03.260524  2461 leader_election.cc:343] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.262393  2898 raft_consensus.cc:493] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.263093  2898 raft_consensus.cc:515] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.262421  2541 raft_consensus.cc:359] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.246595  2168 catalog_manager.cc:5697] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.267992  2541 raft_consensus.cc:385] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.270112  2541 raft_consensus.cc:740] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.293987  2541 consensus_queue.cc:260] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.304524  2898 leader_election.cc:290] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:03.306178  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:03.307592  2389 leader_election.cc:343] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.315048  2894 leader_election.cc:290] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:03.322726  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:03.323621  2421 raft_consensus.cc:2468] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
W20260709 13:13:03.325580  2387 leader_election.cc:343] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.326278  2387 leader_election.cc:304] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:03.327198  2908 raft_consensus.cc:2749] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.328735  2463 leader_election.cc:304] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:03.330163  2766 raft_consensus.cc:2804] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.330775  2766 raft_consensus.cc:697] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:03.331878  2766 consensus_queue.cc:237] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:13:03.333094  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 63953.1us
I20260709 13:13:03.333964  2541 ts_tablet_manager.cc:1434] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 13:13:03.335057  2541 tablet_bootstrap.cc:492] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:03.335083  2543 raft_consensus.cc:740] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.343464  2543 consensus_queue.cc:260] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.327131  2423 raft_consensus.cc:2468] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:03.345583  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:03.330622  2271 raft_consensus.cc:3060] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.345674  2541 tablet_bootstrap.cc:654] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.348165  2543 ts_tablet_manager.cc:1434] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260709 13:13:03.349360  2543 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
W20260709 13:13:03.350673  2461 leader_election.cc:343] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.346630  2315 leader_election.cc:304] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:13:03.355564  2902 raft_consensus.cc:2804] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.356109  2902 raft_consensus.cc:697] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:03.357053  2902 consensus_queue.cc:237] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.360291  2544 tablet_bootstrap.cc:492] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:03.360888  2544 ts_tablet_manager.cc:1403] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.208s	user 0.039s	sys 0.031s
I20260709 13:13:03.361982  2542 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:03.362546  2542 ts_tablet_manager.cc:1403] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.138s	user 0.039s	sys 0.027s
I20260709 13:13:03.363643  2544 raft_consensus.cc:359] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.364387  2544 raft_consensus.cc:385] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.364671  2544 raft_consensus.cc:740] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.365442  2542 raft_consensus.cc:359] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.366235  2542 raft_consensus.cc:385] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.366500  2542 raft_consensus.cc:740] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.367251  2542 consensus_queue.cc:260] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.367753  2544 consensus_queue.cc:260] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.369802  2542 ts_tablet_manager.cc:1434] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:03.370865  2542 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:03.371730  2544 ts_tablet_manager.cc:1434] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:13:03.375991  2544 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:03.381076  2541 tablet_bootstrap.cc:492] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:03.381567  2541 ts_tablet_manager.cc:1403] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.004s
I20260709 13:13:03.392829  2544 tablet_bootstrap.cc:654] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.387048  2909 consensus_queue.cc:1048] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:13:03.395784  2725 consensus_queue.cc:1048] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.398325  2541 raft_consensus.cc:359] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.399129  2541 raft_consensus.cc:385] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.399181  2274 raft_consensus.cc:3060] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.402554  2541 raft_consensus.cc:740] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.409313  2541 consensus_queue.cc:260] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.414804  2543 tablet_bootstrap.cc:654] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.428870  2541 ts_tablet_manager.cc:1434] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:13:03.439008  2542 tablet_bootstrap.cc:654] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.445650  2541 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:03.460681  2849 raft_consensus.cc:493] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.461269  2849 raft_consensus.cc:515] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.463346  2849 leader_election.cc:290] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:03.464488  2168 catalog_manager.cc:5697] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.467499  2544 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:03.468024  2544 ts_tablet_manager.cc:1403] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.029s
I20260709 13:13:03.467819  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e0b15b3c884b8e99633d52c01d1f64" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:03.470333  2169 catalog_manager.cc:5697] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.471365  2419 raft_consensus.cc:2468] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:03.468588  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e0b15b3c884b8e99633d52c01d1f64" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:03.489732  2541 tablet_bootstrap.cc:654] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.490209  2725 consensus_queue.cc:1048] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:13:03.495802  2315 leader_election.cc:304] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:03.499547  2493 raft_consensus.cc:1275] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Refusing update from remote peer cf33d724fb704d85ab3127e566123c10: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:03.501334  2896 raft_consensus.cc:2804] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.501824  2896 raft_consensus.cc:493] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.502183  2896 raft_consensus.cc:3060] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:03.508558  2315 leader_election.cc:343] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.509833  2543 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:03.510452  2543 ts_tablet_manager.cc:1403] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.161s	user 0.008s	sys 0.005s
I20260709 13:13:03.513500  2543 raft_consensus.cc:359] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.514315  2900 consensus_queue.cc:1048] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.514978  2543 raft_consensus.cc:385] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.515301  2543 raft_consensus.cc:740] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.515980  2543 consensus_queue.cc:260] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.559998  2543 ts_tablet_manager.cc:1434] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.003s
I20260709 13:13:03.561244  2544 raft_consensus.cc:359] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.563118  2544 raft_consensus.cc:385] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.563418  2544 raft_consensus.cc:740] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.570443  2544 consensus_queue.cc:260] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.576610  2543 tablet_bootstrap.cc:492] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:03.578784  2544 ts_tablet_manager.cc:1434] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.003s
I20260709 13:13:03.587757  2542 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:03.588074  2419 raft_consensus.cc:1275] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Refusing update from remote peer cf33d724fb704d85ab3127e566123c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:03.588383  2542 ts_tablet_manager.cc:1403] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.218s	user 0.041s	sys 0.030s
I20260709 13:13:03.592929  2544 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066: Bootstrap starting.
I20260709 13:13:03.594445  2615 consensus_queue.cc:1048] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.594848  2541 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:03.595346  2541 ts_tablet_manager.cc:1403] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.000s
I20260709 13:13:03.571434  2896 raft_consensus.cc:515] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.609519  2541 raft_consensus.cc:359] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.610350  2541 raft_consensus.cc:385] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.610616  2541 raft_consensus.cc:740] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.611351  2541 consensus_queue.cc:260] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.614678  2900 consensus_queue.cc:1048] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.616084  2541 ts_tablet_manager.cc:1434] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:13:03.618829  2343 raft_consensus.cc:1275] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:13:03.621228  2461 consensus_peers.cc:597] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.622412  2541 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:03.627692  2269 raft_consensus.cc:1275] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:03.629820  2908 consensus_queue.cc:1048] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.632815  2900 raft_consensus.cc:493] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.633381  2900 raft_consensus.cc:515] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.633953  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e0b15b3c884b8e99633d52c01d1f64" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:03.635531  2900 leader_election.cc:290] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:03.636178  2898 consensus_queue.cc:1048] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.636888  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e0b15b3c884b8e99633d52c01d1f64" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:03.637526  2420 raft_consensus.cc:3060] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.637583  2706 raft_consensus.cc:493] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.641845  2706 raft_consensus.cc:515] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.644604  2706 leader_election.cc:290] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:03.645959  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:03.646575  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7db953c1cb4d7282bfab9976f3998b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:03.651964  2315 leader_election.cc:343] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.655072  2543 tablet_bootstrap.cc:654] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.656008  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7db953c1cb4d7282bfab9976f3998b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:03.657341  2313 leader_election.cc:343] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.658011  2544 tablet_bootstrap.cc:654] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:03.664072  2315 leader_election.cc:343] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.664659  2315 leader_election.cc:304] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:03.666443  2902 raft_consensus.cc:2749] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.633756  2896 leader_election.cc:290] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:03.667790  2909 consensus_queue.cc:1048] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.666567  2706 consensus_queue.cc:1048] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:13:03.703507  2915 raft_consensus.cc:493] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.704082  2915 raft_consensus.cc:515] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.706512  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:03.707231  2343 raft_consensus.cc:2468] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
W20260709 13:13:03.675101  2461 leader_election.cc:343] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.715780  2915 leader_election.cc:290] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
W20260709 13:13:03.736173  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 46672.8us
W20260709 13:13:03.716097  2461 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:40559, user_credentials={real_user=slave}} blocked reactor thread for 46650.4us
I20260709 13:13:03.741681  2541 tablet_bootstrap.cc:654] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.752336  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:03.753116  2489 raft_consensus.cc:2468] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:13:03.752375  2544 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066: No bootstrap required, opened a new log
I20260709 13:13:03.754485  2544 ts_tablet_manager.cc:1403] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066: Time spent bootstrapping tablet: real 0.168s	user 0.018s	sys 0.026s
I20260709 13:13:03.742077  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:03.757153  2544 raft_consensus.cc:359] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:03.759951  2544 raft_consensus.cc:385] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.760249  2544 raft_consensus.cc:740] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e98dadf6176848ef8893b68c45629066, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.763705  2544 consensus_queue.cc:260] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:13:03.771793  2956 log.cc:927] Time spent T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:13:03.777245  2542 raft_consensus.cc:359] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.778085  2542 raft_consensus.cc:385] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.778456  2542 raft_consensus.cc:740] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.779842  2896 raft_consensus.cc:493] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.780429  2896 raft_consensus.cc:515] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.782624  2896 leader_election.cc:290] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:03.759049  2343 raft_consensus.cc:2468] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 0.
I20260709 13:13:03.779142  2542 consensus_queue.cc:260] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.784094  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:03.785166  2237 leader_election.cc:304] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:03.785598  2542 ts_tablet_manager.cc:1434] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.194s	user 0.008s	sys 0.004s
I20260709 13:13:03.786100  2915 raft_consensus.cc:2804] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.786520  2915 raft_consensus.cc:493] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:03.786675  2313 leader_election.cc:343] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.786900  2915 raft_consensus.cc:3060] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.795962  2544 ts_tablet_manager.cc:1434] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
W20260709 13:13:03.798062  2313 consensus_peers.cc:597] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.812588  2542 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:03.817344  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:03.806484  2420 raft_consensus.cc:2468] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:03.825585  2422 raft_consensus.cc:2468] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 0.
I20260709 13:13:03.868374  2541 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:03.868933  2541 ts_tablet_manager.cc:1403] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.247s	user 0.015s	sys 0.008s
I20260709 13:13:03.870420  2460 leader_election.cc:304] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:03.891891  2543 tablet_bootstrap.cc:492] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:03.897817  2543 ts_tablet_manager.cc:1403] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.325s	user 0.022s	sys 0.021s
I20260709 13:13:03.892096  2541 raft_consensus.cc:359] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.899634  2541 raft_consensus.cc:385] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.899957  2541 raft_consensus.cc:740] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.894299  2315 leader_election.cc:304] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b
I20260709 13:13:03.902410  2315 leader_election.cc:304] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:03.903298  2849 raft_consensus.cc:2804] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.892938  2894 raft_consensus.cc:2804] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.904244  2894 raft_consensus.cc:493] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.904547  2541 consensus_queue.cc:260] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
W20260709 13:13:03.891224  2387 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:40559, user_credentials={real_user=slave}} blocked reactor thread for 79553.8us
I20260709 13:13:03.909288  2542 tablet_bootstrap.cc:654] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.918421  2852 raft_consensus.cc:493] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.919106  2849 raft_consensus.cc:697] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:03.920159  2849 consensus_queue.cc:237] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.920825  2541 ts_tablet_manager.cc:1434] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.052s	user 0.002s	sys 0.005s
W20260709 13:13:03.902830  2460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 193013us
I20260709 13:13:03.931149  2541 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10: Bootstrap starting.
I20260709 13:13:03.904629  2894 raft_consensus.cc:3060] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.923095  2852 raft_consensus.cc:515] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.955868  2852 leader_election.cc:290] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
W20260709 13:13:03.959944  2461 consensus_peers.cc:597] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:03.942381  2902 raft_consensus.cc:2804] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.967147  2902 raft_consensus.cc:493] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.967511  2902 raft_consensus.cc:3060] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.969799  2541 tablet_bootstrap.cc:654] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.975072  2915 raft_consensus.cc:515] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:03.977192  2915 leader_election.cc:290] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:03.982247  2971 raft_consensus.cc:493] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.982793  2971 raft_consensus.cc:515] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:03.984916  2971 leader_election.cc:290] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:03.987869  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b1f2e989a49adbbe3fda8fa181a98" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:03.965694  2543 raft_consensus.cc:359] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.991694  2543 raft_consensus.cc:385] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.991973  2543 raft_consensus.cc:740] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.992733  2543 consensus_queue.cc:260] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:03.995337  2543 ts_tablet_manager.cc:1434] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.000s
I20260709 13:13:03.996312  2543 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
W20260709 13:13:04.000700  2387 leader_election.cc:343] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.004391  2615 consensus_queue.cc:1048] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:04.011085  2315 consensus_peers.cc:597] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 -> Peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Couldn't send request to peer 7d612b55885c4aee87952bd05925f03b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:04.014310  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b1f2e989a49adbbe3fda8fa181a98" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.019982  2343 raft_consensus.cc:2468] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 0.
I20260709 13:13:04.022141  2386 leader_election.cc:304] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.016713  2725 raft_consensus.cc:493] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.023851  2969 raft_consensus.cc:2804] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:04.023672  2725 raft_consensus.cc:515] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:04.024289  2969 raft_consensus.cc:493] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.024700  2969 raft_consensus.cc:3060] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.029626  2718 consensus_queue.cc:1048] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:04.032485  2725 leader_election.cc:290] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:04.034487  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.034977  2902 raft_consensus.cc:515] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.061293  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87781f9dd28d4ae7bcf9a3daf87ed7f8" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:04.088342  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.097972  2273 raft_consensus.cc:3060] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.105571  2463 leader_election.cc:304] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:04.107091  2706 raft_consensus.cc:2749] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.110627  2542 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.111214  2542 ts_tablet_manager.cc:1403] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.309s	user 0.019s	sys 0.007s
I20260709 13:13:04.124202  2969 raft_consensus.cc:515] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.133219  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:04.133942  2496 raft_consensus.cc:3060] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.135099  2421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63b29c3e7d3b4be7aab7aa8cf53c04a8" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:04.137646  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:04.138367  2349 raft_consensus.cc:3060] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.138530  2240 leader_election.cc:304] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:04.144410  2542 raft_consensus.cc:359] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.145138  2542 raft_consensus.cc:385] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.146486  2969 leader_election.cc:290] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:04.146988  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b1f2e989a49adbbe3fda8fa181a98" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:13:04.148658  2387 leader_election.cc:343] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.150615  2902 leader_election.cc:290] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:04.154213  2349 raft_consensus.cc:2468] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:13:04.155489  2237 leader_election.cc:304] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:04.156710  2852 raft_consensus.cc:2804] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:04.157212  2852 raft_consensus.cc:697] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:04.158345  2852 consensus_queue.cc:237] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.160589  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b1f2e989a49adbbe3fda8fa181a98" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:04.161258  2344 raft_consensus.cc:3060] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.160082  2170 catalog_manager.cc:5697] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.167918  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:04.168679  2422 raft_consensus.cc:3060] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.145439  2542 raft_consensus.cc:740] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.176537  2543 tablet_bootstrap.cc:654] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.176736  2542 consensus_queue.cc:260] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.178206  2541 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10: No bootstrap required, opened a new log
I20260709 13:13:04.178725  2541 ts_tablet_manager.cc:1403] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10: Time spent bootstrapping tablet: real 0.257s	user 0.034s	sys 0.020s
I20260709 13:13:04.183727  2542 ts_tablet_manager.cc:1434] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.002s
I20260709 13:13:04.195835  2541 raft_consensus.cc:359] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.198922  2541 raft_consensus.cc:385] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:04.199100  2313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:40559, user_credentials={real_user=slave}} blocked reactor thread for 84742.3us
I20260709 13:13:04.199415  2541 raft_consensus.cc:740] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.201170  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:04.207181  2344 raft_consensus.cc:2468] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
I20260709 13:13:04.207723  2493 raft_consensus.cc:3060] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.156822  2894 raft_consensus.cc:515] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.187593  2970 raft_consensus.cc:493] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:13:04.221570  2313 leader_election.cc:343] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.221439  2541 consensus_queue.cc:260] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.230815  2542 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.233759  2386 leader_election.cc:304] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.235024  2975 raft_consensus.cc:2804] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:04.235563  2975 raft_consensus.cc:697] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:04.236425  2975 consensus_queue.cc:237] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
W20260709 13:13:04.236963  2219 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:04.239529  2894 leader_election.cc:290] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:04.233390  2973 raft_consensus.cc:2749] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.246372  2541 ts_tablet_manager.cc:1434] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.000s
I20260709 13:13:04.231446  2970 raft_consensus.cc:515] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.248997  2496 raft_consensus.cc:2468] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 1.
I20260709 13:13:04.252893  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:04.254370  2387 leader_election.cc:343] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.249261  2970 leader_election.cc:290] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:04.262354  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:04.279031  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:04.279743  2347 raft_consensus.cc:3060] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:13:04.281386  2461 leader_election.cc:343] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.269536  2496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:04.286120  2389 leader_election.cc:343] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.286643  2389 leader_election.cc:304] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.287463  2969 raft_consensus.cc:2749] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.288316  2542 tablet_bootstrap.cc:654] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.296949  2347 raft_consensus.cc:2468] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:04.307837  2543 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:04.308455  2543 ts_tablet_manager.cc:1403] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.312s	user 0.022s	sys 0.014s
I20260709 13:13:04.312953  2543 raft_consensus.cc:359] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.313740  2543 raft_consensus.cc:385] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.302258  2460 leader_election.cc:304] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.315932  2766 raft_consensus.cc:2804] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:04.316499  2766 raft_consensus.cc:697] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:04.317373  2766 consensus_queue.cc:237] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.299829  2422 raft_consensus.cc:2468] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:04.314045  2543 raft_consensus.cc:740] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.324270  2315 leader_election.cc:304] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.326139  2615 raft_consensus.cc:2804] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:04.326699  2615 raft_consensus.cc:697] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:04.327514  2615 consensus_queue.cc:237] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.337195  2543 consensus_queue.cc:260] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.350008  2542 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.350590  2542 ts_tablet_manager.cc:1403] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.127s	user 0.028s	sys 0.002s
I20260709 13:13:04.359465  2542 raft_consensus.cc:359] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.360404  2542 raft_consensus.cc:385] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.360751  2542 raft_consensus.cc:740] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.361549  2542 consensus_queue.cc:260] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.363929  2542 ts_tablet_manager.cc:1434] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:04.365059  2273 raft_consensus.cc:3060] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.369107  2543 ts_tablet_manager.cc:1434] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.003s
I20260709 13:13:04.370574  2543 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:04.376103  2542 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.382192  2615 raft_consensus.cc:493] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.382752  2615 raft_consensus.cc:515] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.383749  2542 tablet_bootstrap.cc:654] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.386222  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:04.387833  2313 leader_election.cc:343] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.388443  2615 leader_election.cc:290] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:04.393544  2973 raft_consensus.cc:493] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.394721  2973 raft_consensus.cc:515] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.397054  2973 leader_election.cc:290] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:04.398541  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.398981  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f322094126754e8885c94371d6292e5b" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:04.399902  2274 raft_consensus.cc:3060] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.403191  2542 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.403858  2542 ts_tablet_manager.cc:1403] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 13:13:04.406388  2240 leader_election.cc:304] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:04.407032  2542 raft_consensus.cc:359] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.407739  2542 raft_consensus.cc:385] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.408006  2542 raft_consensus.cc:740] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.408730  2542 consensus_queue.cc:260] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.409788  2168 catalog_manager.cc:5697] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 0 to 1, leader changed from <none> to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.425081  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:04.433254  2542 ts_tablet_manager.cc:1434] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.029s	user 0.018s	sys 0.001s
I20260709 13:13:04.434948  2543 tablet_bootstrap.cc:654] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.435566  2542 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.446844  2542 tablet_bootstrap.cc:654] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.458966  2543 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:04.459470  2543 ts_tablet_manager.cc:1403] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.021s
I20260709 13:13:04.462320  2543 raft_consensus.cc:359] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.463135  2543 raft_consensus.cc:385] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.463452  2543 raft_consensus.cc:740] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.463011  2169 catalog_manager.cc:5697] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.464092  2543 consensus_queue.cc:260] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.466617  2543 ts_tablet_manager.cc:1434] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:13:04.467597  2543 tablet_bootstrap.cc:492] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:04.474299  2543 tablet_bootstrap.cc:654] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.488984  2171 catalog_manager.cc:5697] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.506312  2543 tablet_bootstrap.cc:492] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:04.506879  2543 ts_tablet_manager.cc:1403] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.005s
I20260709 13:13:04.510289  2543 raft_consensus.cc:359] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:04.510964  2543 raft_consensus.cc:385] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.511217  2543 raft_consensus.cc:740] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.511888  2894 raft_consensus.cc:493] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.512398  2894 raft_consensus.cc:515] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.514678  2894 leader_election.cc:290] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:04.518262  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7db953c1cb4d7282bfab9976f3998b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.519008  2347 raft_consensus.cc:2468] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:04.520797  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7db953c1cb4d7282bfab9976f3998b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:04.522805  2543 consensus_queue.cc:260] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:04.525367  2543 ts_tablet_manager.cc:1434] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:04.526634  2543 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
I20260709 13:13:04.527601  2615 consensus_queue.cc:1048] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.521075  2460 leader_election.cc:304] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:04.532933  2894 raft_consensus.cc:2804] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:04.533331  2894 raft_consensus.cc:493] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:13:04.533443  2461 leader_election.cc:343] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.533692  2894 raft_consensus.cc:3060] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.528823  2171 catalog_manager.cc:5697] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.546484  2543 tablet_bootstrap.cc:654] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.558733  2894 raft_consensus.cc:515] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.561547  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7db953c1cb4d7282bfab9976f3998b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:04.563491  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb7db953c1cb4d7282bfab9976f3998b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:04.564096  2349 raft_consensus.cc:3060] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.568023  2543 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:04.568562  2543 ts_tablet_manager.cc:1403] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.004s
W20260709 13:13:04.570235  2315 leader_election.cc:343] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:04.570535  2461 leader_election.cc:343] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.572536  2543 raft_consensus.cc:359] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.563517  2894 leader_election.cc:290] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:04.574911  2349 raft_consensus.cc:2468] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:04.578001  2460 leader_election.cc:304] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.581139  2725 raft_consensus.cc:2804] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:04.581794  2725 raft_consensus.cc:697] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:04.582680  2725 consensus_queue.cc:237] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.586087  2974 consensus_queue.cc:1048] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:04.573269  2543 raft_consensus.cc:385] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.594789  2974 raft_consensus.cc:493] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.595345  2974 raft_consensus.cc:515] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.597420  2974 leader_election.cc:290] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:04.594463  2543 raft_consensus.cc:740] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.598515  2543 consensus_queue.cc:260] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.601425  2543 ts_tablet_manager.cc:1434] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:13:04.602483  2543 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b: Bootstrap starting.
W20260709 13:13:04.602877  2463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 45219.7us
I20260709 13:13:04.609548  2894 raft_consensus.cc:493] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.610630  2543 tablet_bootstrap.cc:654] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.610239  2894 raft_consensus.cc:515] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.613297  2894 leader_election.cc:290] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:04.614421  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:04.617036  2461 leader_election.cc:343] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.570727  2315 leader_election.cc:304] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.626309  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:04.629194  2974 consensus_queue.cc:1048] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.642711  2615 raft_consensus.cc:2749] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.644039  2543 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b: No bootstrap required, opened a new log
I20260709 13:13:04.644558  2543 ts_tablet_manager.cc:1403] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.003s
I20260709 13:13:04.635773  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a5d1b594b2484f9099f78faf6004e8" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:04.638540  2852 raft_consensus.cc:2749] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.656497  2240 leader_election.cc:304] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:13:04.660691  2852 raft_consensus.cc:2749] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.647294  2543 raft_consensus.cc:359] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.662307  2543 raft_consensus.cc:385] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.662622  2543 raft_consensus.cc:740] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.663172  2543 consensus_queue.cc:260] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.664773  2543 ts_tablet_manager.cc:1434] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:13:04.665342  2168 catalog_manager.cc:5697] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:04.651100  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.68:36641, user_credentials={real_user=slave}} blocked reactor thread for 80891.3us
W20260709 13:13:04.672478  2315 consensus_peers.cc:597] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 -> Peer 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641): Couldn't send request to peer 7d612b55885c4aee87952bd05925f03b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:04.675213  2387 consensus_peers.cc:597] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:04.652138  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:04.675860  2422 raft_consensus.cc:2468] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:04.681030  2273 raft_consensus.cc:3060] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.683709  2463 leader_election.cc:304] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.685835  2766 raft_consensus.cc:2804] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:04.686288  2766 raft_consensus.cc:493] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.686610  2766 raft_consensus.cc:3060] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.695494  2542 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.696079  2542 ts_tablet_manager.cc:1403] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.261s	user 0.060s	sys 0.116s
W20260709 13:13:04.706187  2461 consensus_peers.cc:597] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:04.705253  2766 raft_consensus.cc:515] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.701393  2542 raft_consensus.cc:359] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.708591  2542 raft_consensus.cc:385] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.708918  2542 raft_consensus.cc:740] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.710321  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:04.710487  2542 consensus_queue.cc:260] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.710994  2418 raft_consensus.cc:3060] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.713165  2542 ts_tablet_manager.cc:1434] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:13:04.714231  2542 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.717742  2418 raft_consensus.cc:2468] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:04.719087  2463 leader_election.cc:304] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:04.719466  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:04.719872  2542 tablet_bootstrap.cc:654] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.720715  2706 raft_consensus.cc:2804] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:04.721093  2461 leader_election.cc:343] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.721853  2766 leader_election.cc:290] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:04.722122  2706 raft_consensus.cc:697] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:04.723124  2706 consensus_queue.cc:237] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.731884  2542 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.732410  2542 ts_tablet_manager.cc:1403] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:13:04.734855  2542 raft_consensus.cc:359] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.735495  2542 raft_consensus.cc:385] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.735751  2542 raft_consensus.cc:740] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.736357  2542 consensus_queue.cc:260] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.738634  2542 ts_tablet_manager.cc:1434] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:13:04.743942  2542 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.746068  2766 raft_consensus.cc:493] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.746685  2766 raft_consensus.cc:515] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.746732  2169 catalog_manager.cc:5697] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.749250  2766 leader_election.cc:290] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:04.749662  2542 tablet_bootstrap.cc:654] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.750257  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.764219  2349 raft_consensus.cc:2468] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:04.765478  2460 leader_election.cc:304] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:04.768869  2766 raft_consensus.cc:2804] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:04.769270  2766 raft_consensus.cc:493] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:04.769615  2766 raft_consensus.cc:3060] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.752183  2706 raft_consensus.cc:493] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.774683  2706 raft_consensus.cc:515] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:04.777456  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e0b15b3c884b8e99633d52c01d1f64" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.750260  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:04.778795  2766 raft_consensus.cc:515] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
W20260709 13:13:04.780105  2461 leader_election.cc:343] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.781744  2274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:13:04.783010  2461 leader_election.cc:343] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:04.783746  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:04.784390  2349 raft_consensus.cc:3060] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.789535  2766 leader_election.cc:290] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:04.791313  2706 leader_election.cc:290] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:04.792716  2542 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.793329  2542 ts_tablet_manager.cc:1403] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.012s
I20260709 13:13:04.795274  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61e0b15b3c884b8e99633d52c01d1f64" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:04.795315  2349 raft_consensus.cc:2468] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:04.796581  2460 leader_election.cc:304] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:04.796664  2463 leader_election.cc:304] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:04.796767  2542 raft_consensus.cc:359] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.797690  2542 raft_consensus.cc:385] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.797938  2766 raft_consensus.cc:2804] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:04.798031  2542 raft_consensus.cc:740] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.798085  2706 raft_consensus.cc:2749] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.798609  2766 raft_consensus.cc:697] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:04.799016  2542 consensus_queue.cc:260] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.799787  2766 consensus_queue.cc:237] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.801165  2542 ts_tablet_manager.cc:1434] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:13:04.802659  2542 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.809154  2542 tablet_bootstrap.cc:654] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.814327  2542 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.814854  2542 ts_tablet_manager.cc:1403] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 13:13:04.813541  2169 catalog_manager.cc:5697] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.816316  2898 consensus_queue.cc:1048] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.817456  2542 raft_consensus.cc:359] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.818166  2542 raft_consensus.cc:385] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.818426  2542 raft_consensus.cc:740] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.819068  2542 consensus_queue.cc:260] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.820338  2542 ts_tablet_manager.cc:1434] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:04.821110  2542 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.826529  2542 tablet_bootstrap.cc:654] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.865543  2967 consensus_queue.cc:1048] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:04.870733  2542 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.871287  2542 ts_tablet_manager.cc:1403] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.021s
I20260709 13:13:04.874202  2542 raft_consensus.cc:359] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.874868  2542 raft_consensus.cc:385] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.875125  2542 raft_consensus.cc:740] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.875869  2542 consensus_queue.cc:260] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.877527  2273 raft_consensus.cc:3060] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.877884  2542 ts_tablet_manager.cc:1434] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:04.879066  2542 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.885237  2542 tablet_bootstrap.cc:654] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.888280  2766 consensus_queue.cc:1048] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:04.886796  2967 consensus_queue.cc:1048] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:13:04.907860  2542 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.908434  2542 ts_tablet_manager.cc:1403] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:13:04.912835  2542 raft_consensus.cc:359] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.913539  2542 raft_consensus.cc:385] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.913816  2542 raft_consensus.cc:740] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.914520  2542 consensus_queue.cc:260] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:04.922335  2542 ts_tablet_manager.cc:1434] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:13:04.923427  2542 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:04.933950  2542 tablet_bootstrap.cc:654] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:04.934827  2852 raft_consensus.cc:493] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:04.935377  2852 raft_consensus.cc:515] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:04.937461  2852 leader_election.cc:290] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:04.938699  2542 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: No bootstrap required, opened a new log
I20260709 13:13:04.938601  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b1f2e989a49adbbe3fda8fa181a98" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:04.939280  2542 ts_tablet_manager.cc:1403] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:13:04.941632  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56b1f2e989a49adbbe3fda8fa181a98" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:04.943274  2237 leader_election.cc:304] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066
I20260709 13:13:04.945327  2852 raft_consensus.cc:2749] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:04.946725  2542 raft_consensus.cc:359] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.947470  2542 raft_consensus.cc:385] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:04.947726  2542 raft_consensus.cc:740] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:04.948467  2542 consensus_queue.cc:260] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:04.950606  2542 ts_tablet_manager.cc:1434] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:13:04.985092  2493 raft_consensus.cc:3060] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.990568  2274 raft_consensus.cc:3060] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:04.999300  2979 consensus_queue.cc:1048] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.011657  2852 raft_consensus.cc:493] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.011252  2979 consensus_queue.cc:1048] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.012254  2852 raft_consensus.cc:515] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:05.014395  2852 leader_election.cc:290] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:05.015793  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:05.017758  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca50cf726644de7a82745b940c12b8d" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:05.019286  2240 leader_election.cc:304] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:05.020289  2852 raft_consensus.cc:2749] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.087646  2273 raft_consensus.cc:3060] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.098869  2979 raft_consensus.cc:493] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.099313  2979 raft_consensus.cc:515] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:05.101476  2979 leader_election.cc:290] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:05.103281  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:05.103461  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:05.104190  2418 raft_consensus.cc:2468] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:05.104696  2273 raft_consensus.cc:2468] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 0.
I20260709 13:13:05.105504  2463 leader_election.cc:304] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:05.106603  2979 raft_consensus.cc:2804] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:05.106976  2979 raft_consensus.cc:493] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:05.107335  2979 raft_consensus.cc:3060] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.116688  2979 raft_consensus.cc:515] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:05.118906  2979 leader_election.cc:290] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:05.119472  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:05.120103  2418 raft_consensus.cc:3060] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.120379  2273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:05.120975  2273 raft_consensus.cc:3060] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.126922  2273 raft_consensus.cc:2468] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:05.128114  2461 leader_election.cc:304] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:05.128410  2418 raft_consensus.cc:2468] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:05.129148  2979 raft_consensus.cc:2804] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:05.129647  2979 raft_consensus.cc:697] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:05.130487  2979 consensus_queue.cc:237] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:05.143146  2170 catalog_manager.cc:5697] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 1 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:05.236593  2274 raft_consensus.cc:3060] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.236804  2852 raft_consensus.cc:493] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.240315  2852 raft_consensus.cc:515] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:05.243528  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:05.243826  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:05.244715  2349 raft_consensus.cc:2393] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:13:05.245620  2852 leader_election.cc:290] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:05.246059  2237 leader_election.cc:304] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:05.248577  2974 raft_consensus.cc:3060] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.256002  2974 raft_consensus.cc:2749] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.258239  2974 raft_consensus.cc:493] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:05.258730  2974 raft_consensus.cc:515] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:05.260706  2979 consensus_queue.cc:1048] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.266417  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:05.267571  2418 raft_consensus.cc:2393] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87f37ab7e614ece80499e3f25bc9ea3 in current term 1: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:13:05.269236  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:05.270890  2240 leader_election.cc:304] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3; no voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066
I20260709 13:13:05.271754  2852 raft_consensus.cc:3060] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:05.274930  2974 leader_election.cc:290] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:05.282208  2852 raft_consensus.cc:2749] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:05.286018  2725 consensus_queue.cc:1048] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.332024  2725 consensus_queue.cc:1048] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.344780  2725 consensus_queue.cc:1048] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.562045 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
W20260709 13:13:05.566588  2313 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:05.571237  2313 consensus_peers.cc:597] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.588328  2461 consensus_peers.cc:597] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.615638  2461 consensus_peers.cc:597] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.619081 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:05.619899 28565 tablet_replica.cc:333] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.620620 28565 raft_consensus.cc:2243] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.621047 28565 raft_consensus.cc:2272] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.622943 28565 tablet_replica.cc:333] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.623541 28565 raft_consensus.cc:2243] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.623975 28565 raft_consensus.cc:2272] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.626317 28565 tablet_replica.cc:333] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.626957 28565 raft_consensus.cc:2243] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.627362 28565 raft_consensus.cc:2272] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.629689 28565 tablet_replica.cc:333] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.630402 28565 raft_consensus.cc:2243] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.630913 28565 raft_consensus.cc:2272] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.633496 28565 tablet_replica.cc:333] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.634163 28565 raft_consensus.cc:2243] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.634560 28565 raft_consensus.cc:2272] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.635576  2387 consensus_peers.cc:597] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.637475 28565 tablet_replica.cc:333] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.638435 28565 raft_consensus.cc:2243] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.638963 28565 raft_consensus.cc:2272] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.640045  2461 consensus_peers.cc:597] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.641428  2461 consensus_peers.cc:597] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.641813 28565 tablet_replica.cc:333] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.642489 28565 raft_consensus.cc:2243] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.642889 28565 raft_consensus.cc:2272] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.644821 28565 tablet_replica.cc:333] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.645546 28565 raft_consensus.cc:2243] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.646100 28565 raft_consensus.cc:2272] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.648454 28565 tablet_replica.cc:333] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.649252 28565 raft_consensus.cc:2243] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.649662 28565 raft_consensus.cc:2272] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.651583 28565 tablet_replica.cc:333] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.652302 28565 raft_consensus.cc:2243] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.652725 28565 raft_consensus.cc:2272] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.654647 28565 tablet_replica.cc:333] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.655185 28565 raft_consensus.cc:2243] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.655572 28565 raft_consensus.cc:2272] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.657262 28565 tablet_replica.cc:333] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.657796 28565 raft_consensus.cc:2243] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.658211 28565 raft_consensus.cc:2272] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.659875 28565 tablet_replica.cc:333] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.660406 28565 raft_consensus.cc:2243] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.660768 28565 raft_consensus.cc:2272] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.663026 28565 tablet_replica.cc:333] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.663565 28565 raft_consensus.cc:2243] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.664095 28565 raft_consensus.cc:2272] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.666057 28565 tablet_replica.cc:333] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.666625 28565 raft_consensus.cc:2243] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.667032 28565 raft_consensus.cc:2272] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.668903 28565 tablet_replica.cc:333] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.669412 28565 raft_consensus.cc:2243] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.669757 28565 raft_consensus.cc:2272] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.671885 28565 tablet_replica.cc:333] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.672430 28565 raft_consensus.cc:2243] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.672859 28565 raft_consensus.cc:2272] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.675050 28565 tablet_replica.cc:333] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.675699 28565 raft_consensus.cc:2243] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.676220 28565 raft_consensus.cc:2272] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.676582  2387 consensus_peers.cc:597] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.678494 28565 tablet_replica.cc:333] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.679128 28565 raft_consensus.cc:2243] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.679522 28565 raft_consensus.cc:2272] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.682034 28565 tablet_replica.cc:333] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.682771 28565 raft_consensus.cc:2243] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.683248 28565 raft_consensus.cc:2272] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.686275 28565 tablet_replica.cc:333] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.687047 28565 raft_consensus.cc:2243] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.688135 28565 raft_consensus.cc:2272] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.691095 28565 tablet_replica.cc:333] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.691845 28565 raft_consensus.cc:2243] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.692376 28565 raft_consensus.cc:2272] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.692739  2461 consensus_peers.cc:597] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.699745 28565 tablet_replica.cc:333] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.700631 28565 raft_consensus.cc:2243] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.701629 28565 raft_consensus.cc:2272] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.705871 28565 tablet_replica.cc:333] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.706703 28565 raft_consensus.cc:2243] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.707278 28565 raft_consensus.cc:2272] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.710160 28565 tablet_replica.cc:333] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
W20260709 13:13:05.710397  2461 consensus_peers.cc:597] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.710965 28565 raft_consensus.cc:2243] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.711575 28565 raft_consensus.cc:2272] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.714609 28565 tablet_replica.cc:333] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.715472 28565 raft_consensus.cc:2243] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.716575 28565 raft_consensus.cc:2272] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.719400 28565 tablet_replica.cc:333] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.720124 28565 raft_consensus.cc:2243] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.720606 28565 raft_consensus.cc:2272] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.722401  2461 consensus_peers.cc:597] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.723129 28565 tablet_replica.cc:333] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.723847 28565 raft_consensus.cc:2243] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.724640 28565 raft_consensus.cc:2272] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.726583 28565 tablet_replica.cc:333] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.727146 28565 raft_consensus.cc:2243] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.727566 28565 raft_consensus.cc:2272] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.729445 28565 tablet_replica.cc:333] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.730052 28565 raft_consensus.cc:2243] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.730832 28565 raft_consensus.cc:2272] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.733165 28565 tablet_replica.cc:333] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.733896 28565 raft_consensus.cc:2243] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.733865  2725 consensus_queue.cc:1048] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:05.734551 28565 raft_consensus.cc:2272] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.737131 28565 tablet_replica.cc:333] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.737736 28565 raft_consensus.cc:2243] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.738176 28565 raft_consensus.cc:2272] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.740708 28565 tablet_replica.cc:333] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.741367 28565 raft_consensus.cc:2243] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.742209 28565 raft_consensus.cc:2272] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.744366  2387 consensus_peers.cc:597] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.744691 28565 tablet_replica.cc:333] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
W20260709 13:13:05.744978  2313 consensus_peers.cc:597] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.745409 28565 raft_consensus.cc:2243] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.746071 28565 raft_consensus.cc:2272] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.746410  2313 consensus_peers.cc:597] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.748749 28565 tablet_replica.cc:333] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
W20260709 13:13:05.748734  2461 consensus_peers.cc:597] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.749557 28565 raft_consensus.cc:2243] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.750061 28565 raft_consensus.cc:2272] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.752511 28565 tablet_replica.cc:333] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.753280 28565 raft_consensus.cc:2243] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.753762 28565 raft_consensus.cc:2272] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.754833  2461 consensus_peers.cc:597] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.756484 28565 tablet_replica.cc:333] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.757323 28565 raft_consensus.cc:2243] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.757812 28565 raft_consensus.cc:2272] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.760228 28565 tablet_replica.cc:333] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.760932 28565 raft_consensus.cc:2243] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.761449 28565 raft_consensus.cc:2272] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.764114 28565 tablet_replica.cc:333] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.764825 28565 raft_consensus.cc:2243] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.765317 28565 raft_consensus.cc:2272] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.767589 28565 tablet_replica.cc:333] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
W20260709 13:13:05.767881  2313 consensus_peers.cc:597] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.768318 28565 raft_consensus.cc:2243] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:05.769308 28565 raft_consensus.cc:2272] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.771435 28565 tablet_replica.cc:333] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.772071 28565 raft_consensus.cc:2243] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.772495 28565 raft_consensus.cc:2272] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.775240 28565 tablet_replica.cc:333] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.775753 28565 raft_consensus.cc:2243] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.776161 28565 raft_consensus.cc:2272] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.778283 28565 tablet_replica.cc:333] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.778738 28565 raft_consensus.cc:2243] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.779101 28565 raft_consensus.cc:2272] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.781018 28565 tablet_replica.cc:333] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.781499 28565 raft_consensus.cc:2243] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.781952 28565 raft_consensus.cc:2272] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:05.783903 28565 tablet_replica.cc:333] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: stopping tablet replica
I20260709 13:13:05.784355 28565 raft_consensus.cc:2243] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:05.784694 28565 raft_consensus.cc:2272] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:05.789274  2313 consensus_peers.cc:597] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.809299  2461 consensus_peers.cc:597] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.813954  2461 consensus_peers.cc:597] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.848800  2313 consensus_peers.cc:597] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.852461  2461 consensus_peers.cc:597] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.856581 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
W20260709 13:13:05.884775  2461 consensus_peers.cc:597] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.892457  2461 consensus_peers.cc:597] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.893443  2313 consensus_peers.cc:597] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.898432  2387 consensus_peers.cc:597] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.930055  2313 consensus_peers.cc:597] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.934320 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:05.941365  3038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:05.943277  3039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:05.948047  2313 consensus_peers.cc:597] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.950505  3041 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:05.952135 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:05.953208 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:05.953437 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:05.953641 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602785953616 us; error 0 us; skew 500 ppm
I20260709 13:13:05.954216 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:05.957783 28565 webserver.cc:533] Webserver started at http://127.27.229.65:43767/ using document root <none> and password file <none>
I20260709 13:13:05.958482 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:05.958735 28565 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:13:05.964363  2313 consensus_peers.cc:597] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.966475 28565 fs_manager.cc:714] Time spent opening directory manager: real 0.006s	user 0.007s	sys 0.000s
W20260709 13:13:05.972807  2313 consensus_peers.cc:597] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.973080  2461 consensus_peers.cc:597] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.977764  3046 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:05.978863 28565 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:05.979238 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
format_stamp: "Formatted at 2026-07-09 13:12:54 on dist-test-slave-twc1"
I20260709 13:13:05.979700 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:13:05.980682  2387 consensus_peers.cc:597] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:05.998221  2461 consensus_peers.cc:597] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:05.999969 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:06.001554 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:06.003064 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:13:06.004431  2461 consensus_peers.cc:597] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.008296  3053 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:13:06.074968  2461 consensus_peers.cc:597] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.085197  2313 consensus_peers.cc:597] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.085637  2461 consensus_peers.cc:597] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.094818  2387 consensus_peers.cc:597] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:06.120286  2387 consensus_peers.cc:597] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:06.300328 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:13:06.300690 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.293s	user 0.008s	sys 0.000s
I20260709 13:13:06.300976 28565 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:13:06.306511  3053 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.321832  3053 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.322937  3053 tablet_bootstrap.cc:492] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.323585  3053 ts_tablet_manager.cc:1403] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:13:06.326159  3053 raft_consensus.cc:359] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.326850  3053 raft_consensus.cc:740] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.327517  3053 consensus_queue.cc:260] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.395557  3053 ts_tablet_manager.cc:1434] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.072s	user 0.043s	sys 0.025s
I20260709 13:13:06.396435  3053 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.417872  3053 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.418861  3053 tablet_bootstrap.cc:492] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.419524  3053 ts_tablet_manager.cc:1403] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:13:06.422214  3053 raft_consensus.cc:359] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.422899  3053 raft_consensus.cc:740] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.423578  3053 consensus_queue.cc:260] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.425462  3053 ts_tablet_manager.cc:1434] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:06.426388  3053 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.447516  3053 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.448426  3053 tablet_bootstrap.cc:492] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.449070  3053 ts_tablet_manager.cc:1403] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
I20260709 13:13:06.451582  3053 raft_consensus.cc:359] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.452252  3053 raft_consensus.cc:740] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.453159  3053 consensus_queue.cc:260] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.455049  3053 ts_tablet_manager.cc:1434] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:13:06.455840  3053 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.476975  3053 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.477957  3053 tablet_bootstrap.cc:492] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.478578  3053 ts_tablet_manager.cc:1403] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 13:13:06.480894  3053 raft_consensus.cc:359] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.481655  3053 raft_consensus.cc:740] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.482290  3053 consensus_queue.cc:260] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.484187  3053 ts_tablet_manager.cc:1434] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:06.484925  3053 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.510103  3053 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.511026  3053 tablet_bootstrap.cc:492] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.511651  3053 ts_tablet_manager.cc:1403] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:13:06.514088  3053 raft_consensus.cc:359] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.514768  3053 raft_consensus.cc:740] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.515522  3053 consensus_queue.cc:260] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.517571  3053 ts_tablet_manager.cc:1434] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:06.518356  3053 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.533344  3053 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.534228  3053 tablet_bootstrap.cc:492] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.534857  3053 ts_tablet_manager.cc:1403] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:13:06.537354  3053 raft_consensus.cc:359] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.538074  3053 raft_consensus.cc:740] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.538650  3053 consensus_queue.cc:260] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.540321  3053 ts_tablet_manager.cc:1434] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:13:06.541009  3053 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.572243  3053 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.573220  3053 tablet_bootstrap.cc:492] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.573910  3053 ts_tablet_manager.cc:1403] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.008s
I20260709 13:13:06.576365  3053 raft_consensus.cc:359] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.577071  3053 raft_consensus.cc:740] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.577733  3053 consensus_queue.cc:260] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.579872  3053 ts_tablet_manager.cc:1434] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:06.580708  3053 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.620325  3053 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.621333  3053 tablet_bootstrap.cc:492] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.622052  3053 ts_tablet_manager.cc:1403] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.016s
I20260709 13:13:06.625626  3053 raft_consensus.cc:359] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.626327  3053 raft_consensus.cc:740] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.627002  3053 consensus_queue.cc:260] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.628938  3053 ts_tablet_manager.cc:1434] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:13:06.629805  3053 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.644345  3053 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.645288  3053 tablet_bootstrap.cc:492] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.645948  3053 ts_tablet_manager.cc:1403] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:13:06.648396  3053 raft_consensus.cc:359] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.649086  3053 raft_consensus.cc:740] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.650887  3053 consensus_queue.cc:260] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.653003  3053 ts_tablet_manager.cc:1434] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:06.653820  3053 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.668848  3053 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.669764  3053 tablet_bootstrap.cc:492] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.668839  2893 raft_consensus.cc:493] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.670697  3053 ts_tablet_manager.cc:1403] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:13:06.670475  2893 raft_consensus.cc:515] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.672639  2893 leader_election.cc:290] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:06.673667  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d485c05977430d926f04e26c16f267" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:06.674171  3053 raft_consensus.cc:359] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.675166  3053 raft_consensus.cc:740] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.675910  3053 consensus_queue.cc:260] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.677701  3053 ts_tablet_manager.cc:1434] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
W20260709 13:13:06.677855  2461 leader_election.cc:336] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:06.678426  3053 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.678375  2461 leader_election.cc:304] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:13:06.679173  2893 raft_consensus.cc:2749] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:06.698071 28565 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:13:06.698467 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.397s	user 0.260s	sys 0.023s
I20260709 13:13:06.701866  3053 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.702965  3053 tablet_bootstrap.cc:492] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.703651  3053 ts_tablet_manager.cc:1403] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:13:06.706290  3053 raft_consensus.cc:359] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.707006  2967 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.707043  3053 raft_consensus.cc:740] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.707727  2967 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.708161  3053 consensus_queue.cc:260] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.709962  2967 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:06.710691  3053 ts_tablet_manager.cc:1434] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:06.711619  3053 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.711885  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:06.714401  2975 raft_consensus.cc:493] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.714983  2975 raft_consensus.cc:515] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
W20260709 13:13:06.715523  2313 leader_election.cc:336] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:06.715971  2313 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:06.717084  2975 leader_election.cc:290] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:06.721242  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d485c05977430d926f04e26c16f267" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:06.722146  2489 raft_consensus.cc:2468] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 1.
W20260709 13:13:06.723800  2387 leader_election.cc:336] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:06.724680  2389 leader_election.cc:304] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:06.724694  2967 raft_consensus.cc:2749] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:06.725869  2975 raft_consensus.cc:2804] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:06.726369  2975 raft_consensus.cc:493] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.726732  2975 raft_consensus.cc:3060] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.739600  2975 raft_consensus.cc:515] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.742601  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d485c05977430d926f04e26c16f267" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:06.743207  2489 raft_consensus.cc:3060] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:06.744284  3053 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.745388  3053 tablet_bootstrap.cc:492] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.746145  3053 ts_tablet_manager.cc:1403] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.019s
I20260709 13:13:06.748968  3053 raft_consensus.cc:359] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.750999  3053 raft_consensus.cc:740] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
W20260709 13:13:06.752339  2387 leader_election.cc:336] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:06.752089  3053 consensus_queue.cc:260] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.754642  3053 ts_tablet_manager.cc:1434] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:13:06.755623  3053 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.757445  2489 raft_consensus.cc:2468] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:06.761452  2389 leader_election.cc:304] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:06.762573  3030 raft_consensus.cc:2804] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:06.763067  3030 raft_consensus.cc:697] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:06.763891  3030 consensus_queue.cc:237] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.770556  2975 leader_election.cc:290] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:06.783278  3053 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.784467  3053 tablet_bootstrap.cc:492] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.785262  3053 ts_tablet_manager.cc:1403] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.007s
I20260709 13:13:06.788022  3053 raft_consensus.cc:359] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.788798  3053 raft_consensus.cc:740] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.789695  3053 consensus_queue.cc:260] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.792213  3053 ts_tablet_manager.cc:1434] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:13:06.793159  3053 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.815423  3053 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.816498  3053 tablet_bootstrap.cc:492] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.817266  3053 ts_tablet_manager.cc:1403] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 13:13:06.820221  3053 raft_consensus.cc:359] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.821013  3053 raft_consensus.cc:740] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.821911  3053 consensus_queue.cc:260] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:06.824409  3053 ts_tablet_manager.cc:1434] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:13:06.825376  3053 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.847999  3053 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.849071  3053 tablet_bootstrap.cc:492] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.849800  3053 ts_tablet_manager.cc:1403] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:13:06.852481  3053 raft_consensus.cc:359] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.853250  3053 raft_consensus.cc:740] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.854194  3053 consensus_queue.cc:260] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.854830  2169 catalog_manager.cc:5697] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 1 to 2, leader changed from b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65) to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:06.856514  3053 ts_tablet_manager.cc:1434] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:13:06.867066  3053 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.887161  3053 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.889635  3053 tablet_bootstrap.cc:492] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.892534  3053 ts_tablet_manager.cc:1403] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:13:06.895351  3053 raft_consensus.cc:359] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.896126  3053 raft_consensus.cc:740] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.896900  3053 consensus_queue.cc:260] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.899319  3053 ts_tablet_manager.cc:1434] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:06.900213  3053 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.903628  2975 raft_consensus.cc:493] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.904285  2975 raft_consensus.cc:515] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.906456  2975 leader_election.cc:290] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:06.906945  2975 raft_consensus.cc:493] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.907320  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:06.907452  2975 raft_consensus.cc:515] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.912525  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
W20260709 13:13:06.912690  2387 leader_election.cc:336] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:06.914018  2387 leader_election.cc:304] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:06.919447  3030 raft_consensus.cc:2749] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:06.925468  2975 leader_election.cc:290] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
W20260709 13:13:06.932437  2387 leader_election.cc:336] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:06.932899  2387 leader_election.cc:304] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:06.933634  2975 raft_consensus.cc:2749] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:06.942158  3053 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.948360  3053 tablet_bootstrap.cc:492] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.949997  3053 ts_tablet_manager.cc:1403] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.004s
I20260709 13:13:06.953058  3053 raft_consensus.cc:359] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.953814  3053 raft_consensus.cc:740] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.954613  3030 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.954684  3053 consensus_queue.cc:260] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.955324  3030 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.956965  3053 ts_tablet_manager.cc:1434] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:06.957592  3030 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:06.957827  3053 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.959003  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
W20260709 13:13:06.962303  2387 leader_election.cc:336] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:06.962724  2387 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:06.964025  3030 raft_consensus.cc:2749] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:06.975841  3053 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:06.976766  3053 tablet_bootstrap.cc:492] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:06.977454  3053 ts_tablet_manager.cc:1403] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:13:06.979808  3053 raft_consensus.cc:359] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.980327  3053 raft_consensus.cc:740] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:06.980854  3053 consensus_queue.cc:260] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:06.982553  3053 ts_tablet_manager.cc:1434] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:06.983173  3053 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:06.987890  2725 raft_consensus.cc:493] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.988449  2725 raft_consensus.cc:515] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:06.990429  2725 leader_election.cc:290] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:06.991158  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:06.991904  2422 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:06.993896  2463 leader_election.cc:304] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:06.996053  2893 raft_consensus.cc:2804] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:06.996480  2893 raft_consensus.cc:493] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:06.996836  2893 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.009210  2893 raft_consensus.cc:515] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.012342  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:07.013031  2422 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.024353 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:40559
I20260709 13:13:07.025470  2422 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:13:07.026880  2893 leader_election.cc:290] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:07.027426  3134 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:40559 every 8 connection(s)
I20260709 13:13:07.028270  2463 leader_election.cc:304] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:07.029232  2893 raft_consensus.cc:2804] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.029752  2893 raft_consensus.cc:697] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:07.030701  2893 consensus_queue.cc:237] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.042359  2725 raft_consensus.cc:493] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.042958  2725 raft_consensus.cc:515] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.046186  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:07.046962  2422 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:07.051266  2463 leader_election.cc:304] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:07.052270  3053 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.052690  3054 raft_consensus.cc:2804] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.053119  3054 raft_consensus.cc:493] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.053377  3053 tablet_bootstrap.cc:492] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.053504  3054 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.054333  3053 ts_tablet_manager.cc:1403] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.071s	user 0.029s	sys 0.028s
I20260709 13:13:07.056679  2169 catalog_manager.cc:5697] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 1 to 2, leader changed from b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65) to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 2 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.057052  3053 raft_consensus.cc:359] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.057981  3053 raft_consensus.cc:740] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.058899  3053 consensus_queue.cc:260] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.061198  3053 ts_tablet_manager.cc:1434] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:07.062196  3053 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.063869  2975 raft_consensus.cc:493] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.064446  2975 raft_consensus.cc:515] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.068794  2975 leader_election.cc:290] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:07.071338  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:07.074404  3054 raft_consensus.cc:515] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.081225  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:07.081709  3107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
W20260709 13:13:07.085266  2461 leader_election.cc:343] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.086012  2725 leader_election.cc:290] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
W20260709 13:13:07.087229  2461 leader_election.cc:343] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.089030  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:07.096709  2422 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.099084  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:07.099838  3108 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.101244  2967 raft_consensus.cc:493] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.101812  2967 raft_consensus.cc:515] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.105052  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b" is_pre_election: true
I20260709 13:13:07.105541  2422 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:13:07.109836  2463 leader_election.cc:304] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:07.098970  3106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:07.111927  2894 raft_consensus.cc:2804] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.112424  2894 raft_consensus.cc:697] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:07.113205  2967 leader_election.cc:290] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:07.113250  2894 consensus_queue.cc:237] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.119338  2725 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.120055  2725 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.089172  3054 leader_election.cc:290] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:07.124904  2725 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:07.130986  3106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:07.131827  3106 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:07.134629  2461 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:07.135591  2893 raft_consensus.cc:2804] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.136014  2893 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.136498  2893 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.141448  3108 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:13:07.148468  2902 raft_consensus.cc:493] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.150276  3053 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.150681  2725 raft_consensus.cc:493] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.195580  2725 raft_consensus.cc:515] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.195590  2902 raft_consensus.cc:515] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.164383  2900 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.197348  2900 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.199765  2900 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:07.199889  2725 leader_election.cc:290] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:07.170085  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:07.202513  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:07.203039  3105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:07.203394  2422 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
W20260709 13:13:07.180229  2463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 61612.8us
I20260709 13:13:07.203727  3105 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:07.208570  2902 leader_election.cc:290] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:07.202653  2344 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
I20260709 13:13:07.196146  3053 tablet_bootstrap.cc:492] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.210214  3053 ts_tablet_manager.cc:1403] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.148s	user 0.044s	sys 0.018s
I20260709 13:13:07.213418  2893 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.157991  3106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:07.214725  3106 raft_consensus.cc:2468] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
I20260709 13:13:07.204648  2315 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:07.216121  2900 raft_consensus.cc:2804] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.216585  2900 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
W20260709 13:13:07.204558  2387 consensus_peers.cc:597] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:07.216956  2900 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.204911  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:07.207909  3107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:07.221557  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066" is_pre_election: true
I20260709 13:13:07.222424  2422 raft_consensus.cc:2468] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 1.
W20260709 13:13:07.222690  2387 leader_election.cc:343] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.223165  2387 leader_election.cc:304] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e98dadf6176848ef8893b68c45629066; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:07.223874  2970 raft_consensus.cc:2749] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:07.213500  3053 raft_consensus.cc:359] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.225332  3053 raft_consensus.cc:740] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.225694  2315 leader_election.cc:304] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:07.231397  2493 raft_consensus.cc:1275] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.215687  2893 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:07.235181  2967 raft_consensus.cc:2804] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.235808  2967 raft_consensus.cc:493] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.237039  2970 consensus_queue.cc:1048] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.236328  2967 raft_consensus.cc:3060] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.244838  2169 catalog_manager.cc:5697] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 1 to 2, leader changed from b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65) to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 2 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.227504  2313 leader_election.cc:304] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b
W20260709 13:13:07.247013  2313 leader_election.cc:343] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.226164  3053 consensus_queue.cc:260] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.248834  2902 raft_consensus.cc:2804] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.249585  3053 ts_tablet_manager.cc:1434] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:13:07.249327  2902 raft_consensus.cc:493] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.227952  2900 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.250527  3053 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.250897  3107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" is_pre_election: true
I20260709 13:13:07.251605  3107 raft_consensus.cc:2468] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 1.
W20260709 13:13:07.237268  2460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 49322.8us
I20260709 13:13:07.250358  3106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:07.252578  3106 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.253902  2349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10" is_pre_election: true
I20260709 13:13:07.259163  2900 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:07.261834  3108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:07.262516  3108 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.263187  2347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:07.263782  2347 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.266340  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:07.267354  2422 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.270800  2347 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:13:07.276089  2902 raft_consensus.cc:3060] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.283360  2422 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 2.
I20260709 13:13:07.279079  2460 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:07.294375  2725 raft_consensus.cc:2804] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.294955  2725 raft_consensus.cc:697] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:07.295904  2725 consensus_queue.cc:237] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.306282  2461 leader_election.cc:304] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:07.308051  2894 raft_consensus.cc:2804] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:07.308439  2894 raft_consensus.cc:493] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:07.308770  2894 raft_consensus.cc:3060] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.312019  3108 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 2.
I20260709 13:13:07.316093  2313 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:07.331749  3149 raft_consensus.cc:2804] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.332381  3149 raft_consensus.cc:697] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:07.317582  2967 raft_consensus.cc:515] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.335572  2967 leader_election.cc:290] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:07.336731  2894 raft_consensus.cc:515] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.347865  3106 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:13:07.359560  3137 heartbeater.cc:344] Connected to a master server at 127.27.229.126:46147
I20260709 13:13:07.360029  3137 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:07.361047  3137 heartbeater.cc:507] Master 127.27.229.126:46147 requested a full tablet report, sending...
I20260709 13:13:07.333319  3149 consensus_queue.cc:237] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.367527  3105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:07.368189  3105 raft_consensus.cc:3060] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.371798  2894 leader_election.cc:290] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Requested vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
W20260709 13:13:07.378165  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 84546.6us
I20260709 13:13:07.382266  2422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:07.382849  2422 raft_consensus.cc:3060] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.387763  2169 catalog_manager.cc:5697] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 1 to 2, leader changed from b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65) to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 2 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.365687  2902 raft_consensus.cc:515] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.394538  2902 leader_election.cc:290] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:07.395308  3053 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.395340  2349 raft_consensus.cc:2393] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 2: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:13:07.396384  3053 tablet_bootstrap.cc:492] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.397187  3053 ts_tablet_manager.cc:1403] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.147s	user 0.024s	sys 0.026s
I20260709 13:13:07.404137  2490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:07.405170  2490 raft_consensus.cc:2393] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 2: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:13:07.408689  3053 raft_consensus.cc:359] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.414143  3053 raft_consensus.cc:740] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
W20260709 13:13:07.415498  2313 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:40559, user_credentials={real_user=slave}} blocked reactor thread for 99481.2us
I20260709 13:13:07.416622  2422 raft_consensus.cc:2468] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf33d724fb704d85ab3127e566123c10 in term 2.
I20260709 13:13:07.417884  3053 consensus_queue.cc:260] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.420092  2315 leader_election.cc:304] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:07.409107  2169 ts_manager.cc:194] Re-registered known tserver with Master: b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:07.409834  3105 raft_consensus.cc:2468] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d612b55885c4aee87952bd05925f03b in term 2.
I20260709 13:13:07.431690  3053 ts_tablet_manager.cc:1434] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 13:13:07.431797  2461 leader_election.cc:304] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:07.432471  2902 raft_consensus.cc:2804] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.432834  3053 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.433036  2902 raft_consensus.cc:697] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 2 LEADER]: Becoming Leader. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:07.449854  3145 raft_consensus.cc:2804] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.450572  3145 raft_consensus.cc:697] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Leader. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:07.451457  3145 consensus_queue.cc:237] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.443079  3106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6327d6ef6b3c494b9b70a426897e9121" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
W20260709 13:13:07.460969  2313 leader_election.cc:343] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:07.464726  3107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "cf33d724fb704d85ab3127e566123c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
I20260709 13:13:07.465675  3107 raft_consensus.cc:2393] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf33d724fb704d85ab3127e566123c10 in current term 2: Already voted for candidate 7d612b55885c4aee87952bd05925f03b in this term.
I20260709 13:13:07.461053  2902 consensus_queue.cc:237] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.475812  2168 catalog_manager.cc:5697] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 1 to 2, leader changed from b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65) to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.485566  2313 leader_election.cc:304] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf33d724fb704d85ab3127e566123c10; no voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:07.487486  2967 raft_consensus.cc:2749] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:13:07.495663  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f51c0624f6946a2871ddb439bf616e7" candidate_uuid: "7d612b55885c4aee87952bd05925f03b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:07.496474  2344 raft_consensus.cc:2393] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d612b55885c4aee87952bd05925f03b in current term 2: Already voted for candidate cf33d724fb704d85ab3127e566123c10 in this term.
I20260709 13:13:07.515278  3053 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.516017  3053 tablet_bootstrap.cc:492] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.516590  3053 ts_tablet_manager.cc:1403] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.003s
I20260709 13:13:07.518561  3053 raft_consensus.cc:359] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.519250  3053 raft_consensus.cc:740] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.520033  3053 consensus_queue.cc:260] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.522341  3053 ts_tablet_manager.cc:1434] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:07.523182  3053 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.536213  2171 catalog_manager.cc:5697] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b reported cstate change: term changed from 1 to 2, leader changed from b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65) to 7d612b55885c4aee87952bd05925f03b (127.27.229.68). New cstate: current_term: 2 leader_uuid: "7d612b55885c4aee87952bd05925f03b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.540206  3053 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.542404  3053 tablet_bootstrap.cc:492] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.543076  3053 ts_tablet_manager.cc:1403] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:13:07.549151  3053 raft_consensus.cc:359] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.549829  3053 raft_consensus.cc:740] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.550489  3053 consensus_queue.cc:260] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.553900  3053 ts_tablet_manager.cc:1434] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:13:07.554749  3053 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.566550  2423 raft_consensus.cc:1275] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.575680  3145 consensus_queue.cc:1048] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:07.578809  2461 consensus_peers.cc:597] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:07.579963  2169 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40598
I20260709 13:13:07.539494  2170 catalog_manager.cc:5697] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 reported cstate change: term changed from 1 to 2, leader changed from b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65) to cf33d724fb704d85ab3127e566123c10 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "cf33d724fb704d85ab3127e566123c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:07.591194  3137 heartbeater.cc:499] Master 127.27.229.126:46147 was elected leader, sending a full tablet report...
I20260709 13:13:07.639461  3053 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.640386  3053 tablet_bootstrap.cc:492] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.641028  3053 ts_tablet_manager.cc:1403] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.086s	user 0.030s	sys 0.026s
I20260709 13:13:07.643540  3053 raft_consensus.cc:359] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.644246  3053 raft_consensus.cc:740] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.646943  3053 consensus_queue.cc:260] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.648679  3053 ts_tablet_manager.cc:1434] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:07.649338  3053 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.670923  3053 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.671880  3053 tablet_bootstrap.cc:492] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.672538  3053 ts_tablet_manager.cc:1403] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 13:13:07.675136  3053 raft_consensus.cc:359] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.675865  3053 raft_consensus.cc:740] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.676596  3053 consensus_queue.cc:260] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.678684  3053 ts_tablet_manager.cc:1434] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:07.679530  3053 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.694917  3053 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.695885  3053 tablet_bootstrap.cc:492] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.696609  3053 ts_tablet_manager.cc:1403] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:13:07.699339  3053 raft_consensus.cc:359] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.700035  3053 raft_consensus.cc:740] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.700713  3053 consensus_queue.cc:260] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.703002  3053 ts_tablet_manager.cc:1434] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:13:07.703773  3053 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.713688  2423 raft_consensus.cc:1275] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.714864  3142 consensus_queue.cc:1048] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.717854  3108 raft_consensus.cc:1275] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.719340  3142 consensus_queue.cc:1048] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.720285  3053 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.721298  3053 tablet_bootstrap.cc:492] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.721982  3053 ts_tablet_manager.cc:1403] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.018s	user 0.018s	sys 0.000s
I20260709 13:13:07.733275  3053 raft_consensus.cc:359] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.734017  3053 raft_consensus.cc:740] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.734722  3053 consensus_queue.cc:260] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.736922  3053 ts_tablet_manager.cc:1434] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:07.737732  3053 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.756536  3053 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.757500  3053 tablet_bootstrap.cc:492] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.758224  3053 ts_tablet_manager.cc:1403] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 13:13:07.761781  3053 raft_consensus.cc:359] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.762506  3053 raft_consensus.cc:740] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.763154  3053 consensus_queue.cc:260] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.765436  3053 ts_tablet_manager.cc:1434] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:13:07.767198  3053 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.793404  3053 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.794188  3053 tablet_bootstrap.cc:492] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.794836  3053 ts_tablet_manager.cc:1403] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.008s
I20260709 13:13:07.796895  3053 raft_consensus.cc:359] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.797570  3053 raft_consensus.cc:740] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.798287  3053 consensus_queue.cc:260] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:07.799944  3053 ts_tablet_manager.cc:1434] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:07.800678  3053 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.819279  3053 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.820233  3053 tablet_bootstrap.cc:492] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.820914  3053 ts_tablet_manager.cc:1403] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 13:13:07.823468  3053 raft_consensus.cc:359] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.824195  3053 raft_consensus.cc:740] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.824908  3053 consensus_queue.cc:260] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.826957  3053 ts_tablet_manager.cc:1434] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:13:07.828358  3053 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.843289  3053 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.844141  3053 tablet_bootstrap.cc:492] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.844662  3053 ts_tablet_manager.cc:1403] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:13:07.846508  3053 raft_consensus.cc:359] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.847009  3053 raft_consensus.cc:740] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.847496  3053 consensus_queue.cc:260] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:07.849308  3053 ts_tablet_manager.cc:1434] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:07.850142  3053 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.865201  3053 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.866166  3053 tablet_bootstrap.cc:492] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.866834  3053 ts_tablet_manager.cc:1403] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.001s
I20260709 13:13:07.869375  3053 raft_consensus.cc:359] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:07.871249  3053 raft_consensus.cc:740] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.871940  3053 consensus_queue.cc:260] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:07.874097  3053 ts_tablet_manager.cc:1434] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:13:07.877111  3053 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.896106  3053 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.896975  3053 tablet_bootstrap.cc:492] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.897696  3053 ts_tablet_manager.cc:1403] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.003s
I20260709 13:13:07.898440  3107 raft_consensus.cc:1275] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.900169  3154 consensus_queue.cc:1048] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.900170  3053 raft_consensus.cc:359] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.902734  3053 raft_consensus.cc:740] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.903550  3053 consensus_queue.cc:260] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.905572  3053 ts_tablet_manager.cc:1434] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:13:07.906347  3053 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.908269  2423 raft_consensus.cc:1275] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer cf33d724fb704d85ab3127e566123c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.910763  2344 raft_consensus.cc:1275] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.912444  3149 consensus_queue.cc:1048] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.914258  3148 consensus_queue.cc:1048] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:07.915550  2423 raft_consensus.cc:1275] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer cf33d724fb704d85ab3127e566123c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.919139  3149 consensus_queue.cc:1048] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:07.943202  2461 consensus_peers.cc:597] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:07.944859  3053 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:07.944859  2346 raft_consensus.cc:1275] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.946380  3053 tablet_bootstrap.cc:492] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:07.947190  3053 ts_tablet_manager.cc:1403] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.014s
I20260709 13:13:07.947610  2893 consensus_queue.cc:1048] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:07.949684  2313 consensus_peers.cc:597] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:07.949678  3053 raft_consensus.cc:359] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.950675  3053 raft_consensus.cc:740] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:07.951485  3053 consensus_queue.cc:260] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:07.953024  3053 ts_tablet_manager.cc:1434] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:07.955556  3053 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:07.955693  3106 raft_consensus.cc:1275] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Refusing update from remote peer 7d612b55885c4aee87952bd05925f03b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.957237  3148 consensus_queue.cc:1048] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.959996  3106 raft_consensus.cc:1275] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Refusing update from remote peer cf33d724fb704d85ab3127e566123c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.964078  3152 consensus_queue.cc:1048] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:13:07.980859  2461 consensus_peers.cc:597] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:08.120034  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 101285us
I20260709 13:13:08.139894  3053 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:13:08.149000  2387 consensus_peers.cc:597] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:08.159128  3053 tablet_bootstrap.cc:492] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.160077  3053 ts_tablet_manager.cc:1403] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.205s	user 0.028s	sys 0.038s
I20260709 13:13:08.168037  3053 raft_consensus.cc:359] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.168743  3053 raft_consensus.cc:740] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.169410  3053 consensus_queue.cc:260] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.175480  3053 ts_tablet_manager.cc:1434] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:13:08.176476  3053 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
W20260709 13:13:08.176785  2315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:33615, user_credentials={real_user=slave}} blocked reactor thread for 56056.7us
W20260709 13:13:08.211712  3187 log.cc:927] Time spent T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 13:13:08.213243  3105 raft_consensus.cc:3060] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:08.217157  2461 consensus_peers.cc:597] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:08.233896  2461 consensus_peers.cc:597] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:08.253253  2461 consensus_peers.cc:597] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:08.269151  3053 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.270332  3053 tablet_bootstrap.cc:492] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.271003  3053 ts_tablet_manager.cc:1403] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.002s
I20260709 13:13:08.278190  3053 raft_consensus.cc:359] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.278923  3053 raft_consensus.cc:740] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.279657  3053 consensus_queue.cc:260] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.281762  3053 ts_tablet_manager.cc:1434] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
W20260709 13:13:08.282315  2461 consensus_peers.cc:597] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:13:08.282637  3053 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.296187  3053 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.297129  3053 tablet_bootstrap.cc:492] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.297843  3053 ts_tablet_manager.cc:1403] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:13:08.300277  3053 raft_consensus.cc:359] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:08.301015  3053 raft_consensus.cc:740] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.301779  3053 consensus_queue.cc:260] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:08.303434  3053 ts_tablet_manager.cc:1434] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:08.304281  3053 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.326925  3053 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.327877  3053 tablet_bootstrap.cc:492] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.328549  3053 ts_tablet_manager.cc:1403] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.001s
I20260709 13:13:08.330682  3053 raft_consensus.cc:359] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:08.331166  3053 raft_consensus.cc:740] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.331746  3053 consensus_queue.cc:260] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:08.333242  3053 ts_tablet_manager.cc:1434] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.000s
I20260709 13:13:08.334422  3053 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.349495  3053 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.350364  3053 tablet_bootstrap.cc:492] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.351083  3053 ts_tablet_manager.cc:1403] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:13:08.353263  3053 raft_consensus.cc:359] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:08.353875  3053 raft_consensus.cc:740] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.354512  3053 consensus_queue.cc:260] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:08.356662  3053 ts_tablet_manager.cc:1434] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:13:08.357684  3053 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.371289  3053 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.372256  3053 tablet_bootstrap.cc:492] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.372932  3053 ts_tablet_manager.cc:1403] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:13:08.375417  3053 raft_consensus.cc:359] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:08.375953  3053 raft_consensus.cc:740] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.376515  3053 consensus_queue.cc:260] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:08.378615  3053 ts_tablet_manager.cc:1434] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:08.384155  3053 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.403080  3053 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.403829  3053 tablet_bootstrap.cc:492] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.404466  3053 ts_tablet_manager.cc:1403] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.007s
I20260709 13:13:08.406781  3053 raft_consensus.cc:359] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.407471  3053 raft_consensus.cc:740] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.408249  3053 consensus_queue.cc:260] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.410179  3053 ts_tablet_manager.cc:1434] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:08.410938  3053 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.431106  3053 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.432103  3053 tablet_bootstrap.cc:492] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.432688  3053 ts_tablet_manager.cc:1403] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.002s
I20260709 13:13:08.434645  3053 raft_consensus.cc:359] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:08.435273  3053 raft_consensus.cc:740] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.435895  3053 consensus_queue.cc:260] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:08.437681  3053 ts_tablet_manager.cc:1434] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:13:08.438539  3053 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.449836  3105 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:08.452085  3053 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.453058  3053 tablet_bootstrap.cc:492] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.453681  3053 ts_tablet_manager.cc:1403] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:13:08.456598  3053 raft_consensus.cc:359] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.457986  3053 raft_consensus.cc:740] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.458776  3053 consensus_queue.cc:260] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.460919  3053 ts_tablet_manager.cc:1434] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:13:08.461699  3053 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.480450  3053 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.481235  3053 tablet_bootstrap.cc:492] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.481858  3053 ts_tablet_manager.cc:1403] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:13:08.483736  3053 raft_consensus.cc:359] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.484352  3053 raft_consensus.cc:740] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.484928  3053 consensus_queue.cc:260] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.486959  3053 ts_tablet_manager.cc:1434] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:08.488112  3053 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap starting.
I20260709 13:13:08.504897  3053 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:08.505733  3053 tablet_bootstrap.cc:492] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Bootstrap complete.
I20260709 13:13:08.506618  3053 ts_tablet_manager.cc:1403] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:13:08.508782  3053 raft_consensus.cc:359] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.509449  3053 raft_consensus.cc:740] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Initialized, Role: FOLLOWER
I20260709 13:13:08.510139  3053 consensus_queue.cc:260] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:08.511983  3053 ts_tablet_manager.cc:1434] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:08.960983  3103 raft_consensus.cc:3060] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:11.838374  2460 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:37949, user_credentials={real_user=slave}} blocked reactor thread for 57261.6us
I20260709 13:13:17.296532 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:17.355288  2493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:17.356135  2493 raft_consensus.cc:606] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:17.369755  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f"
dest_uuid: "cf33d724fb704d85ab3127e566123c10"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:44230
I20260709 13:13:17.370409  2344 raft_consensus.cc:606] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:17.372943  2493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:17.373402  2493 raft_consensus.cc:606] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:17.375728  2493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:17.376194  2493 raft_consensus.cc:606] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:17.378360  2493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:17.378806  2493 raft_consensus.cc:606] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:17.381534  2493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:17.382268  2493 raft_consensus.cc:606] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:17.383406 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:17.385123 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:17.419735  3238 raft_consensus.cc:993] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.420351  3221 raft_consensus.cc:1081] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.422209  3105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36500
I20260709 13:13:17.422770  3105 raft_consensus.cc:493] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:17.423086  3105 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.429502  3105 raft_consensus.cc:515] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:17.431639  3105 leader_election.cc:290] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:17.452971  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:17.453778  2344 raft_consensus.cc:3055] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:17.454101  2344 raft_consensus.cc:740] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:17.454927  2344 consensus_queue.cc:260] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:17.456041  2344 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.460794  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1afd652caeb4870bc040ee85a68ee9f" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:17.461437  2423 raft_consensus.cc:3060] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.463014  2344 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:17.464247  3047 leader_election.cc:304] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:17.466064  3252 raft_consensus.cc:2804] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:17.467195  3252 raft_consensus.cc:697] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:17.467463  2423 raft_consensus.cc:2468] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:17.468138  3252 consensus_queue.cc:237] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:17.478168  2170 catalog_manager.cc:5697] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 2 to 3, leader changed from cf33d724fb704d85ab3127e566123c10 (127.27.229.66) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.500926  3239 raft_consensus.cc:993] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.501367  3239 raft_consensus.cc:1081] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.502507  3259 raft_consensus.cc:993] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.503427  3241 raft_consensus.cc:1081] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.505252  3103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:17.505570  3105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:17.506289  3105 raft_consensus.cc:493] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:17.506680  3103 raft_consensus.cc:493] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:17.507150  3103 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.506659  3105 raft_consensus.cc:3060] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.507967  3239 raft_consensus.cc:993] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.508769  3259 raft_consensus.cc:1081] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.510716  3107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:17.511293  3107 raft_consensus.cc:493] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:17.511653  3107 raft_consensus.cc:3060] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.513684  3103 raft_consensus.cc:515] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.515164  3105 raft_consensus.cc:515] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.515643  3103 leader_election.cc:290] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:17.517750  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:17.518381  2423 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.519863  3105 leader_election.cc:290] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:17.521257  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:17.521948  2419 raft_consensus.cc:3060] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.525799  2423 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:17.527801  3050 leader_election.cc:304] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:17.528774  3252 raft_consensus.cc:2804] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:17.529261  3252 raft_consensus.cc:697] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:17.530150  3252 consensus_queue.cc:237] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.520134  3107 raft_consensus.cc:515] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.535601  3107 leader_election.cc:290] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:17.537253  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:17.537899  2420 raft_consensus.cc:3060] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.538910  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401f4bd5793e424c8b248f0c7228ce2c" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:17.539568  2493 raft_consensus.cc:3055] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:17.539842  2493 raft_consensus.cc:740] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:17.539901  2490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6a7e2640e594f4c816e8bbfe035ea28" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:17.540758  2490 raft_consensus.cc:3055] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:17.540625  2493 consensus_queue.cc:260] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.541199  2490 raft_consensus.cc:740] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:17.542546  2492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5fb36d7bd44d7a8b073eae26ba8b23" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:17.543215  2492 raft_consensus.cc:3055] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:17.542225  2490 consensus_queue.cc:260] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.543535  2492 raft_consensus.cc:740] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:17.544644  2490 raft_consensus.cc:3060] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.544430  2492 consensus_queue.cc:260] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.546226  2492 raft_consensus.cc:3060] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.545054  2493 raft_consensus.cc:3060] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:17.552017  2419 raft_consensus.cc:2468] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.546317  2420 raft_consensus.cc:2468] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.554739  3050 leader_election.cc:304] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:17.555763  3253 raft_consensus.cc:2804] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:17.557516  3050 leader_election.cc:304] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:17.560995  3252 raft_consensus.cc:2804] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:17.561347  2493 raft_consensus.cc:2468] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:17.561491  3252 raft_consensus.cc:697] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:17.562557  3252 consensus_queue.cc:237] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.564124  2492 raft_consensus.cc:2468] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.570119  2490 raft_consensus.cc:2468] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.568692  2170 catalog_manager.cc:5697] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 2 to 3, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.576023  3253 raft_consensus.cc:697] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:17.577320  3253 consensus_queue.cc:237] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.585196  3239 raft_consensus.cc:993] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.585608  3239 raft_consensus.cc:1081] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.586997  3103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:17.587435  3103 raft_consensus.cc:493] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:17.587795  3103 raft_consensus.cc:3060] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.593688  3103 raft_consensus.cc:515] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.594405  2170 catalog_manager.cc:5697] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.595359  3103 leader_election.cc:290] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:17.595819  2170 catalog_manager.cc:5697] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.596627  2420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:17.597294  2420 raft_consensus.cc:3060] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.597389  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b812b253535b4aeea1d25a2fd849a6ef" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:17.598011  2493 raft_consensus.cc:3055] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:17.598224  2493 raft_consensus.cc:740] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:17.598800  2493 consensus_queue.cc:260] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.599982  2493 raft_consensus.cc:3060] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.606830  2420 raft_consensus.cc:2468] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.606832  2493 raft_consensus.cc:2468] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.608495  3050 leader_election.cc:304] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:17.609160  3253 raft_consensus.cc:2804] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:17.609548  3253 raft_consensus.cc:697] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:17.610281  3253 consensus_queue.cc:237] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:17.621696  2170 catalog_manager.cc:5697] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:17.771198  3259 raft_consensus.cc:993] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.771595  3239 raft_consensus.cc:1081] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:17.773058  3103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:17.773612  3103 raft_consensus.cc:493] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:17.774060  3103 raft_consensus.cc:3060] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.779963  3103 raft_consensus.cc:515] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:17.781379  3103 leader_election.cc:290] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:17.782305  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:17.782217  2492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1839fe9b25246a78f571eef32e6ef2b" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:17.783036  2344 raft_consensus.cc:3060] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.783115  2492 raft_consensus.cc:3055] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:17.783522  2492 raft_consensus.cc:740] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:17.784353  2492 consensus_queue.cc:260] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:17.785742  2492 raft_consensus.cc:3060] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:17.790289  2344 raft_consensus.cc:2468] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.791579  3047 leader_election.cc:304] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:17.792378  3253 raft_consensus.cc:2804] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:17.792933  2492 raft_consensus.cc:2468] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:17.792832  3253 raft_consensus.cc:697] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:17.794294  3253 consensus_queue.cc:237] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:17.803252  2170 catalog_manager.cc:5697] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:17.995131  2492 raft_consensus.cc:1275] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:17.996371  3253 consensus_queue.cc:1048] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:18.008122  2420 raft_consensus.cc:1275] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:18.009626  3252 consensus_queue.cc:1048] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:18.023123  2420 raft_consensus.cc:1275] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:18.026654  3252 consensus_queue.cc:1048] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:18.039749  2493 raft_consensus.cc:1275] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:18.041332  3262 consensus_queue.cc:1048] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.049667  2344 raft_consensus.cc:1275] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:18.051314  3252 consensus_queue.cc:1048] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.057410  2419 raft_consensus.cc:1275] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:18.059029  3252 consensus_queue.cc:1048] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:18.071794  2420 raft_consensus.cc:1275] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:18.073009  2418 raft_consensus.cc:1275] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:18.074926  3263 consensus_queue.cc:1048] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:18.075930  2492 raft_consensus.cc:1275] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:18.076382  3263 consensus_queue.cc:1048] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:18.081229  3252 consensus_queue.cc:1048] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:18.103047  2493 raft_consensus.cc:1275] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:18.105417  3262 consensus_queue.cc:1048] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:18.224575  2344 raft_consensus.cc:1275] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:18.226058  3262 consensus_queue.cc:1048] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:18.243716  2489 raft_consensus.cc:1275] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:18.246160  3252 consensus_queue.cc:1048] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:18.386153 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:18.428982 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:18.471107  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8"
dest_uuid: "cf33d724fb704d85ab3127e566123c10"
mode: GRACEFUL
new_leader_uuid: "e98dadf6176848ef8893b68c45629066"
 from {username='slave'} at 127.0.0.1:44230
I20260709 13:13:18.471604  2344 raft_consensus.cc:606] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Received request to transfer leadership to TS e98dadf6176848ef8893b68c45629066
I20260709 13:13:18.474498  2489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fd662b171494cd18b261a83314083d3"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "e98dadf6176848ef8893b68c45629066"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:18.474997  2489 raft_consensus.cc:606] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS e98dadf6176848ef8893b68c45629066
I20260709 13:13:18.477207  2489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "e98dadf6176848ef8893b68c45629066"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:18.477679  2489 raft_consensus.cc:606] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS e98dadf6176848ef8893b68c45629066
I20260709 13:13:18.480152  2492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:18.480823  2492 raft_consensus.cc:606] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:18.483239  2492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:18.483762  2492 raft_consensus.cc:606] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:18.486121  2492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:18.486701  2492 raft_consensus.cc:606] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:18.487931 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:13:18.489641 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:18.545634  3259 raft_consensus.cc:993] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b: : Instructing follower e98dadf6176848ef8893b68c45629066 to start an election
I20260709 13:13:18.546217  3259 raft_consensus.cc:1081] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer e98dadf6176848ef8893b68c45629066 to start an election
I20260709 13:13:18.547731  2423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7"
dest_uuid: "e98dadf6176848ef8893b68c45629066"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:13:18.548168  2423 raft_consensus.cc:493] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.548463  2423 raft_consensus.cc:3060] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.555558  2423 raft_consensus.cc:515] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.558831  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:18.559460  2344 raft_consensus.cc:3060] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.560364  2423 leader_election.cc:290] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:18.560384  2492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "639b7a560e414c60a43f687a8eaf95f7" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:18.561312  2492 raft_consensus.cc:3055] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.561731  2492 raft_consensus.cc:740] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:18.562633  2492 consensus_queue.cc:260] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.565369  2492 raft_consensus.cc:3060] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.569020  2344 raft_consensus.cc:2468] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:18.570279  2386 leader_election.cc:304] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:18.571074  3245 raft_consensus.cc:2804] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.571473  3245 raft_consensus.cc:697] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:18.572352  3245 consensus_queue.cc:237] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.572788  2492 raft_consensus.cc:2468] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:18.582520  2171 catalog_manager.cc:5697] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.638175  3268 raft_consensus.cc:993] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10: : Instructing follower e98dadf6176848ef8893b68c45629066 to start an election
I20260709 13:13:18.639060  3268 raft_consensus.cc:1081] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Signalling peer e98dadf6176848ef8893b68c45629066 to start an election
I20260709 13:13:18.641338  2423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8"
dest_uuid: "e98dadf6176848ef8893b68c45629066"
 from {username='slave'} at 127.0.0.1:58300
I20260709 13:13:18.641985  2423 raft_consensus.cc:493] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.642354  2423 raft_consensus.cc:3060] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.649109  2423 raft_consensus.cc:515] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.651187  2423 leader_election.cc:290] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:18.651643  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:18.652263  2344 raft_consensus.cc:3055] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.652412  2492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25f96db2fd0848edbbd0b74d46d285c8" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:18.652516  2344 raft_consensus.cc:740] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:18.653105  2492 raft_consensus.cc:3060] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.653573  2344 consensus_queue.cc:260] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.654603  2344 raft_consensus.cc:3060] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.660235  2344 raft_consensus.cc:2468] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:18.660933  2492 raft_consensus.cc:2468] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:18.661299  2386 leader_election.cc:304] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf33d724fb704d85ab3127e566123c10, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:18.662909  3244 raft_consensus.cc:2804] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.664060  3244 raft_consensus.cc:697] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:18.664978  3244 consensus_queue.cc:237] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.674827  2171 catalog_manager.cc:5697] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 1 to 2, leader changed from cf33d724fb704d85ab3127e566123c10 (127.27.229.66) to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.744876  3284 raft_consensus.cc:993] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:18.745352  3259 raft_consensus.cc:1081] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:18.746987  3107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:18.747514  3107 raft_consensus.cc:493] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.747778  3107 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.752882  3107 raft_consensus.cc:515] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:18.755404  2423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:18.755601  3107 leader_election.cc:290] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:18.756064  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0c3f9ead2094675856fff4f3fdc8cf9" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:18.756680  2423 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.756748  2493 raft_consensus.cc:3055] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:18.757145  2493 raft_consensus.cc:740] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:18.757891  2493 consensus_queue.cc:260] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:18.758978  2493 raft_consensus.cc:3060] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.763521  2423 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:18.764743  3050 leader_election.cc:304] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:18.765667  3263 raft_consensus.cc:2804] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:18.766165  3263 raft_consensus.cc:697] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:18.766990  3263 consensus_queue.cc:237] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:18.768658  2493 raft_consensus.cc:2468] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:18.777305  2171 catalog_manager.cc:5697] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 2 to 3, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:18.823861  3284 raft_consensus.cc:993] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:18.824301  3259 raft_consensus.cc:1081] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:18.825802  3107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:18.826357  3107 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.826653  3107 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.832158  3107 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:18.836041  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:18.836046  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da44ad18eaab4920bb17c257fe5ff546" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:18.836980  3107 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:18.837064  2493 raft_consensus.cc:3055] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:18.838049  2493 raft_consensus.cc:740] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:18.838234  2344 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.839066  2493 consensus_queue.cc:260] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:18.840397  2493 raft_consensus.cc:3060] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:18.845896  2344 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:18.846983  2493 raft_consensus.cc:2468] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:18.847091  3047 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:18.848201  3263 raft_consensus.cc:2804] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:18.848598  3263 raft_consensus.cc:697] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:18.849284  3263 consensus_queue.cc:237] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:18.858830  2171 catalog_manager.cc:5697] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 2 to 3, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:18.944901  3299 raft_consensus.cc:993] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:18.945389  3284 raft_consensus.cc:993] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b: : Instructing follower e98dadf6176848ef8893b68c45629066 to start an election
I20260709 13:13:18.945539  3297 raft_consensus.cc:1081] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:18.946040  3298 raft_consensus.cc:1081] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer e98dadf6176848ef8893b68c45629066 to start an election
I20260709 13:13:18.947269  3107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:18.947458  2418 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fd662b171494cd18b261a83314083d3"
dest_uuid: "e98dadf6176848ef8893b68c45629066"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:13:18.947937  3107 raft_consensus.cc:493] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.947995  2418 raft_consensus.cc:493] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:18.948269  3107 raft_consensus.cc:3060] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.948421  2418 raft_consensus.cc:3060] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.953415  3107 raft_consensus.cc:515] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:18.953506  2418 raft_consensus.cc:515] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.956439  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:18.956465  2492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:18.957125  2493 raft_consensus.cc:3055] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.957170  2492 raft_consensus.cc:3055] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:18.957526  2493 raft_consensus.cc:740] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:18.957671  2492 raft_consensus.cc:740] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:18.958370  2493 consensus_queue.cc:260] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:18.958519  2492 consensus_queue.cc:260] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.959493  2493 raft_consensus.cc:3060] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.959635  2492 raft_consensus.cc:3060] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.962484  3107 leader_election.cc:290] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:18.967661  2418 leader_election.cc:290] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:18.970927  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1bf4527355144469770b9b84ae9a88a" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:18.971315  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd662b171494cd18b261a83314083d3" candidate_uuid: "e98dadf6176848ef8893b68c45629066" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:18.971522  2344 raft_consensus.cc:3060] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.971938  2346 raft_consensus.cc:3060] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:18.972913  2492 raft_consensus.cc:2468] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:18.974088  2389 leader_election.cc:304] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:18.975847  3244 raft_consensus.cc:2804] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.976457  3244 raft_consensus.cc:697] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Becoming Leader. State: Replica: e98dadf6176848ef8893b68c45629066, State: Running, Role: LEADER
I20260709 13:13:18.980593  2346 raft_consensus.cc:2468] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e98dadf6176848ef8893b68c45629066 in term 2.
I20260709 13:13:18.977310  3244 consensus_queue.cc:237] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } }
I20260709 13:13:18.985127  2493 raft_consensus.cc:2468] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:18.987202  3050 leader_election.cc:304] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:18.988128  3263 raft_consensus.cc:2804] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:18.988601  3263 raft_consensus.cc:697] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:18.989411  3263 consensus_queue.cc:237] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:18.998685  2344 raft_consensus.cc:2468] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:19.002701  2171 catalog_manager.cc:5697] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to e98dadf6176848ef8893b68c45629066 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "e98dadf6176848ef8893b68c45629066" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.012557  2170 catalog_manager.cc:5697] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.072151  2493 raft_consensus.cc:1275] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.073338  3244 consensus_queue.cc:1048] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.085134  2344 raft_consensus.cc:1275] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.086472  3245 consensus_queue.cc:1048] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.086771  2346 raft_consensus.cc:1275] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.088708  3245 consensus_queue.cc:1048] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.110246  2489 raft_consensus.cc:1275] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.111961  3245 consensus_queue.cc:1048] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.219070  2418 raft_consensus.cc:1275] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.220188  3263 consensus_queue.cc:1048] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.238803  2493 raft_consensus.cc:1275] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.240439  3263 consensus_queue.cc:1048] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.258100  2346 raft_consensus.cc:1275] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.259722  3313 consensus_queue.cc:1048] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.273131  2493 raft_consensus.cc:1275] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:19.284298  3316 consensus_queue.cc:1048] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:19.389699  2346 raft_consensus.cc:1275] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.390869  3313 consensus_queue.cc:1048] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.403781  2493 raft_consensus.cc:1275] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.405300  3316 consensus_queue.cc:1048] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.490732 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:19.542659 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:19.553295  2493 raft_consensus.cc:1275] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.554941  3244 consensus_queue.cc:1048] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.606726  2346 raft_consensus.cc:1275] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer e98dadf6176848ef8893b68c45629066: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:19.608709  3244 consensus_queue.cc:1048] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:19.643527  2493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:19.644026  2493 raft_consensus.cc:606] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:19.646497  2493 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97"
dest_uuid: "7d612b55885c4aee87952bd05925f03b"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:60354
I20260709 13:13:19.647023  2493 raft_consensus.cc:606] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:19.649591  2346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb"
dest_uuid: "cf33d724fb704d85ab3127e566123c10"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:44230
I20260709 13:13:19.650202  2346 raft_consensus.cc:606] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:19.653030  2346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28"
dest_uuid: "cf33d724fb704d85ab3127e566123c10"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:44230
I20260709 13:13:19.653468  2346 raft_consensus.cc:606] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:19.655526  2346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932"
dest_uuid: "cf33d724fb704d85ab3127e566123c10"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:44230
I20260709 13:13:19.655949  2346 raft_consensus.cc:606] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:19.656818 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:13:19.658170 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:19.826949  3238 raft_consensus.cc:993] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:19.827404  3291 raft_consensus.cc:1081] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:19.828765  3105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36500
I20260709 13:13:19.829300  3105 raft_consensus.cc:493] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.829576  3105 raft_consensus.cc:3060] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.834257  3105 raft_consensus.cc:515] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:19.835819  3105 leader_election.cc:290] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:19.836751  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:19.837405  2344 raft_consensus.cc:3055] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.837664  2344 raft_consensus.cc:740] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:19.836743  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e35b4b5dcc014c7488f8e250fc29cd28" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:19.838392  2489 raft_consensus.cc:3060] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.838593  2344 consensus_queue.cc:260] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:19.839862  2344 raft_consensus.cc:3060] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.846679  2489 raft_consensus.cc:2468] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:19.847895  3050 leader_election.cc:304] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:19.848722  3316 raft_consensus.cc:2804] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.848922  2344 raft_consensus.cc:2468] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:19.849215  3316 raft_consensus.cc:697] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:19.850317  3316 consensus_queue.cc:237] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:19.861639  2170 catalog_manager.cc:5697] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from cf33d724fb704d85ab3127e566123c10 (127.27.229.66) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:19.968152  3238 raft_consensus.cc:993] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:19.968593  3291 raft_consensus.cc:1081] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:19.969949  3105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36500
I20260709 13:13:19.970369  3105 raft_consensus.cc:493] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.970618  3105 raft_consensus.cc:3060] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.975214  3105 raft_consensus.cc:515] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:19.976678  3105 leader_election.cc:290] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:19.977411  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:19.977662  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa1e1d96a4584c249a551ed8c02cd932" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:19.978005  2344 raft_consensus.cc:3055] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:19.978220  2418 raft_consensus.cc:3060] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.978374  2344 raft_consensus.cc:740] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:19.979211  2344 consensus_queue.cc:260] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:19.980860  2344 raft_consensus.cc:3060] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:19.986364  2344 raft_consensus.cc:2468] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:19.986364  2418 raft_consensus.cc:2468] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:19.987583  3047 leader_election.cc:304] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:19.988574  3253 raft_consensus.cc:2804] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:19.989045  3253 raft_consensus.cc:697] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:19.989825  3253 consensus_queue.cc:237] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:19.997362  3297 raft_consensus.cc:993] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:19.997867  3297 raft_consensus.cc:1081] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:19.999439  3105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:19.999979  3105 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.000380  3105 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:20.000061  2170 catalog_manager.cc:5697] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from cf33d724fb704d85ab3127e566123c10 (127.27.229.66) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.007354  3105 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:20.010496  3105 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Requested vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641)
I20260709 13:13:20.014092  2418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:20.014220  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a388dcea8c964b44a75944b6a5e72c97" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:20.014729  2418 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:20.014858  2489 raft_consensus.cc:3055] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:20.015362  2489 raft_consensus.cc:740] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:20.015969  2489 consensus_queue.cc:260] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:20.017143  2489 raft_consensus.cc:3060] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:20.019999  2418 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:20.021147  3050 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:20.022032  3253 raft_consensus.cc:2804] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:20.022527  3253 raft_consensus.cc:697] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:20.023257  3253 consensus_queue.cc:237] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:20.024082  2489 raft_consensus.cc:2468] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 3.
I20260709 13:13:20.034700  2170 catalog_manager.cc:5697] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 2 to 3, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 3 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:20.093276  3238 raft_consensus.cc:993] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:20.094240  3291 raft_consensus.cc:1081] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:20.095817  3107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36500
I20260709 13:13:20.096364  3107 raft_consensus.cc:493] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.096648  3107 raft_consensus.cc:3060] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.097087  3298 raft_consensus.cc:993] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:20.097607  3297 raft_consensus.cc:1081] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:20.099169  3105 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36492
I20260709 13:13:20.099709  3105 raft_consensus.cc:493] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:20.100049  3105 raft_consensus.cc:3060] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.103654  3107 raft_consensus.cc:515] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:20.105724  3107 leader_election.cc:290] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:20.106654  2489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:20.107091  3105 raft_consensus.cc:515] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:20.107379  2489 raft_consensus.cc:3060] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.107396  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e24620bfc0cd42408a861714b4aad2eb" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:20.108129  2344 raft_consensus.cc:3055] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.108374  2344 raft_consensus.cc:740] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:20.109089  2344 consensus_queue.cc:260] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:20.110143  3105 leader_election.cc:290] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers 7d612b55885c4aee87952bd05925f03b (127.27.229.68:36641), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:20.110263  2493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d612b55885c4aee87952bd05925f03b"
I20260709 13:13:20.110682  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d9df2600494490b900c0d25d88cd6a" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:20.110894  2493 raft_consensus.cc:3055] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:20.111277  2493 raft_consensus.cc:740] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d612b55885c4aee87952bd05925f03b, State: Running, Role: LEADER
I20260709 13:13:20.111904  2493 consensus_queue.cc:260] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:20.112819  2493 raft_consensus.cc:3060] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.111250  2346 raft_consensus.cc:3060] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.115285  2344 raft_consensus.cc:3060] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:20.120664  2346 raft_consensus.cc:2468] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:20.122687  3047 leader_election.cc:304] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10; no voters: 
I20260709 13:13:20.122879  2489 raft_consensus.cc:2468] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:20.124061  3253 raft_consensus.cc:2804] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.124657  3050 leader_election.cc:304] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b, b87f37ab7e614ece80499e3f25bc9ea3; no voters: 
I20260709 13:13:20.124926  3253 raft_consensus.cc:697] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:20.125690  3316 raft_consensus.cc:2804] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:20.126195  3316 raft_consensus.cc:697] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:20.127100  3316 consensus_queue.cc:237] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:20.130761  2493 raft_consensus.cc:2468] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:20.126200  3253 consensus_queue.cc:237] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:20.123129  2344 raft_consensus.cc:2468] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:20.146034  2170 catalog_manager.cc:5697] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from 7d612b55885c4aee87952bd05925f03b (127.27.229.68) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.160244  2170 catalog_manager.cc:5697] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from cf33d724fb704d85ab3127e566123c10 (127.27.229.66) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:20.347209  2344 raft_consensus.cc:1275] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.348438  3253 consensus_queue.cc:1048] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.357864  2489 raft_consensus.cc:1275] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.359674  3316 consensus_queue.cc:1048] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:20.439252  2418 raft_consensus.cc:1275] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.440462  3316 consensus_queue.cc:1048] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.452888  2344 raft_consensus.cc:1275] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.454144  3253 consensus_queue.cc:1048] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.530913  2344 raft_consensus.cc:1275] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.532229  3253 consensus_queue.cc:1048] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.546310  2489 raft_consensus.cc:1275] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.548892  3313 consensus_queue.cc:1048] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.560672  2493 raft_consensus.cc:1275] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:20.562263  3313 consensus_queue.cc:1048] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.603192  2489 raft_consensus.cc:1275] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.604746  3313 consensus_queue.cc:1048] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.621728  2418 raft_consensus.cc:1275] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:20.622517  2346 raft_consensus.cc:1275] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:20.623313  3253 consensus_queue.cc:1048] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.624370  3337 consensus_queue.cc:1048] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:20.658987 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:20.702462 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:20.737409  2346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e"
dest_uuid: "cf33d724fb704d85ab3127e566123c10"
mode: GRACEFUL
new_leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:44230
I20260709 13:13:20.737959  2346 raft_consensus.cc:606] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Received request to transfer leadership to TS b87f37ab7e614ece80499e3f25bc9ea3
I20260709 13:13:20.739166 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:13:20.740437 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:21.157764  3268 raft_consensus.cc:993] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10: : Instructing follower b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:21.158284  3268 raft_consensus.cc:1081] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Signalling peer b87f37ab7e614ece80499e3f25bc9ea3 to start an election
I20260709 13:13:21.159610  3107 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e"
dest_uuid: "b87f37ab7e614ece80499e3f25bc9ea3"
 from {username='slave'} at 127.0.0.1:36500
I20260709 13:13:21.160034  3107 raft_consensus.cc:493] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:21.160301  3107 raft_consensus.cc:3060] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:21.166379  3107 raft_consensus.cc:515] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:21.169060  3107 leader_election.cc:290] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Requested vote from peers cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949), e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615)
I20260709 13:13:21.169162  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf33d724fb704d85ab3127e566123c10"
I20260709 13:13:21.169833  2344 raft_consensus.cc:3055] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:21.169976  2419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a38b520c4d354a30ab517a2539f0a42e" candidate_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e98dadf6176848ef8893b68c45629066"
I20260709 13:13:21.170234  2344 raft_consensus.cc:740] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf33d724fb704d85ab3127e566123c10, State: Running, Role: LEADER
I20260709 13:13:21.170631  2419 raft_consensus.cc:3060] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:21.171067  2344 consensus_queue.cc:260] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:21.172104  2344 raft_consensus.cc:3060] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:21.176074  2419 raft_consensus.cc:2468] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:21.177366  3050 leader_election.cc:304] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066; no voters: 
I20260709 13:13:21.178187  3316 raft_consensus.cc:2804] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:21.178668  3316 raft_consensus.cc:697] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Becoming Leader. State: Replica: b87f37ab7e614ece80499e3f25bc9ea3, State: Running, Role: LEADER
I20260709 13:13:21.178599  2344 raft_consensus.cc:2468] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87f37ab7e614ece80499e3f25bc9ea3 in term 2.
I20260709 13:13:21.179836  3316 consensus_queue.cc:237] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } }
I20260709 13:13:21.197472  2171 catalog_manager.cc:5697] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 reported cstate change: term changed from 1 to 2, leader changed from cf33d724fb704d85ab3127e566123c10 (127.27.229.66) to b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:21.590072  2346 raft_consensus.cc:1275] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.591259  3313 consensus_queue.cc:1048] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.602591  2419 raft_consensus.cc:1275] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Refusing update from remote peer b87f37ab7e614ece80499e3f25bc9ea3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:21.604532  3313 consensus_queue.cc:1048] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:21.741266 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:21.877259 28565 tablet_server.cc:179] TabletServer@127.27.229.65:40559 shutting down...
W20260709 13:13:21.916723  2387 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 114 similar messages]
W20260709 13:13:21.942382  2387 consensus_peers.cc:597] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.944830  2461 consensus_peers.cc:597] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.984951  2461 consensus_peers.cc:597] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.986486  2461 consensus_peers.cc:597] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.019989  2461 consensus_peers.cc:597] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.033567  2313 consensus_peers.cc:597] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.038551  2313 consensus_peers.cc:597] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.042608 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:22.048607 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.051373 28565 raft_consensus.cc:2243] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.052562 28565 raft_consensus.cc:2272] T 9ab2577017124173bbf7a9a3ccf1b044 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.056100  2313 consensus_peers.cc:597] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.057473 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.058811 28565 raft_consensus.cc:2243] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.059531 28565 raft_consensus.cc:2272] T c3ba9973b45145b0a660d1a46ac9da53 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.060585  2313 consensus_peers.cc:597] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.063725 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.064826 28565 raft_consensus.cc:2243] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:22.065269  2313 consensus_peers.cc:597] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.065595 28565 raft_consensus.cc:2272] T 086b4a405c1a426a9dfd410277309eb8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.069242 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.070200 28565 raft_consensus.cc:2243] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:22.071339  3048 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:13:22.071847 28565 raft_consensus.cc:2272] T 96d9df2600494490b900c0d25d88cd6a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.075671 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.076730 28565 raft_consensus.cc:2243] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.080106 28565 raft_consensus.cc:2272] T 401f4bd5793e424c8b248f0c7228ce2c P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.083091 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.083752 28565 raft_consensus.cc:2243] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.084693 28565 raft_consensus.cc:2272] T ea5fb36d7bd44d7a8b073eae26ba8b23 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.087240 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.087883 28565 raft_consensus.cc:2243] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.088783 28565 raft_consensus.cc:2272] T f6a7e2640e594f4c816e8bbfe035ea28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.092201 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.093281 28565 raft_consensus.cc:2243] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.094010 28565 raft_consensus.cc:2272] T e0dbbafcfa9d45b8b88a1851186758d6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.094504  2461 consensus_peers.cc:597] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.096994 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.097690 28565 raft_consensus.cc:2243] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.098181 28565 raft_consensus.cc:2272] T 7c00e7b281c741edaba5be11f02f5685 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.101323 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.102082 28565 raft_consensus.cc:2243] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.102679 28565 raft_consensus.cc:2272] T 2d57bcd5dc1f4559959b6af08f31e9ad P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.105952 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.106877 28565 raft_consensus.cc:2243] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.108767 28565 raft_consensus.cc:2272] T b812b253535b4aeea1d25a2fd849a6ef P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.110047  2461 consensus_peers.cc:597] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.110993  2461 consensus_peers.cc:597] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.111665  2461 consensus_peers.cc:597] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.112010 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.112735 28565 raft_consensus.cc:2243] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.113809 28565 raft_consensus.cc:2272] T f1839fe9b25246a78f571eef32e6ef2b P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.116994 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.117895 28565 raft_consensus.cc:2243] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.119385 28565 raft_consensus.cc:2272] T a388dcea8c964b44a75944b6a5e72c97 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.122854 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.123657 28565 raft_consensus.cc:2243] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.124126 28565 raft_consensus.cc:2272] T da1c8eb5f0b9448c8761472608c325e3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.126770 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.127403 28565 raft_consensus.cc:2243] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.127907 28565 raft_consensus.cc:2272] T 6327d6ef6b3c494b9b70a426897e9121 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.130600 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.131332 28565 raft_consensus.cc:2243] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.131855 28565 raft_consensus.cc:2272] T f322094126754e8885c94371d6292e5b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.132468  2387 consensus_peers.cc:597] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.134336 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.135052 28565 raft_consensus.cc:2243] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.135577 28565 raft_consensus.cc:2272] T 2a981f697d3849b8bf1f6d21f6ee49a6 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.138911 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.139954 28565 raft_consensus.cc:2243] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.140643 28565 raft_consensus.cc:2272] T dca50cf726644de7a82745b940c12b8d P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.142730  2461 consensus_peers.cc:597] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.144229 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.145319 28565 raft_consensus.cc:2243] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.145972 28565 raft_consensus.cc:2272] T 51b37d5c87774ab0aadad534ab6a652b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.149528  2461 consensus_peers.cc:597] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.149674 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.150455 28565 raft_consensus.cc:2243] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.150931 28565 raft_consensus.cc:2272] T 62d101e9e818491db6b36b9112b724f3 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.153716 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.154485 28565 raft_consensus.cc:2243] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.155141 28565 raft_consensus.cc:2272] T e6dd644561b24709b20fcb3ae2e883e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.157559 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.158380 28565 raft_consensus.cc:2243] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.158977 28565 raft_consensus.cc:2272] T 24353821c9e4434b957a5f26248d0b5a P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.160413  2461 consensus_peers.cc:597] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.161796 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.162622 28565 raft_consensus.cc:2243] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.163221 28565 raft_consensus.cc:2272] T 5f51c0624f6946a2871ddb439bf616e7 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.165971 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.166572 28565 raft_consensus.cc:2243] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.166998 28565 raft_consensus.cc:2272] T deb1d997d66d411b9175baf01eba5527 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.169468 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.170143 28565 raft_consensus.cc:2243] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.170634 28565 raft_consensus.cc:2272] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.173156 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.173745 28565 raft_consensus.cc:2243] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.174702 28565 raft_consensus.cc:2272] T e24620bfc0cd42408a861714b4aad2eb P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.177251 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.178056 28565 raft_consensus.cc:2243] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.179219 28565 raft_consensus.cc:2272] T da44ad18eaab4920bb17c257fe5ff546 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.181807 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.182415 28565 raft_consensus.cc:2243] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.183413 28565 raft_consensus.cc:2272] T d1bf4527355144469770b9b84ae9a88a P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.185626 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.186239 28565 raft_consensus.cc:2243] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.186691 28565 raft_consensus.cc:2272] T 32dce47c7bca4ca9867196d40543c2a9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.189538 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.190250 28565 raft_consensus.cc:2243] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.190836 28565 raft_consensus.cc:2272] T 7775d57497934ba19aeb046609de5e25 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.190912  2461 consensus_peers.cc:597] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.193017 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.193658 28565 raft_consensus.cc:2243] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.194579 28565 raft_consensus.cc:2272] T b1afd652caeb4870bc040ee85a68ee9f P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.196846 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.197435 28565 raft_consensus.cc:2243] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.197994 28565 raft_consensus.cc:2272] T 595f4be17edb429fa78dad4b4a237fe5 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.200892 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.201721 28565 raft_consensus.cc:2243] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:22.201749  2387 consensus_peers.cc:597] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.202445 28565 raft_consensus.cc:2272] T 98cc21fae71c4267b5b185563944dcd9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.205209 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.206060 28565 raft_consensus.cc:2243] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.206602 28565 raft_consensus.cc:2272] T f56b1f2e989a49adbbe3fda8fa181a98 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.209177 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.209724 28565 raft_consensus.cc:2243] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.210216 28565 raft_consensus.cc:2272] T 62a5d1b594b2484f9099f78faf6004e8 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.212414 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.212916 28565 raft_consensus.cc:2243] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.213358 28565 raft_consensus.cc:2272] T 572f21ffe3d5423ab1708c3718752308 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.215662 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.216148 28565 raft_consensus.cc:2243] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.217003 28565 raft_consensus.cc:2272] T b0c3f9ead2094675856fff4f3fdc8cf9 P b87f37ab7e614ece80499e3f25bc9ea3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.219801 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.220594 28565 raft_consensus.cc:2243] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.221055 28565 raft_consensus.cc:2272] T c2bd883297624b7eb3b686e8c91fa005 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.223317 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.223867 28565 raft_consensus.cc:2243] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.224357 28565 raft_consensus.cc:2272] T c9d485c05977430d926f04e26c16f267 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.226444 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.226933 28565 raft_consensus.cc:2243] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.227819 28565 raft_consensus.cc:2272] T a38b520c4d354a30ab517a2539f0a42e P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.230458 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.231029 28565 raft_consensus.cc:2243] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.231495 28565 raft_consensus.cc:2272] T d6ccc1fa5471499daebb6bfe28fe9eab P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.233644 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.234391 28565 raft_consensus.cc:2243] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.235316 28565 raft_consensus.cc:2272] T e35b4b5dcc014c7488f8e250fc29cd28 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.237725 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.238294 28565 raft_consensus.cc:2243] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.238911 28565 raft_consensus.cc:2272] T e0205f70184949afaacd77d16dc39833 P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.241582 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.242301 28565 raft_consensus.cc:2243] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.243255 28565 raft_consensus.cc:2272] T fa1e1d96a4584c249a551ed8c02cd932 P b87f37ab7e614ece80499e3f25bc9ea3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.245484 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:22.245980 28565 raft_consensus.cc:2243] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.246431 28565 raft_consensus.cc:2272] T eb7db953c1cb4d7282bfab9976f3998b P b87f37ab7e614ece80499e3f25bc9ea3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.260703  2313 consensus_peers.cc:597] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.268669  2313 consensus_peers.cc:597] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.285238  2313 consensus_peers.cc:597] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.295696  2387 consensus_peers.cc:597] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.304177  2387 consensus_peers.cc:597] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.330840  2387 consensus_peers.cc:597] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.333412 28565 tablet_server.cc:196] TabletServer@127.27.229.65:40559 shutdown complete.
W20260709 13:13:22.341192  2387 consensus_peers.cc:597] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.359683  2313 consensus_peers.cc:597] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.419322  2387 consensus_peers.cc:597] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.422307 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
W20260709 13:13:22.437199  2460 consensus_peers.cc:597] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.455190  2386 consensus_peers.cc:597] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.459985 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:22.460978 28565 tablet_replica.cc:333] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.462126 28565 raft_consensus.cc:2243] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.462711 28565 raft_consensus.cc:2272] T f1839fe9b25246a78f571eef32e6ef2b P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.464787 28565 tablet_replica.cc:333] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.465377 28565 raft_consensus.cc:2243] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.465956 28565 raft_consensus.cc:2272] T f56b1f2e989a49adbbe3fda8fa181a98 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.468770 28565 tablet_replica.cc:333] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.470665 28565 raft_consensus.cc:2243] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.471287 28565 raft_consensus.cc:2272] T 639b7a560e414c60a43f687a8eaf95f7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.473357  2461 consensus_peers.cc:597] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b -> Peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Couldn't send request to peer b87f37ab7e614ece80499e3f25bc9ea3. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.474360 28565 tablet_replica.cc:333] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.475076 28565 raft_consensus.cc:2243] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.475893 28565 raft_consensus.cc:2272] T da1c8eb5f0b9448c8761472608c325e3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.478024 28565 tablet_replica.cc:333] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.478749 28565 raft_consensus.cc:2243] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.479313 28565 raft_consensus.cc:2272] T d6ccc1fa5471499daebb6bfe28fe9eab P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.482389 28565 tablet_replica.cc:333] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.483192 28565 raft_consensus.cc:2243] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.484292 28565 raft_consensus.cc:2272] T 62d101e9e818491db6b36b9112b724f3 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.487311 28565 tablet_replica.cc:333] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.488130 28565 raft_consensus.cc:2243] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.488703 28565 raft_consensus.cc:2272] T e35b4b5dcc014c7488f8e250fc29cd28 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.491555 28565 tablet_replica.cc:333] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.502565 28565 raft_consensus.cc:2243] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.503214 28565 raft_consensus.cc:2272] T a38b520c4d354a30ab517a2539f0a42e P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.506743 28565 tablet_replica.cc:333] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.507622 28565 raft_consensus.cc:2243] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.508248 28565 raft_consensus.cc:2272] T c2bd883297624b7eb3b686e8c91fa005 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.511190 28565 tablet_replica.cc:333] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.511976 28565 raft_consensus.cc:2243] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.513150 28565 raft_consensus.cc:2272] T 5f7fbb0337a84684b74dd9e6b31e2863 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.515990 28565 tablet_replica.cc:333] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.516808 28565 raft_consensus.cc:2243] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.518173 28565 raft_consensus.cc:2272] T 32dce47c7bca4ca9867196d40543c2a9 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.521051 28565 tablet_replica.cc:333] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.521864 28565 raft_consensus.cc:2243] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.522497 28565 raft_consensus.cc:2272] T d1bf4527355144469770b9b84ae9a88a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.525228 28565 tablet_replica.cc:333] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.526108 28565 raft_consensus.cc:2243] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.526676 28565 raft_consensus.cc:2272] T f322094126754e8885c94371d6292e5b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.529616 28565 tablet_replica.cc:333] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.530431 28565 raft_consensus.cc:2243] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.531584 28565 raft_consensus.cc:2272] T 6327d6ef6b3c494b9b70a426897e9121 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.534703 28565 tablet_replica.cc:333] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
W20260709 13:13:22.534721  2460 consensus_peers.cc:597] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.535619 28565 raft_consensus.cc:2243] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.536301 28565 raft_consensus.cc:2272] T 5f51c0624f6946a2871ddb439bf616e7 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.539223 28565 tablet_replica.cc:333] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.540057 28565 raft_consensus.cc:2243] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.541239 28565 raft_consensus.cc:2272] T 24353821c9e4434b957a5f26248d0b5a P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.544114 28565 tablet_replica.cc:333] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.544965 28565 raft_consensus.cc:2243] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.545645 28565 raft_consensus.cc:2272] T 25f96db2fd0848edbbd0b74d46d285c8 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.548651 28565 tablet_replica.cc:333] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.549479 28565 raft_consensus.cc:2243] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.550083 28565 raft_consensus.cc:2272] T e0dbbafcfa9d45b8b88a1851186758d6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.552977 28565 tablet_replica.cc:333] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.553791 28565 raft_consensus.cc:2243] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.554418 28565 raft_consensus.cc:2272] T dda6016d742d427295ff961579eb0adc P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.557263 28565 tablet_replica.cc:333] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.558068 28565 raft_consensus.cc:2243] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.558631 28565 raft_consensus.cc:2272] T 5f79bc0e1fbb4d32923d277db6baaa91 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.561517 28565 tablet_replica.cc:333] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.562332 28565 raft_consensus.cc:2243] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.562927 28565 raft_consensus.cc:2272] T fa1e1d96a4584c249a551ed8c02cd932 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.565724 28565 tablet_replica.cc:333] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.566515 28565 raft_consensus.cc:2243] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:22.567230  2386 consensus_peers.cc:597] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.567714 28565 raft_consensus.cc:2272] T 2d57bcd5dc1f4559959b6af08f31e9ad P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.570730 28565 tablet_replica.cc:333] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
W20260709 13:13:22.570995  2386 consensus_peers.cc:597] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.571741 28565 raft_consensus.cc:2243] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.572450 28565 raft_consensus.cc:2272] T dca50cf726644de7a82745b940c12b8d P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.575296 28565 tablet_replica.cc:333] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
W20260709 13:13:22.575621  2386 consensus_peers.cc:597] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.576152 28565 raft_consensus.cc:2243] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.578687 28565 raft_consensus.cc:2272] T 51b37d5c87774ab0aadad534ab6a652b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.581578 28565 tablet_replica.cc:333] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.582576 28565 raft_consensus.cc:2243] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.583165 28565 raft_consensus.cc:2272] T 2a981f697d3849b8bf1f6d21f6ee49a6 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.586134 28565 tablet_replica.cc:333] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.586856 28565 raft_consensus.cc:2243] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.587939 28565 raft_consensus.cc:2272] T 61e0b15b3c884b8e99633d52c01d1f64 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.590651 28565 tablet_replica.cc:333] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.591266 28565 raft_consensus.cc:2243] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.592428 28565 raft_consensus.cc:2272] T c9643f19185c4726ba1ddb57ca801a95 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.595449 28565 tablet_replica.cc:333] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.596242 28565 raft_consensus.cc:2243] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.596792 28565 raft_consensus.cc:2272] T 98cc21fae71c4267b5b185563944dcd9 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.599400 28565 tablet_replica.cc:333] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.599970 28565 raft_consensus.cc:2243] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.600828 28565 raft_consensus.cc:2272] T 186ff068763e4792881c144c673946ac P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.602989 28565 tablet_replica.cc:333] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.603518 28565 raft_consensus.cc:2243] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.603950 28565 raft_consensus.cc:2272] T 500e7e1147774338aa8067755a8dfcb0 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.606043 28565 tablet_replica.cc:333] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.606570 28565 raft_consensus.cc:2243] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.607400 28565 raft_consensus.cc:2272] T 595f4be17edb429fa78dad4b4a237fe5 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.609279 28565 tablet_replica.cc:333] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.609797 28565 raft_consensus.cc:2243] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.610569 28565 raft_consensus.cc:2272] T bf6df690111e402c94e06d82cb995e45 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.612424 28565 tablet_replica.cc:333] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.612967 28565 raft_consensus.cc:2243] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.613420 28565 raft_consensus.cc:2272] T e24620bfc0cd42408a861714b4aad2eb P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.615523 28565 tablet_replica.cc:333] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.616065 28565 raft_consensus.cc:2243] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.616535 28565 raft_consensus.cc:2272] T da44ad18eaab4920bb17c257fe5ff546 P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.618494 28565 tablet_replica.cc:333] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.618980 28565 raft_consensus.cc:2243] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.619391 28565 raft_consensus.cc:2272] T eb7db953c1cb4d7282bfab9976f3998b P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.621847 28565 tablet_replica.cc:333] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.622668 28565 raft_consensus.cc:2243] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.623359 28565 raft_consensus.cc:2272] T 2fd662b171494cd18b261a83314083d3 P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.626482 28565 tablet_replica.cc:333] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.627357 28565 raft_consensus.cc:2243] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.627934 28565 raft_consensus.cc:2272] T 9a5033c63fb34bddaa116c59c67d0032 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.630672 28565 tablet_replica.cc:333] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.631484 28565 raft_consensus.cc:2243] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.632354 28565 raft_consensus.cc:2272] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.634500 28565 tablet_replica.cc:333] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.635102 28565 raft_consensus.cc:2243] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.635587 28565 raft_consensus.cc:2272] T 96d9df2600494490b900c0d25d88cd6a P cf33d724fb704d85ab3127e566123c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.637863 28565 tablet_replica.cc:333] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.638542 28565 raft_consensus.cc:2243] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.639492 28565 raft_consensus.cc:2272] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.639678  2460 consensus_peers.cc:597] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.641485 28565 tablet_replica.cc:333] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.642150 28565 raft_consensus.cc:2243] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.642598 28565 raft_consensus.cc:2272] T deb1d997d66d411b9175baf01eba5527 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.644568 28565 tablet_replica.cc:333] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.645030 28565 raft_consensus.cc:2243] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.645406 28565 raft_consensus.cc:2272] T 80a8678d891d4cfd999693b186227d40 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.647382 28565 tablet_replica.cc:333] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.647814 28565 raft_consensus.cc:2243] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.648175 28565 raft_consensus.cc:2272] T b1afd652caeb4870bc040ee85a68ee9f P cf33d724fb704d85ab3127e566123c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.650153 28565 tablet_replica.cc:333] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10: stopping tablet replica
I20260709 13:13:22.650592 28565 raft_consensus.cc:2243] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.651362 28565 raft_consensus.cc:2272] T 572f21ffe3d5423ab1708c3718752308 P cf33d724fb704d85ab3127e566123c10 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.659273  2460 consensus_peers.cc:597] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.688158  2386 consensus_peers.cc:597] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.696620  2386 consensus_peers.cc:597] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.707100  2460 consensus_peers.cc:597] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.728724 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
W20260709 13:13:22.785676  2386 consensus_peers.cc:597] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.797605  2386 consensus_peers.cc:597] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.808063  2460 consensus_peers.cc:597] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.823741  2386 consensus_peers.cc:597] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.832056 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
W20260709 13:13:22.860342  2463 consensus_peers.cc:597] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.888172 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:22.889097 28565 tablet_replica.cc:333] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.889799 28565 raft_consensus.cc:2243] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.890385 28565 raft_consensus.cc:2272] T f6a7e2640e594f4c816e8bbfe035ea28 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.892779 28565 tablet_replica.cc:333] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.893622 28565 raft_consensus.cc:2243] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.894251 28565 raft_consensus.cc:2272] T ea5fb36d7bd44d7a8b073eae26ba8b23 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.896649  2460 consensus_peers.cc:597] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:22.896853  2463 consensus_peers.cc:597] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.897346 28565 tablet_replica.cc:333] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.898072 28565 raft_consensus.cc:2243] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.898861 28565 raft_consensus.cc:2272] T f56b1f2e989a49adbbe3fda8fa181a98 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.901240 28565 tablet_replica.cc:333] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.901842 28565 raft_consensus.cc:2243] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.902292 28565 raft_consensus.cc:2272] T 62a5d1b594b2484f9099f78faf6004e8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.904656 28565 tablet_replica.cc:333] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066: stopping tablet replica
W20260709 13:13:22.904578  2386 consensus_peers.cc:597] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.905539 28565 raft_consensus.cc:2243] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.906092 28565 raft_consensus.cc:2272] T b812b253535b4aeea1d25a2fd849a6ef P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.908231 28565 tablet_replica.cc:333] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.908792 28565 raft_consensus.cc:2243] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.909220 28565 raft_consensus.cc:2272] T 63b29c3e7d3b4be7aab7aa8cf53c04a8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.911288 28565 tablet_replica.cc:333] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.911996 28565 raft_consensus.cc:2243] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.912513 28565 raft_consensus.cc:2272] T da1c8eb5f0b9448c8761472608c325e3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.915334  2463 consensus_peers.cc:597] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.915477 28565 tablet_replica.cc:333] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.917104 28565 raft_consensus.cc:2243] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.918244 28565 raft_consensus.cc:2272] T 51b37d5c87774ab0aadad534ab6a652b P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.918643  2386 consensus_peers.cc:597] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.920432 28565 tablet_replica.cc:333] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.921198 28565 raft_consensus.cc:2243] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.921633 28565 raft_consensus.cc:2272] T c3ba9973b45145b0a660d1a46ac9da53 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.924147 28565 tablet_replica.cc:333] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
W20260709 13:13:22.924438  2463 consensus_peers.cc:597] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.924962 28565 raft_consensus.cc:2243] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.925483 28565 raft_consensus.cc:2272] T 9ab2577017124173bbf7a9a3ccf1b044 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.927831 28565 tablet_replica.cc:333] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.928462 28565 raft_consensus.cc:2243] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.928936 28565 raft_consensus.cc:2272] T 62d101e9e818491db6b36b9112b724f3 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.931093 28565 tablet_replica.cc:333] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.931762 28565 raft_consensus.cc:2243] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.932534 28565 raft_consensus.cc:2272] T e0205f70184949afaacd77d16dc39833 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.934464 28565 tablet_replica.cc:333] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.934998 28565 raft_consensus.cc:2243] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.935755 28565 raft_consensus.cc:2272] T 639b7a560e414c60a43f687a8eaf95f7 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.937703 28565 tablet_replica.cc:333] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.938274 28565 raft_consensus.cc:2243] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.938710 28565 raft_consensus.cc:2272] T 7c00e7b281c741edaba5be11f02f5685 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.940493 28565 tablet_replica.cc:333] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.941016 28565 raft_consensus.cc:2243] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.941761 28565 raft_consensus.cc:2272] T dda6016d742d427295ff961579eb0adc P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.943466 28565 tablet_replica.cc:333] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.943991 28565 raft_consensus.cc:2243] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.944732 28565 raft_consensus.cc:2272] T 25f96db2fd0848edbbd0b74d46d285c8 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.946573 28565 tablet_replica.cc:333] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.947080 28565 raft_consensus.cc:2243] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.947512 28565 raft_consensus.cc:2272] T e6dd644561b24709b20fcb3ae2e883e8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.949359 28565 tablet_replica.cc:333] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.949908 28565 raft_consensus.cc:2243] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.950343 28565 raft_consensus.cc:2272] T 24353821c9e4434b957a5f26248d0b5a P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.952265 28565 tablet_replica.cc:333] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.952915 28565 raft_consensus.cc:2243] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.953423 28565 raft_consensus.cc:2272] T b1afd652caeb4870bc040ee85a68ee9f P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.956018 28565 tablet_replica.cc:333] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.956743 28565 raft_consensus.cc:2243] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.957508 28565 raft_consensus.cc:2272] T 7775d57497934ba19aeb046609de5e25 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.959998 28565 tablet_replica.cc:333] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.960568 28565 raft_consensus.cc:2243] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.961009 28565 raft_consensus.cc:2272] T a38b520c4d354a30ab517a2539f0a42e P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.963333 28565 tablet_replica.cc:333] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.964038 28565 raft_consensus.cc:2243] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.964968 28565 raft_consensus.cc:2272] T c9d485c05977430d926f04e26c16f267 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.965608  2460 consensus_peers.cc:597] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.967278 28565 tablet_replica.cc:333] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.967914 28565 raft_consensus.cc:2243] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.968627 28565 raft_consensus.cc:2272] T c2bd883297624b7eb3b686e8c91fa005 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.970494 28565 tablet_replica.cc:333] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.971107 28565 raft_consensus.cc:2243] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.971537 28565 raft_consensus.cc:2272] T 9a5033c63fb34bddaa116c59c67d0032 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.973841 28565 tablet_replica.cc:333] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.974650 28565 raft_consensus.cc:2243] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.975111 28565 raft_consensus.cc:2272] T 5f7fbb0337a84684b74dd9e6b31e2863 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:22.975258  2460 consensus_peers.cc:597] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b -> Peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Couldn't send request to peer cf33d724fb704d85ab3127e566123c10. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.977280 28565 tablet_replica.cc:333] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.977818 28565 raft_consensus.cc:2243] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.978246 28565 raft_consensus.cc:2272] T 32dce47c7bca4ca9867196d40543c2a9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.980077 28565 tablet_replica.cc:333] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.980561 28565 raft_consensus.cc:2243] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.981252 28565 raft_consensus.cc:2272] T f322094126754e8885c94371d6292e5b P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.983212 28565 tablet_replica.cc:333] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.984009 28565 raft_consensus.cc:2243] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.984549 28565 raft_consensus.cc:2272] T 6327d6ef6b3c494b9b70a426897e9121 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.987036 28565 tablet_replica.cc:333] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.987703 28565 raft_consensus.cc:2243] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.988227 28565 raft_consensus.cc:2272] T 61e0b15b3c884b8e99633d52c01d1f64 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.990329 28565 tablet_replica.cc:333] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.990864 28565 raft_consensus.cc:2243] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.991303 28565 raft_consensus.cc:2272] T c9643f19185c4726ba1ddb57ca801a95 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.993270 28565 tablet_replica.cc:333] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.993783 28565 raft_consensus.cc:2243] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.994592 28565 raft_consensus.cc:2272] T 500e7e1147774338aa8067755a8dfcb0 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.996546 28565 tablet_replica.cc:333] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:22.997030 28565 raft_consensus.cc:2243] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.997741 28565 raft_consensus.cc:2272] T 98cc21fae71c4267b5b185563944dcd9 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.999612 28565 tablet_replica.cc:333] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.000181 28565 raft_consensus.cc:2243] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.000665 28565 raft_consensus.cc:2272] T 186ff068763e4792881c144c673946ac P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.002533 28565 tablet_replica.cc:333] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.003047 28565 raft_consensus.cc:2243] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.003494 28565 raft_consensus.cc:2272] T b0c3f9ead2094675856fff4f3fdc8cf9 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.005556 28565 tablet_replica.cc:333] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.006114 28565 raft_consensus.cc:2243] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.006541 28565 raft_consensus.cc:2272] T 80a8678d891d4cfd999693b186227d40 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.008347 28565 tablet_replica.cc:333] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.008855 28565 raft_consensus.cc:2243] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.009619 28565 raft_consensus.cc:2272] T 2fd662b171494cd18b261a83314083d3 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.011396 28565 tablet_replica.cc:333] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.011938 28565 raft_consensus.cc:2243] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.012327 28565 raft_consensus.cc:2272] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.014402 28565 tablet_replica.cc:333] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.014931 28565 raft_consensus.cc:2243] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.015388 28565 raft_consensus.cc:2272] T 401f4bd5793e424c8b248f0c7228ce2c P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.017270 28565 tablet_replica.cc:333] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.017756 28565 raft_consensus.cc:2243] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.018196 28565 raft_consensus.cc:2272] T 572f21ffe3d5423ab1708c3718752308 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.020059 28565 tablet_replica.cc:333] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.020661 28565 raft_consensus.cc:2243] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.021167 28565 raft_consensus.cc:2272] T a388dcea8c964b44a75944b6a5e72c97 P e98dadf6176848ef8893b68c45629066 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.023684 28565 tablet_replica.cc:333] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.024367 28565 raft_consensus.cc:2243] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.024822 28565 raft_consensus.cc:2272] T bf6df690111e402c94e06d82cb995e45 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.027426 28565 tablet_replica.cc:333] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.028097 28565 raft_consensus.cc:2243] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.028640 28565 raft_consensus.cc:2272] T 086b4a405c1a426a9dfd410277309eb8 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.030947 28565 tablet_replica.cc:333] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.031435 28565 raft_consensus.cc:2243] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.032232 28565 raft_consensus.cc:2272] T 5f79bc0e1fbb4d32923d277db6baaa91 P e98dadf6176848ef8893b68c45629066 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.034305 28565 tablet_replica.cc:333] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066: stopping tablet replica
I20260709 13:13:23.034778 28565 raft_consensus.cc:2243] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.035204 28565 raft_consensus.cc:2272] T fa1e1d96a4584c249a551ed8c02cd932 P e98dadf6176848ef8893b68c45629066 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.095614  3297 raft_consensus.cc:493] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:23.096091  3297 raft_consensus.cc:515] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:23.097965  3297 leader_election.cc:290] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
W20260709 13:13:23.101332  2461 leader_election.cc:336] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
W20260709 13:13:23.102154  2460 leader_election.cc:336] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111)
I20260709 13:13:23.102486  2460 leader_election.cc:304] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:23.103048  3297 raft_consensus.cc:2749] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.108407 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
W20260709 13:13:23.120788  2463 consensus_peers.cc:597] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.67:33615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:23.131688  2463 consensus_peers.cc:597] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.67:33615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.158388  3297 raft_consensus.cc:493] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:23.159056  3297 raft_consensus.cc:515] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:23.161795  3297 leader_election.cc:290] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
W20260709 13:13:23.166524  2461 leader_election.cc:336] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
W20260709 13:13:23.167872  2460 leader_election.cc:336] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111)
I20260709 13:13:23.169872  2460 leader_election.cc:304] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:23.170596  3297 raft_consensus.cc:2749] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:23.189811  3373 raft_consensus.cc:493] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:23.190388  3373 raft_consensus.cc:515] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e98dadf6176848ef8893b68c45629066" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33615 } } peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } }
I20260709 13:13:23.192382  3373 leader_election.cc:290] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615), b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559)
I20260709 13:13:23.196192 28565 tablet_server.cc:179] TabletServer@127.27.229.68:0 shutting down...
W20260709 13:13:23.197256  2463 leader_election.cc:336] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Network error: Client connection negotiation failed: client connection to 127.27.229.67:33615: connect: Connection refused (error 111)
W20260709 13:13:23.197803  2461 leader_election.cc:336] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:23.198345  2461 leader_election.cc:304] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, e98dadf6176848ef8893b68c45629066
I20260709 13:13:23.199275  3373 raft_consensus.cc:2749] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:13:23.236202  2463 consensus_peers.cc:597] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b -> Peer e98dadf6176848ef8893b68c45629066 (127.27.229.67:33615): Couldn't send request to peer e98dadf6176848ef8893b68c45629066. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.67:33615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:23.244521 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:23.245451 28565 tablet_replica.cc:333] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.246413 28565 raft_consensus.cc:2243] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.246871 28565 raft_consensus.cc:2272] T f1839fe9b25246a78f571eef32e6ef2b P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.248978 28565 tablet_replica.cc:333] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.249536 28565 raft_consensus.cc:2243] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.249992 28565 raft_consensus.cc:2272] T f6a7e2640e594f4c816e8bbfe035ea28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.251971 28565 tablet_replica.cc:333] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.252516 28565 raft_consensus.cc:2243] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.252913 28565 raft_consensus.cc:2272] T ea5fb36d7bd44d7a8b073eae26ba8b23 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.254794 28565 tablet_replica.cc:333] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.255360 28565 raft_consensus.cc:2243] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.256083 28565 raft_consensus.cc:2272] T 62a5d1b594b2484f9099f78faf6004e8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.257895 28565 tablet_replica.cc:333] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.258445 28565 raft_consensus.cc:2243] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.258850 28565 raft_consensus.cc:2272] T b812b253535b4aeea1d25a2fd849a6ef P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.260648 28565 tablet_replica.cc:333] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.261240 28565 raft_consensus.cc:2243] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.261586  3373 raft_consensus.cc:493] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b87f37ab7e614ece80499e3f25bc9ea3)
I20260709 13:13:23.261792 28565 raft_consensus.cc:2272] T 5f79bc0e1fbb4d32923d277db6baaa91 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.262190  3373 raft_consensus.cc:515] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d612b55885c4aee87952bd05925f03b" member_type: VOTER last_known_addr { host: "127.27.229.68" port: 36641 } } peers { permanent_uuid: "b87f37ab7e614ece80499e3f25bc9ea3" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 40559 } } peers { permanent_uuid: "cf33d724fb704d85ab3127e566123c10" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 37949 } }
I20260709 13:13:23.263974  3373 leader_election.cc:290] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559), cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949)
I20260709 13:13:23.264418 28565 tablet_replica.cc:333] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.265338 28565 raft_consensus.cc:2243] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.265981 28565 raft_consensus.cc:2272] T 639b7a560e414c60a43f687a8eaf95f7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:23.268302  2461 leader_election.cc:336] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b87f37ab7e614ece80499e3f25bc9ea3 (127.27.229.65:40559): Network error: Client connection negotiation failed: client connection to 127.27.229.65:40559: connect: Connection refused (error 111)
I20260709 13:13:23.268903 28565 tablet_replica.cc:333] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
W20260709 13:13:23.269622  2460 leader_election.cc:336] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer cf33d724fb704d85ab3127e566123c10 (127.27.229.66:37949): Network error: Client connection negotiation failed: client connection to 127.27.229.66:37949: connect: Connection refused (error 111)
I20260709 13:13:23.269824 28565 raft_consensus.cc:2243] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.270129  2460 leader_election.cc:304] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d612b55885c4aee87952bd05925f03b; no voters: b87f37ab7e614ece80499e3f25bc9ea3, cf33d724fb704d85ab3127e566123c10
I20260709 13:13:23.270793  3373 raft_consensus.cc:2749] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:13:23.270881 28565 raft_consensus.cc:2272] T 7c00e7b281c741edaba5be11f02f5685 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.273593 28565 tablet_replica.cc:333] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.274205 28565 raft_consensus.cc:2243] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.274992 28565 raft_consensus.cc:2272] T d6ccc1fa5471499daebb6bfe28fe9eab P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.276962 28565 tablet_replica.cc:333] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.277531 28565 raft_consensus.cc:2243] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.278344 28565 raft_consensus.cc:2272] T 9ab2577017124173bbf7a9a3ccf1b044 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.280575 28565 tablet_replica.cc:333] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.281261 28565 raft_consensus.cc:2243] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.282023 28565 raft_consensus.cc:2272] T c3ba9973b45145b0a660d1a46ac9da53 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.283911 28565 tablet_replica.cc:333] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.284478 28565 raft_consensus.cc:2243] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.284938 28565 raft_consensus.cc:2272] T 5f7fbb0337a84684b74dd9e6b31e2863 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.287012 28565 tablet_replica.cc:333] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.287551 28565 raft_consensus.cc:2243] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.287974 28565 raft_consensus.cc:2272] T d1bf4527355144469770b9b84ae9a88a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.289938 28565 tablet_replica.cc:333] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.290467 28565 raft_consensus.cc:2243] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.290881 28565 raft_consensus.cc:2272] T b0c3f9ead2094675856fff4f3fdc8cf9 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.292750 28565 tablet_replica.cc:333] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.293252 28565 raft_consensus.cc:2243] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.294059 28565 raft_consensus.cc:2272] T 80a8678d891d4cfd999693b186227d40 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.295876 28565 tablet_replica.cc:333] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.296435 28565 raft_consensus.cc:2243] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.296835 28565 raft_consensus.cc:2272] T e35b4b5dcc014c7488f8e250fc29cd28 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.298722 28565 tablet_replica.cc:333] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.299264 28565 raft_consensus.cc:2243] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.299683 28565 raft_consensus.cc:2272] T e0205f70184949afaacd77d16dc39833 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.301769 28565 tablet_replica.cc:333] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.302325 28565 raft_consensus.cc:2243] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.302788 28565 raft_consensus.cc:2272] T 25f96db2fd0848edbbd0b74d46d285c8 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.304656 28565 tablet_replica.cc:333] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.305186 28565 raft_consensus.cc:2243] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.305951 28565 raft_consensus.cc:2272] T dca50cf726644de7a82745b940c12b8d P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.307843 28565 tablet_replica.cc:333] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.308386 28565 raft_consensus.cc:2243] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.309131 28565 raft_consensus.cc:2272] T 2a981f697d3849b8bf1f6d21f6ee49a6 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.311179 28565 tablet_replica.cc:333] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.311724 28565 raft_consensus.cc:2243] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.312129 28565 raft_consensus.cc:2272] T 61e0b15b3c884b8e99633d52c01d1f64 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.314185 28565 tablet_replica.cc:333] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.314698 28565 raft_consensus.cc:2243] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.315071 28565 raft_consensus.cc:2272] T c9643f19185c4726ba1ddb57ca801a95 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.317026 28565 tablet_replica.cc:333] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.317567 28565 raft_consensus.cc:2243] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.317989 28565 raft_consensus.cc:2272] T 186ff068763e4792881c144c673946ac P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.319743 28565 tablet_replica.cc:333] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.320228 28565 raft_consensus.cc:2243] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.320602 28565 raft_consensus.cc:2272] T 500e7e1147774338aa8067755a8dfcb0 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.322455 28565 tablet_replica.cc:333] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.322983 28565 raft_consensus.cc:2243] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.323369 28565 raft_consensus.cc:2272] T bf6df690111e402c94e06d82cb995e45 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.325448 28565 tablet_replica.cc:333] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.325971 28565 raft_consensus.cc:2243] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.326349 28565 raft_consensus.cc:2272] T 595f4be17edb429fa78dad4b4a237fe5 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.328224 28565 tablet_replica.cc:333] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.328927 28565 raft_consensus.cc:2243] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.330010 28565 raft_consensus.cc:2272] T 5f51c0624f6946a2871ddb439bf616e7 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.332242 28565 tablet_replica.cc:333] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.332825 28565 raft_consensus.cc:2243] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.333582 28565 raft_consensus.cc:2272] T e6dd644561b24709b20fcb3ae2e883e8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.335516 28565 tablet_replica.cc:333] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.336036 28565 raft_consensus.cc:2243] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.336439 28565 raft_consensus.cc:2272] T 87781f9dd28d4ae7bcf9a3daf87ed7f8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.338498 28565 tablet_replica.cc:333] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.339012 28565 raft_consensus.cc:2243] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.339449 28565 raft_consensus.cc:2272] T 401f4bd5793e424c8b248f0c7228ce2c P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.341360 28565 tablet_replica.cc:333] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.341856 28565 raft_consensus.cc:2243] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.342305 28565 raft_consensus.cc:2272] T 96d9df2600494490b900c0d25d88cd6a P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.344113 28565 tablet_replica.cc:333] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.344610 28565 raft_consensus.cc:2243] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.345337 28565 raft_consensus.cc:2272] T 9a5033c63fb34bddaa116c59c67d0032 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.347133 28565 tablet_replica.cc:333] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.347644 28565 raft_consensus.cc:2243] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.348392 28565 raft_consensus.cc:2272] T deb1d997d66d411b9175baf01eba5527 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.350368 28565 tablet_replica.cc:333] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.350868 28565 raft_consensus.cc:2243] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.351243 28565 raft_consensus.cc:2272] T 7775d57497934ba19aeb046609de5e25 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.353035 28565 tablet_replica.cc:333] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.353543 28565 raft_consensus.cc:2243] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.354256 28565 raft_consensus.cc:2272] T 086b4a405c1a426a9dfd410277309eb8 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.355969 28565 tablet_replica.cc:333] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.356436 28565 raft_consensus.cc:2243] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.356797 28565 raft_consensus.cc:2272] T 2d57bcd5dc1f4559959b6af08f31e9ad P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.358598 28565 tablet_replica.cc:333] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.359072 28565 raft_consensus.cc:2243] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.359450 28565 raft_consensus.cc:2272] T dda6016d742d427295ff961579eb0adc P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.361160 28565 tablet_replica.cc:333] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.361619 28565 raft_consensus.cc:2243] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.362327 28565 raft_consensus.cc:2272] T e0dbbafcfa9d45b8b88a1851186758d6 P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.364203 28565 tablet_replica.cc:333] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.364691 28565 raft_consensus.cc:2243] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.365051 28565 raft_consensus.cc:2272] T a388dcea8c964b44a75944b6a5e72c97 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.366856 28565 tablet_replica.cc:333] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.367326 28565 raft_consensus.cc:2243] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.367708 28565 raft_consensus.cc:2272] T c9d485c05977430d926f04e26c16f267 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.369443 28565 tablet_replica.cc:333] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.369884 28565 raft_consensus.cc:2243] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.370253 28565 raft_consensus.cc:2272] T e24620bfc0cd42408a861714b4aad2eb P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.372014 28565 tablet_replica.cc:333] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.372450 28565 raft_consensus.cc:2243] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.372828 28565 raft_consensus.cc:2272] T da44ad18eaab4920bb17c257fe5ff546 P 7d612b55885c4aee87952bd05925f03b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.374661 28565 tablet_replica.cc:333] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.375072 28565 raft_consensus.cc:2243] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.375761 28565 raft_consensus.cc:2272] T eb7db953c1cb4d7282bfab9976f3998b P 7d612b55885c4aee87952bd05925f03b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.377547 28565 tablet_replica.cc:333] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b: stopping tablet replica
I20260709 13:13:23.377969 28565 raft_consensus.cc:2243] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:23.378356 28565 raft_consensus.cc:2272] T 2fd662b171494cd18b261a83314083d3 P 7d612b55885c4aee87952bd05925f03b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.438548 28565 tablet_server.cc:196] TabletServer@127.27.229.68:0 shutdown complete.
I20260709 13:13:23.497246 28565 master.cc:562] Master@127.27.229.126:46147 shutting down...
I20260709 13:13:23.518827 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:23.519421 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:23.519733 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P dc930e44c99944e487346fe701d1e9bb: stopping tablet replica
I20260709 13:13:23.540349 28565 master.cc:584] Master@127.27.229.126:46147 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (29032 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:13:23.628136 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:38899
I20260709 13:13:23.629347 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:23.635850  3381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:23.635864  3380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:23.640179 28565 server_base.cc:1061] running on GCE node
W20260709 13:13:23.640203  3383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:23.641422 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:23.641640 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:23.641791 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602803641772 us; error 0 us; skew 500 ppm
I20260709 13:13:23.642335 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:23.644734 28565 webserver.cc:533] Webserver started at http://127.27.229.126:35977/ using document root <none> and password file <none>
I20260709 13:13:23.645217 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:23.645416 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:23.645665 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:23.646836 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "65e571166af44535b7411e1bf1fbe63d"
format_stamp: "Formatted at 2026-07-09 13:13:23 on dist-test-slave-twc1"
I20260709 13:13:23.651226 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:13:23.654712  3388 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:23.655472 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:23.655751 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "65e571166af44535b7411e1bf1fbe63d"
format_stamp: "Formatted at 2026-07-09 13:13:23 on dist-test-slave-twc1"
I20260709 13:13:23.656023 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:23.676301 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:23.677554 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:23.719314 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:38899
I20260709 13:13:23.719424  3439 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:38899 every 8 connection(s)
I20260709 13:13:23.723274  3440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:23.734030  3440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d: Bootstrap starting.
I20260709 13:13:23.738756  3440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:23.743044  3440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d: No bootstrap required, opened a new log
I20260709 13:13:23.745323  3440 raft_consensus.cc:359] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e571166af44535b7411e1bf1fbe63d" member_type: VOTER }
I20260709 13:13:23.745738  3440 raft_consensus.cc:385] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:23.745983  3440 raft_consensus.cc:740] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e571166af44535b7411e1bf1fbe63d, State: Initialized, Role: FOLLOWER
I20260709 13:13:23.746526  3440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e571166af44535b7411e1bf1fbe63d" member_type: VOTER }
I20260709 13:13:23.746986  3440 raft_consensus.cc:399] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:23.747205  3440 raft_consensus.cc:493] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:23.747447  3440 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:23.752178  3440 raft_consensus.cc:515] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e571166af44535b7411e1bf1fbe63d" member_type: VOTER }
I20260709 13:13:23.752758  3440 leader_election.cc:304] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65e571166af44535b7411e1bf1fbe63d; no voters: 
I20260709 13:13:23.753906  3440 leader_election.cc:290] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:23.754343  3443 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:23.755724  3443 raft_consensus.cc:697] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 1 LEADER]: Becoming Leader. State: Replica: 65e571166af44535b7411e1bf1fbe63d, State: Running, Role: LEADER
I20260709 13:13:23.756428  3443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e571166af44535b7411e1bf1fbe63d" member_type: VOTER }
I20260709 13:13:23.756948  3440 sys_catalog.cc:565] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:23.761317  3445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65e571166af44535b7411e1bf1fbe63d. Latest consensus state: current_term: 1 leader_uuid: "65e571166af44535b7411e1bf1fbe63d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e571166af44535b7411e1bf1fbe63d" member_type: VOTER } }
I20260709 13:13:23.761256  3444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65e571166af44535b7411e1bf1fbe63d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e571166af44535b7411e1bf1fbe63d" member_type: VOTER } }
I20260709 13:13:23.762115  3445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:23.762174  3444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:23.764909  3450 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:23.770038  3450 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:23.773947 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:23.779102  3450 catalog_manager.cc:1383] Generated new cluster ID: d76e910617134a46945918a392c385b8
I20260709 13:13:23.779409  3450 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:23.820050  3450 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:23.821343  3450 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:23.835016  3450 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d: Generated new TSK 0
I20260709 13:13:23.835649  3450 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:23.840574 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:23.847137  3461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:23.847954  3462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:23.850267 28565 server_base.cc:1061] running on GCE node
W20260709 13:13:23.850402  3464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:23.851557 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:23.851751 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:23.851876 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602803851864 us; error 0 us; skew 500 ppm
I20260709 13:13:23.852325 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:23.854744 28565 webserver.cc:533] Webserver started at http://127.27.229.65:45887/ using document root <none> and password file <none>
I20260709 13:13:23.855217 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:23.855383 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:23.855590 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:23.856623 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
format_stamp: "Formatted at 2026-07-09 13:13:23 on dist-test-slave-twc1"
I20260709 13:13:23.861128 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:13:23.864494  3469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:23.865240 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:23.865556 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
format_stamp: "Formatted at 2026-07-09 13:13:23 on dist-test-slave-twc1"
I20260709 13:13:23.865828 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:23.885329 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:23.886682 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:23.888216 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:23.890722 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:23.890903 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:23.891093 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:23.891229 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:23.932875 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:46527
I20260709 13:13:23.933003  3531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:46527 every 8 connection(s)
I20260709 13:13:23.937871 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:23.945128  3536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:23.948731  3537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:23.948849  3539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:23.952709 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:23.954212 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:23.954434 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:23.954663 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602803954639 us; error 0 us; skew 500 ppm
I20260709 13:13:23.955251 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:23.955304  3532 heartbeater.cc:344] Connected to a master server at 127.27.229.126:38899
I20260709 13:13:23.955921  3532 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:23.956991  3532 heartbeater.cc:507] Master 127.27.229.126:38899 requested a full tablet report, sending...
I20260709 13:13:23.958068 28565 webserver.cc:533] Webserver started at http://127.27.229.66:41413/ using document root <none> and password file <none>
I20260709 13:13:23.958667 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:23.958912 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:23.959178 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:23.959465  3405 ts_manager.cc:194] Registered new tserver with Master: cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527)
I20260709 13:13:23.960430 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "0ba6bf810a864db593372c571bba1a67"
format_stamp: "Formatted at 2026-07-09 13:13:23 on dist-test-slave-twc1"
I20260709 13:13:23.961261  3405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48946
I20260709 13:13:23.965716 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:13:23.969542  3544 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:23.970342 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:23.970643 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "0ba6bf810a864db593372c571bba1a67"
format_stamp: "Formatted at 2026-07-09 13:13:23 on dist-test-slave-twc1"
I20260709 13:13:23.970957 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:23.981061 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:23.982384 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:23.983888 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:23.986312 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:23.986529 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:23.986763 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:23.986928 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.027895 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:43977
I20260709 13:13:24.027992  3606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:43977 every 8 connection(s)
I20260709 13:13:24.032831 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:24.039916  3610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.043210  3607 heartbeater.cc:344] Connected to a master server at 127.27.229.126:38899
I20260709 13:13:24.043898  3607 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:24.044042  3611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.046597  3607 heartbeater.cc:507] Master 127.27.229.126:38899 requested a full tablet report, sending...
I20260709 13:13:24.050534  3405 ts_manager.cc:194] Registered new tserver with Master: 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:24.052816  3405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48962
I20260709 13:13:24.055994 28565 server_base.cc:1061] running on GCE node
W20260709 13:13:24.056032  3613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:24.057176 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:24.057421 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:24.057600 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602804057582 us; error 0 us; skew 500 ppm
I20260709 13:13:24.058290 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:24.060591 28565 webserver.cc:533] Webserver started at http://127.27.229.67:41663/ using document root <none> and password file <none>
I20260709 13:13:24.061086 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:24.061272 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:24.061522 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:24.062711 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "5d12ee7ead55455d843508760c81bcc3"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-twc1"
I20260709 13:13:24.067168 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:24.070640  3618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.071445 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:24.071748 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "5d12ee7ead55455d843508760c81bcc3"
format_stamp: "Formatted at 2026-07-09 13:13:24 on dist-test-slave-twc1"
I20260709 13:13:24.072067 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:24.085793 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:24.087090 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:24.088569 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:24.090925 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:24.091131 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.091375 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:24.091517 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:24.131073 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:43933
I20260709 13:13:24.131186  3680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:43933 every 8 connection(s)
I20260709 13:13:24.144703  3681 heartbeater.cc:344] Connected to a master server at 127.27.229.126:38899
I20260709 13:13:24.145145  3681 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:24.145845  3681 heartbeater.cc:507] Master 127.27.229.126:38899 requested a full tablet report, sending...
I20260709 13:13:24.147764  3405 ts_manager.cc:194] Registered new tserver with Master: 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.147850 28565 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013703552s
I20260709 13:13:24.149159  3405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48972
I20260709 13:13:24.173508  3405 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48978:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:24.176405  3405 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:24.253057  3646 tablet_service.cc:1511] Processing CreateTablet for tablet 0508b02b59b54a43ad7bb79594be2553 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:24.254595  3646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0508b02b59b54a43ad7bb79594be2553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.259999  3497 tablet_service.cc:1511] Processing CreateTablet for tablet 0508b02b59b54a43ad7bb79594be2553 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:24.261555  3497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0508b02b59b54a43ad7bb79594be2553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.263407  3645 tablet_service.cc:1511] Processing CreateTablet for tablet ad9c8cffe39240f194a1496c6b44c74d (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:24.264962  3645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9c8cffe39240f194a1496c6b44c74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.265514  3496 tablet_service.cc:1511] Processing CreateTablet for tablet ad9c8cffe39240f194a1496c6b44c74d (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:24.266932  3496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9c8cffe39240f194a1496c6b44c74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.268959  3495 tablet_service.cc:1511] Processing CreateTablet for tablet 1df9edf20307470ba72f256250994a02 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:24.271126  3494 tablet_service.cc:1511] Processing CreateTablet for tablet b9cfb1606e6f4e1f855c7447d37795f7 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:24.273103  3493 tablet_service.cc:1511] Processing CreateTablet for tablet a7fecc51298045668569ed36c69fbc4f (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:24.274823  3644 tablet_service.cc:1511] Processing CreateTablet for tablet 1df9edf20307470ba72f256250994a02 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:24.276268  3644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df9edf20307470ba72f256250994a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.276862  3491 tablet_service.cc:1511] Processing CreateTablet for tablet bbb4507428bc43acae7c5d3024486ff6 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:24.275429  3492 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2ee121cd1a4799bac90ced8983060a (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:24.280364  3495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df9edf20307470ba72f256250994a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.282303  3643 tablet_service.cc:1511] Processing CreateTablet for tablet b9cfb1606e6f4e1f855c7447d37795f7 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:24.305639  3645 tablet_service.cc:1511] Processing CreateTablet for tablet 709ed03df6c54248adf1c61cb1aff23d (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:24.288022  3568 tablet_service.cc:1511] Processing CreateTablet for tablet a7fecc51298045668569ed36c69fbc4f (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:24.290431  3569 tablet_service.cc:1511] Processing CreateTablet for tablet b9cfb1606e6f4e1f855c7447d37795f7 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:13:24.345853  3643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cfb1606e6f4e1f855c7447d37795f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.296402  3640 tablet_service.cc:1511] Processing CreateTablet for tablet 7817d7c24b9b4594a65351429f8dd214 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:24.294195  3563 tablet_service.cc:1511] Processing CreateTablet for tablet 50b04597f96d4062b53206268810e90b (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:24.286904  3493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fecc51298045668569ed36c69fbc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.294291  3641 tablet_service.cc:1511] Processing CreateTablet for tablet bbb4507428bc43acae7c5d3024486ff6 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:24.348778  3640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7817d7c24b9b4594a65351429f8dd214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.291765  3490 tablet_service.cc:1511] Processing CreateTablet for tablet 709ed03df6c54248adf1c61cb1aff23d (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:24.289175  3570 tablet_service.cc:1511] Processing CreateTablet for tablet 1df9edf20307470ba72f256250994a02 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:13:24.282932  3696 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.349757  3641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb4507428bc43acae7c5d3024486ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.317233  3646 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2ee121cd1a4799bac90ced8983060a (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:24.284333  3642 tablet_service.cc:1511] Processing CreateTablet for tablet a7fecc51298045668569ed36c69fbc4f (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:13:24.286402  3572 tablet_service.cc:1511] Processing CreateTablet for tablet 0508b02b59b54a43ad7bb79594be2553 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:13:24.292965  3564 tablet_service.cc:1511] Processing CreateTablet for tablet 7817d7c24b9b4594a65351429f8dd214 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:24.296751  3489 tablet_service.cc:1511] Processing CreateTablet for tablet 7817d7c24b9b4594a65351429f8dd214 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:13:24.300387  3488 tablet_service.cc:1511] Processing CreateTablet for tablet 50b04597f96d4062b53206268810e90b (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:24.353572  3642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fecc51298045668569ed36c69fbc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.297134  3566 tablet_service.cc:1511] Processing CreateTablet for tablet bbb4507428bc43acae7c5d3024486ff6 (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:13:24.351235  3492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2ee121cd1a4799bac90ced8983060a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.355160  3646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2ee121cd1a4799bac90ced8983060a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.292949  3567 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2ee121cd1a4799bac90ced8983060a (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:13:24.358660  3645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709ed03df6c54248adf1c61cb1aff23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.358816  3489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7817d7c24b9b4594a65351429f8dd214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.361526  3494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cfb1606e6f4e1f855c7447d37795f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.297639  3639 tablet_service.cc:1511] Processing CreateTablet for tablet 50b04597f96d4062b53206268810e90b (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:13:24.362795  3639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b04597f96d4062b53206268810e90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.287943  3571 tablet_service.cc:1511] Processing CreateTablet for tablet ad9c8cffe39240f194a1496c6b44c74d (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:13:24.294986  3565 tablet_service.cc:1511] Processing CreateTablet for tablet 709ed03df6c54248adf1c61cb1aff23d (DEFAULT_TABLE table=test-workload [id=0008553457524076b434f012b194a446]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:13:24.364794  3491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb4507428bc43acae7c5d3024486ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.366281  3488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b04597f96d4062b53206268810e90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.368429  3490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709ed03df6c54248adf1c61cb1aff23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.348209  3568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fecc51298045668569ed36c69fbc4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.371692  3570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df9edf20307470ba72f256250994a02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.372013  3696 tablet_bootstrap.cc:654] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.372365  3565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709ed03df6c54248adf1c61cb1aff23d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.374138  3564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7817d7c24b9b4594a65351429f8dd214. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.378271  3567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2ee121cd1a4799bac90ced8983060a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.378968  3566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbb4507428bc43acae7c5d3024486ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.379637  3571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9c8cffe39240f194a1496c6b44c74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.385444  3572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0508b02b59b54a43ad7bb79594be2553. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.386523  3569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9cfb1606e6f4e1f855c7447d37795f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.387141  3563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50b04597f96d4062b53206268810e90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:24.411108  3698 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.422399  3698 tablet_bootstrap.cc:654] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.475272  3698 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.475805  3698 ts_tablet_manager.cc:1403] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.030s
I20260709 13:13:24.484108  3698 raft_consensus.cc:359] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.484863  3698 raft_consensus.cc:385] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.485163  3698 raft_consensus.cc:740] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.486192  3698 consensus_queue.cc:260] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.500248  3696 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.500854  3696 ts_tablet_manager.cc:1403] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.218s	user 0.021s	sys 0.008s
I20260709 13:13:24.506238  3700 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:24.507838  3696 raft_consensus.cc:359] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:24.508653  3696 raft_consensus.cc:385] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.508966  3696 raft_consensus.cc:740] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.509694  3696 consensus_queue.cc:260] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:24.514492  3700 tablet_bootstrap.cc:654] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.519392  3698 ts_tablet_manager.cc:1434] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.043s	user 0.012s	sys 0.011s
I20260709 13:13:24.520159  3532 heartbeater.cc:499] Master 127.27.229.126:38899 was elected leader, sending a full tablet report...
I20260709 13:13:24.520337  3698 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.526818  3698 tablet_bootstrap.cc:654] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.539479  3681 heartbeater.cc:499] Master 127.27.229.126:38899 was elected leader, sending a full tablet report...
I20260709 13:13:24.541041  3698 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.542187  3698 ts_tablet_manager.cc:1403] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.002s
I20260709 13:13:24.542904  3700 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:24.543526  3700 ts_tablet_manager.cc:1403] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.010s
I20260709 13:13:24.545332  3696 ts_tablet_manager.cc:1434] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.044s	user 0.014s	sys 0.011s
I20260709 13:13:24.545142  3698 raft_consensus.cc:359] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.546000  3698 raft_consensus.cc:385] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.546316  3698 raft_consensus.cc:740] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.546490  3696 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.546833  3700 raft_consensus.cc:359] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.547099  3698 consensus_queue.cc:260] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.547654  3700 raft_consensus.cc:385] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.548098  3700 raft_consensus.cc:740] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.549043  3700 consensus_queue.cc:260] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.549631  3698 ts_tablet_manager.cc:1434] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:13:24.550747  3698 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.553848  3696 tablet_bootstrap.cc:654] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.557418  3698 tablet_bootstrap.cc:654] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.558682  3700 ts_tablet_manager.cc:1434] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 13:13:24.559567  3607 heartbeater.cc:499] Master 127.27.229.126:38899 was elected leader, sending a full tablet report...
I20260709 13:13:24.573707  3700 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:24.576797  3696 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.577426  3696 ts_tablet_manager.cc:1403] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.016s
I20260709 13:13:24.580405  3696 raft_consensus.cc:359] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.580969  3696 raft_consensus.cc:385] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.581208  3696 raft_consensus.cc:740] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.581861  3696 consensus_queue.cc:260] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.585377  3698 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.585953  3700 tablet_bootstrap.cc:654] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.585969  3698 ts_tablet_manager.cc:1403] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.035s	user 0.026s	sys 0.006s
I20260709 13:13:24.588093  3696 ts_tablet_manager.cc:1434] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:13:24.589228  3696 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.590776  3698 raft_consensus.cc:359] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.591702  3698 raft_consensus.cc:385] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.592008  3698 raft_consensus.cc:740] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.592921  3698 consensus_queue.cc:260] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.595986  3696 tablet_bootstrap.cc:654] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.597395  3700 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:24.597980  3700 ts_tablet_manager.cc:1403] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 13:13:24.600641  3698 ts_tablet_manager.cc:1434] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:13:24.601073  3700 raft_consensus.cc:359] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.601780  3698 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.601828  3700 raft_consensus.cc:385] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.602337  3700 raft_consensus.cc:740] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.603195  3700 consensus_queue.cc:260] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.608583  3702 raft_consensus.cc:493] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.608984  3700 ts_tablet_manager.cc:1434] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:24.609123  3702 raft_consensus.cc:515] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.610118  3700 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:24.615700  3700 tablet_bootstrap.cc:654] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.618378  3698 tablet_bootstrap.cc:654] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.624382  3702 leader_election.cc:290] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:24.626390  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
W20260709 13:13:24.628211  3620 leader_election.cc:343] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:24.634291  3696 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.634887  3696 ts_tablet_manager.cc:1403] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.007s
I20260709 13:13:24.640445  3696 raft_consensus.cc:359] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.641014  3696 raft_consensus.cc:385] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.641311  3696 raft_consensus.cc:740] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.642290  3696 consensus_queue.cc:260] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.644186  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:24.644979  3507 raft_consensus.cc:2468] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 0.
I20260709 13:13:24.645591  3696 ts_tablet_manager.cc:1434] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:13:24.646507  3698 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.646358  3619 leader_election.cc:304] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:24.646754  3696 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.647073  3698 ts_tablet_manager.cc:1403] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.018s
I20260709 13:13:24.647670  3702 raft_consensus.cc:2804] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:24.648077  3702 raft_consensus.cc:493] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.648392  3702 raft_consensus.cc:3060] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.650971  3700 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:24.651569  3700 ts_tablet_manager.cc:1403] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.010s
I20260709 13:13:24.653646  3696 tablet_bootstrap.cc:654] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.654713  3698 raft_consensus.cc:359] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.655540  3698 raft_consensus.cc:385] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.655833  3698 raft_consensus.cc:740] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.656250  3702 raft_consensus.cc:515] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.657881  3700 raft_consensus.cc:359] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.658967  3700 raft_consensus.cc:385] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.659272  3700 raft_consensus.cc:740] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.659343  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:24.659989  3507 raft_consensus.cc:3060] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.660385  3701 raft_consensus.cc:493] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.660952  3701 raft_consensus.cc:515] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.663223  3702 leader_election.cc:290] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:24.663826  3701 leader_election.cc:290] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.664400  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:24.656591  3698 consensus_queue.cc:260] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
W20260709 13:13:24.666558  3620 leader_election.cc:343] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:24.666749  3698 ts_tablet_manager.cc:1434] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:13:24.666867  3696 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.667590  3696 ts_tablet_manager.cc:1403] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.008s
I20260709 13:13:24.667819  3698 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.670590  3696 raft_consensus.cc:359] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.671430  3696 raft_consensus.cc:385] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.671779  3696 raft_consensus.cc:740] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.672857  3696 consensus_queue.cc:260] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.674886  3698 tablet_bootstrap.cc:654] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.678107  3696 ts_tablet_manager.cc:1434] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:24.678849  3507 raft_consensus.cc:2468] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 1.
I20260709 13:13:24.679345  3696 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.687089  3696 tablet_bootstrap.cc:654] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.664662  3700 consensus_queue.cc:260] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.704978  3700 ts_tablet_manager.cc:1434] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 13:13:24.713403  3700 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:24.724244  3700 tablet_bootstrap.cc:654] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.730507  3696 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.731038  3696 ts_tablet_manager.cc:1403] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.052s	user 0.032s	sys 0.018s
I20260709 13:13:24.731407  3698 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.732200  3698 ts_tablet_manager.cc:1403] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.065s	user 0.024s	sys 0.037s
I20260709 13:13:24.733639  3619 leader_election.cc:304] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:24.733982  3696 raft_consensus.cc:359] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.734797  3696 raft_consensus.cc:385] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.735132  3696 raft_consensus.cc:740] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.734903  3702 raft_consensus.cc:2804] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:24.735924  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:24.736634  3582 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 0.
I20260709 13:13:24.736125  3696 consensus_queue.cc:260] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.738037  3471 leader_election.cc:304] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:24.738464  3700 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:24.738862  3701 raft_consensus.cc:2804] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:24.739012  3700 ts_tablet_manager.cc:1403] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 13:13:24.739300  3701 raft_consensus.cc:493] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.739670  3701 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.747661  3701 raft_consensus.cc:515] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.748134  3700 raft_consensus.cc:359] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.748894  3700 raft_consensus.cc:385] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.749799  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:24.750681  3656 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 0.
I20260709 13:13:24.750679  3702 raft_consensus.cc:697] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:24.735178  3698 raft_consensus.cc:359] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.752792  3698 raft_consensus.cc:385] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.753129  3698 raft_consensus.cc:740] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.753311  3702 consensus_queue.cc:237] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.753901  3698 consensus_queue.cc:260] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.754540  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:24.755137  3582 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.749197  3700 raft_consensus.cc:740] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.756589  3700 consensus_queue.cc:260] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.757680  3721 raft_consensus.cc:493] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.759438  3721 raft_consensus.cc:515] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.762658  3721 leader_election.cc:290] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.763269  3582 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 1.
I20260709 13:13:24.765470  3696 ts_tablet_manager.cc:1434] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.021s
I20260709 13:13:24.765436  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:24.766144  3656 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.767195  3581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:24.753386  3701 leader_election.cc:290] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 election: Requested vote from peers 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.769192  3698 ts_tablet_manager.cc:1434] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.003s
W20260709 13:13:24.770166  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:24.771193  3655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:24.772032  3655 raft_consensus.cc:2468] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 0.
I20260709 13:13:24.770295  3471 leader_election.cc:304] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:24.774070  3701 raft_consensus.cc:2804] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:24.774613  3701 raft_consensus.cc:697] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 LEADER]: Becoming Leader. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Running, Role: LEADER
I20260709 13:13:24.775707  3698 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.778888  3656 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 1.
I20260709 13:13:24.778666  3404 catalog_manager.cc:5697] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:24.779875  3700 ts_tablet_manager.cc:1434] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:13:24.780659  3696 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.782827  3698 tablet_bootstrap.cc:654] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:24.782866  3471 leader_election.cc:343] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:24.783921  3471 leader_election.cc:304] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:24.784826  3700 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:24.784804  3701 consensus_queue.cc:237] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.789505  3721 raft_consensus.cc:2804] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:24.791208  3721 raft_consensus.cc:493] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.791460  3696 tablet_bootstrap.cc:654] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.791574  3721 raft_consensus.cc:3060] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.792928  3700 tablet_bootstrap.cc:654] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.794279  3702 raft_consensus.cc:493] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.794835  3702 raft_consensus.cc:515] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:24.797163  3702 leader_election.cc:290] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977), cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527)
I20260709 13:13:24.797981  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:24.798620  3698 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.799151  3698 ts_tablet_manager.cc:1403] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.002s
W20260709 13:13:24.799392  3620 leader_election.cc:343] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:24.801862  3698 raft_consensus.cc:359] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.802485  3698 raft_consensus.cc:385] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.802665  3698 raft_consensus.cc:740] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.802829  3700 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:24.803393  3700 ts_tablet_manager.cc:1403] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:13:24.803437  3698 consensus_queue.cc:260] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.805706  3696 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.803879  3721 raft_consensus.cc:515] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.806324  3696 ts_tablet_manager.cc:1403] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 13:13:24.806418  3698 ts_tablet_manager.cc:1434] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:24.806636  3700 raft_consensus.cc:359] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.807448  3700 raft_consensus.cc:385] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.807752  3700 raft_consensus.cc:740] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.807839  3698 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.808169  3721 leader_election.cc:290] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 election: Requested vote from peers 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.808687  3700 consensus_queue.cc:260] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.809944  3696 raft_consensus.cc:359] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.810801  3696 raft_consensus.cc:385] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.811147  3696 raft_consensus.cc:740] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.811545  3700 ts_tablet_manager.cc:1434] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:13:24.812615  3700 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:24.812227  3696 consensus_queue.cc:260] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.814150  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:24.814851  3696 ts_tablet_manager.cc:1434] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:24.816049  3696 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.814985  3698 tablet_bootstrap.cc:654] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.816489  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:24.819128  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:24.819744  3656 raft_consensus.cc:3060] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.822885  3696 tablet_bootstrap.cc:654] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.827207  3656 raft_consensus.cc:2468] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 1.
W20260709 13:13:24.828678  3619 leader_election.cc:343] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:24.829159  3619 leader_election.cc:304] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3; no voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f
I20260709 13:13:24.830432  3702 raft_consensus.cc:2749] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:24.831463  3705 raft_consensus.cc:493] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.831894  3471 leader_election.cc:304] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:24.831984  3705 raft_consensus.cc:515] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
W20260709 13:13:24.832916  3471 leader_election.cc:343] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:24.832171  3698 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.834029  3721 raft_consensus.cc:2804] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:24.833775  3698 ts_tablet_manager.cc:1403] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.002s
I20260709 13:13:24.834810  3721 raft_consensus.cc:697] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 LEADER]: Becoming Leader. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Running, Role: LEADER
I20260709 13:13:24.835759  3721 consensus_queue.cc:237] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.837832  3705 leader_election.cc:290] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.837625  3698 raft_consensus.cc:359] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.838521  3698 raft_consensus.cc:385] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.838835  3698 raft_consensus.cc:740] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.839233  3696 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.839848  3696 ts_tablet_manager.cc:1403] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 13:13:24.839527  3698 consensus_queue.cc:260] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.843216  3696 raft_consensus.cc:359] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.845974  3696 raft_consensus.cc:385] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.846377  3696 raft_consensus.cc:740] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.847899  3696 consensus_queue.cc:260] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.850113  3700 tablet_bootstrap.cc:654] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.855039  3698 ts_tablet_manager.cc:1434] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:13:24.856217  3698 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.857671  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:24.858525  3507 raft_consensus.cc:2468] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:24.859176  3696 ts_tablet_manager.cc:1434] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.008s
I20260709 13:13:24.860126  3545 leader_election.cc:304] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:24.861378  3705 raft_consensus.cc:2804] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:24.861737  3705 raft_consensus.cc:493] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.862141  3705 raft_consensus.cc:3060] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.862779  3698 tablet_bootstrap.cc:654] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.861852  3696 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.868391  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:24.869138  3656 raft_consensus.cc:2468] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:24.869038  3402 catalog_manager.cc:5697] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f reported cstate change: term changed from 0 to 1, leader changed from <none> to cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65). New cstate: current_term: 1 leader_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.873950  3696 tablet_bootstrap.cc:654] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.886334  3705 raft_consensus.cc:515] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.892843  3701 raft_consensus.cc:493] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.893121  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:24.893445  3701 raft_consensus.cc:515] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.893880  3507 raft_consensus.cc:3060] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.895707  3701 leader_election.cc:290] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.897228  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fecc51298045668569ed36c69fbc4f" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:24.899616  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fecc51298045668569ed36c69fbc4f" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
W20260709 13:13:24.901032  3471 leader_election.cc:343] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:24.902345  3471 leader_election.cc:343] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:24.899156  3402 catalog_manager.cc:5697] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f reported cstate change: term changed from 0 to 1, leader changed from <none> to cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65). New cstate: current_term: 1 leader_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.902820  3471 leader_election.cc:304] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3
I20260709 13:13:24.908070  3700 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:24.908933  3700 ts_tablet_manager.cc:1403] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.097s	user 0.009s	sys 0.004s
I20260709 13:13:24.910159  3701 raft_consensus.cc:2749] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:24.912017  3507 raft_consensus.cc:2468] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:24.912143  3700 raft_consensus.cc:359] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.913422  3545 leader_election.cc:304] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:24.913844  3700 raft_consensus.cc:385] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.916556  3698 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.916742  3700 raft_consensus.cc:740] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.917140  3698 ts_tablet_manager.cc:1403] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.011s
I20260709 13:13:24.917819  3700 consensus_queue.cc:260] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.919178  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:24.921360  3656 raft_consensus.cc:3060] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.921191  3698 raft_consensus.cc:359] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:24.921875  3698 raft_consensus.cc:385] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.922173  3698 raft_consensus.cc:740] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.917779  3705 leader_election.cc:290] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.923213  3698 consensus_queue.cc:260] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:24.923817  3705 raft_consensus.cc:2804] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:24.924582  3705 raft_consensus.cc:697] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:24.925551  3698 ts_tablet_manager.cc:1434] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:24.925395  3705 consensus_queue.cc:237] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.926142  3696 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.926600  3698 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.932658  3698 tablet_bootstrap.cc:654] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.926626  3696 ts_tablet_manager.cc:1403] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.031s
I20260709 13:13:24.940943  3696 raft_consensus.cc:359] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.941658  3696 raft_consensus.cc:385] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.941946  3696 raft_consensus.cc:740] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.942623  3696 consensus_queue.cc:260] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.943096  3739 raft_consensus.cc:493] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:24.943773  3739 raft_consensus.cc:515] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.944810  3656 raft_consensus.cc:2468] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:24.946853  3696 ts_tablet_manager.cc:1434] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:24.947988  3696 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.954563  3696 tablet_bootstrap.cc:654] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.954725  3698 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:24.955399  3698 ts_tablet_manager.cc:1403] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.005s
I20260709 13:13:24.958549  3698 raft_consensus.cc:359] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.959544  3698 raft_consensus.cc:385] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.959908  3698 raft_consensus.cc:740] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.961429  3698 consensus_queue.cc:260] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.961908  3700 ts_tablet_manager.cc:1434] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.053s	user 0.028s	sys 0.012s
I20260709 13:13:24.963193  3700 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:24.964241  3698 ts_tablet_manager.cc:1434] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:24.965471  3698 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:24.968850  3739 leader_election.cc:290] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:24.970075  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:24.970830  3507 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:24.971649  3696 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.972198  3696 ts_tablet_manager.cc:1403] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:13:24.972486  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:24.973232  3656 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:24.975092  3696 raft_consensus.cc:359] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.975157  3545 leader_election.cc:304] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:24.975865  3696 raft_consensus.cc:385] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.976231  3696 raft_consensus.cc:740] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.976938  3696 consensus_queue.cc:260] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.979061  3698 tablet_bootstrap.cc:654] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.979925  3700 tablet_bootstrap.cc:654] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.981122  3705 raft_consensus.cc:2804] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:24.981621  3705 raft_consensus.cc:493] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:24.982111  3705 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.979161  3696 ts_tablet_manager.cc:1434] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:24.984458  3696 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3: Bootstrap starting.
I20260709 13:13:24.989984  3696 tablet_bootstrap.cc:654] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:24.990489  3402 catalog_manager.cc:5697] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:24.991423  3705 raft_consensus.cc:515] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.994944  3700 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:24.995514  3700 ts_tablet_manager.cc:1403] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.033s	user 0.003s	sys 0.008s
I20260709 13:13:24.995755  3696 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3: No bootstrap required, opened a new log
I20260709 13:13:24.995726  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:24.996392  3696 ts_tablet_manager.cc:1403] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 13:13:24.996526  3507 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:24.998497  3700 raft_consensus.cc:359] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:24.999289  3700 raft_consensus.cc:385] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:24.999097  3696 raft_consensus.cc:359] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:24.999614  3700 raft_consensus.cc:740] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:24.999842  3696 raft_consensus.cc:385] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.000134  3696 raft_consensus.cc:740] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.000530  3700 consensus_queue.cc:260] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:25.000881  3696 consensus_queue.cc:260] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.003172  3700 ts_tablet_manager.cc:1434] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:13:25.003268  3698 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: No bootstrap required, opened a new log
I20260709 13:13:25.003901  3698 ts_tablet_manager.cc:1403] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.012s
I20260709 13:13:25.004261  3700 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:25.004230  3507 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:25.005635  3545 leader_election.cc:304] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.006455  3739 raft_consensus.cc:2804] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.006953  3739 raft_consensus.cc:697] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:25.008141  3705 leader_election.cc:290] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:25.008029  3739 consensus_queue.cc:237] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.006878  3698 raft_consensus.cc:359] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.009234  3698 raft_consensus.cc:385] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.009547  3698 raft_consensus.cc:740] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.009367  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:25.010205  3656 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.010675  3696 ts_tablet_manager.cc:1434] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:13:25.010376  3698 consensus_queue.cc:260] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.012534  3698 ts_tablet_manager.cc:1434] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:13:25.012432  3702 raft_consensus.cc:493] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.013136  3702 raft_consensus.cc:515] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.015348  3702 leader_election.cc:290] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:25.016914  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
W20260709 13:13:25.019119  3620 leader_election.cc:343] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:25.019615  3656 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:25.020231  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:25.024165  3700 tablet_bootstrap.cc:654] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.025467  3507 raft_consensus.cc:2468] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 0.
I20260709 13:13:25.026717  3619 leader_election.cc:304] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:25.027555  3702 raft_consensus.cc:2804] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.027953  3702 raft_consensus.cc:493] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.028349  3702 raft_consensus.cc:3060] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.031905  3402 catalog_manager.cc:5697] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.033859  3700 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:25.034458  3700 ts_tablet_manager.cc:1403] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 13:13:25.034312  3702 raft_consensus.cc:515] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.036904  3702 leader_election.cc:290] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:25.037405  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:25.037212  3700 raft_consensus.cc:359] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.037705  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:25.038086  3700 raft_consensus.cc:385] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.038374  3507 raft_consensus.cc:3060] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.038403  3700 raft_consensus.cc:740] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.039316  3700 consensus_queue.cc:260] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.040120  3582 raft_consensus.cc:3060] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.045818  3507 raft_consensus.cc:2468] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 1.
I20260709 13:13:25.046088  3582 raft_consensus.cc:2468] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 1.
I20260709 13:13:25.046669  3739 raft_consensus.cc:493] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.047168  3739 raft_consensus.cc:515] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.047220  3619 leader_election.cc:304] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.048184  3702 raft_consensus.cc:2804] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.048722  3702 raft_consensus.cc:697] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:25.049321  3739 leader_election.cc:290] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:25.049636  3702 consensus_queue.cc:237] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.050887  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:25.051216  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:25.051927  3656 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:25.052968  3700 ts_tablet_manager.cc:1434] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:13:25.053421  3546 leader_election.cc:304] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: 
I20260709 13:13:25.054023  3507 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:25.054257  3739 raft_consensus.cc:2804] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.055534  3739 raft_consensus.cc:493] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.055925  3739 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.054071  3700 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:25.062163  3739 raft_consensus.cc:515] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.064325  3739 leader_election.cc:290] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:25.065568  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:25.066036  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:25.066321  3507 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.066624  3656 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.067224  3702 raft_consensus.cc:493] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.067806  3702 raft_consensus.cc:515] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.071051  3702 leader_election.cc:290] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:25.071195  3506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709ed03df6c54248adf1c61cb1aff23d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:25.071791  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709ed03df6c54248adf1c61cb1aff23d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:25.072007  3506 raft_consensus.cc:2468] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 0.
I20260709 13:13:25.072496  3582 raft_consensus.cc:2468] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 0.
I20260709 13:13:25.073601  3619 leader_election.cc:304] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.065637  3700 tablet_bootstrap.cc:654] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.075034  3702 raft_consensus.cc:2804] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.075485  3702 raft_consensus.cc:493] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.075898  3702 raft_consensus.cc:3060] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.073649  3507 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:25.076725  3656 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:25.077906  3545 leader_election.cc:304] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.079276  3739 raft_consensus.cc:2804] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.079766  3739 raft_consensus.cc:697] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:25.080147  3700 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:25.080677  3700 ts_tablet_manager.cc:1403] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:13:25.080580  3739 consensus_queue.cc:237] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.080824  3404 catalog_manager.cc:5697] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.083478  3701 raft_consensus.cc:493] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.083662  3700 raft_consensus.cc:359] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.084080  3701 raft_consensus.cc:515] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:25.084451  3700 raft_consensus.cc:385] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.084328  3702 raft_consensus.cc:515] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.085059  3700 raft_consensus.cc:740] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.085991  3700 consensus_queue.cc:260] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.086658  3701 leader_election.cc:290] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:25.087703  3702 leader_election.cc:290] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:25.088109  3700 ts_tablet_manager.cc:1434] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:25.089123  3700 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67: Bootstrap starting.
I20260709 13:13:25.088956  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:25.089386  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709ed03df6c54248adf1c61cb1aff23d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:25.089670  3656 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 0.
I20260709 13:13:25.090190  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:25.090813  3582 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 0.
I20260709 13:13:25.091045  3581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709ed03df6c54248adf1c61cb1aff23d" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:25.091624  3581 raft_consensus.cc:3060] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.091676  3507 raft_consensus.cc:3060] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.094290  3471 leader_election.cc:304] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.095230  3700 tablet_bootstrap.cc:654] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:25.096901  3701 raft_consensus.cc:2804] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.097340  3701 raft_consensus.cc:493] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.097700  3701 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.100898  3581 raft_consensus.cc:2468] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 1.
I20260709 13:13:25.102299  3620 leader_election.cc:304] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: 
I20260709 13:13:25.102803  3507 raft_consensus.cc:2468] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 1.
I20260709 13:13:25.103307  3702 raft_consensus.cc:2804] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.104071  3702 raft_consensus.cc:697] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:25.104956  3702 consensus_queue.cc:237] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.106958  3701 raft_consensus.cc:515] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:25.107838  3700 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67: No bootstrap required, opened a new log
I20260709 13:13:25.108356  3700 ts_tablet_manager.cc:1403] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:13:25.109164  3701 leader_election.cc:290] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 election: Requested vote from peers 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:25.111055  3700 raft_consensus.cc:359] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.111805  3700 raft_consensus.cc:385] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:25.112083  3700 raft_consensus.cc:740] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Initialized, Role: FOLLOWER
I20260709 13:13:25.112393  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:25.112434  3581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:25.113047  3656 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.112794  3700 consensus_queue.cc:260] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.113421  3581 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.114988  3700 ts_tablet_manager.cc:1434] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:13:25.119333  3656 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 1.
I20260709 13:13:25.119014  3404 catalog_manager.cc:5697] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.120908  3471 leader_election.cc:304] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.120265  3402 catalog_manager.cc:5697] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 1 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.123195  3581 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in term 1.
I20260709 13:13:25.123775  3701 raft_consensus.cc:2804] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.124480  3701 raft_consensus.cc:697] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 LEADER]: Becoming Leader. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Running, Role: LEADER
I20260709 13:13:25.125257  3701 consensus_queue.cc:237] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:25.139648  3404 catalog_manager.cc:5697] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f reported cstate change: term changed from 0 to 1, leader changed from <none> to cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65). New cstate: current_term: 1 leader_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:25.180624  3701 consensus_queue.cc:1048] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.192576  3722 consensus_queue.cc:1048] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:25.205315  3739 raft_consensus.cc:493] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.205840  3739 raft_consensus.cc:515] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.207525  3739 leader_election.cc:290] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:25.208253  3507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:25.208671  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:25.209465  3656 raft_consensus.cc:2393] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ba6bf810a864db593372c571bba1a67 in current term 1: Already voted for candidate cd94a5cc3aa0446f8736ce8ff59ac65f in this term.
I20260709 13:13:25.210391  3739 raft_consensus.cc:493] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.210624  3546 leader_election.cc:304] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67; no voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f
I20260709 13:13:25.210958  3739 raft_consensus.cc:515] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.211455  3705 raft_consensus.cc:3060] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.213207  3739 leader_election.cc:290] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:25.214886  3506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:25.214886  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:25.215277  3702 consensus_queue.cc:1048] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:25.215914  3506 raft_consensus.cc:2393] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ba6bf810a864db593372c571bba1a67 in current term 1: Already voted for candidate 5d12ee7ead55455d843508760c81bcc3 in this term.
I20260709 13:13:25.217586  3546 leader_election.cc:304] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67; no voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f
I20260709 13:13:25.218740  3739 raft_consensus.cc:3060] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.218648  3705 raft_consensus.cc:2749] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.227850  3739 raft_consensus.cc:2749] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:25.231878  3739 raft_consensus.cc:493] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:25.232390  3739 raft_consensus.cc:515] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.232543  3720 consensus_queue.cc:1048] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:25.235126  3506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fecc51298045668569ed36c69fbc4f" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" is_pre_election: true
I20260709 13:13:25.235767  3506 raft_consensus.cc:2468] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:25.236747  3545 leader_election.cc:304] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.237731  3705 raft_consensus.cc:2804] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:25.238044  3739 leader_election.cc:290] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:25.238466  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fecc51298045668569ed36c69fbc4f" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:25.239028  3705 raft_consensus.cc:493] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:25.239962  3705 raft_consensus.cc:3060] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.239229  3656 raft_consensus.cc:2468] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 0.
I20260709 13:13:25.245649  3705 raft_consensus.cc:515] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.248468  3506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fecc51298045668569ed36c69fbc4f" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:25.248708  3705 leader_election.cc:290] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:25.249218  3506 raft_consensus.cc:3060] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.249825  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7fecc51298045668569ed36c69fbc4f" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:25.250516  3656 raft_consensus.cc:3060] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:25.255095  3506 raft_consensus.cc:2468] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:25.256228  3545 leader_election.cc:304] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:25.256548  3656 raft_consensus.cc:2468] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:25.257140  3705 raft_consensus.cc:2804] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:25.257592  3705 raft_consensus.cc:697] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:25.258451  3705 consensus_queue.cc:237] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:25.265991  3404 catalog_manager.cc:5697] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:25.312691  3722 consensus_queue.cc:1048] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.322808  3721 consensus_queue.cc:1048] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.405731  3705 consensus_queue.cc:1048] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.416682  3740 consensus_queue.cc:1048] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:25.429829  3740 consensus_queue.cc:1048] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.441234  3740 consensus_queue.cc:1048] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.468111 28565 ts_manager.cc:295] Set tserver state for cd94a5cc3aa0446f8736ce8ff59ac65f to MAINTENANCE_MODE
I20260709 13:13:25.468916 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
I20260709 13:13:25.487247 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:25.488052 28565 tablet_replica.cc:333] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.488752 28565 raft_consensus.cc:2243] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.489349 28565 pending_rounds.cc:70] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Trying to abort 1 pending ops.
I20260709 13:13:25.489526 28565 pending_rounds.cc:77] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305637089801682944 op_type: NO_OP noop_request { }
I20260709 13:13:25.489775 28565 raft_consensus.cc:2889] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:25.490070 28565 raft_consensus.cc:2272] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.492390 28565 tablet_replica.cc:333] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.492959 28565 raft_consensus.cc:2243] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.493310 28565 raft_consensus.cc:2272] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.495107 28565 tablet_replica.cc:333] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.495649 28565 raft_consensus.cc:2243] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.496011 28565 raft_consensus.cc:2272] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.497627 28565 tablet_replica.cc:333] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.498217 28565 raft_consensus.cc:2243] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.498618 28565 raft_consensus.cc:2272] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.500666 28565 tablet_replica.cc:333] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.501214 28565 raft_consensus.cc:2243] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.501611 28565 raft_consensus.cc:2272] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.503842 28565 tablet_replica.cc:333] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.504410 28565 raft_consensus.cc:2243] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.504776 28565 raft_consensus.cc:2272] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.506695 28565 tablet_replica.cc:333] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.507223 28565 raft_consensus.cc:2243] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.508010 28565 raft_consensus.cc:2272] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.510092 28565 tablet_replica.cc:333] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.510587 28565 raft_consensus.cc:2243] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:25.511340 28565 raft_consensus.cc:2272] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.513710 28565 tablet_replica.cc:333] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.514249 28565 raft_consensus.cc:2243] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.514606 28565 raft_consensus.cc:2272] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:25.516242 28565 tablet_replica.cc:333] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: stopping tablet replica
I20260709 13:13:25.516676 28565 raft_consensus.cc:2243] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:25.517071 28565 raft_consensus.cc:2272] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:25.529183  3619 consensus_peers.cc:597] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.548478 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
W20260709 13:13:25.550661  3619 consensus_peers.cc:597] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.625820  3545 consensus_peers.cc:597] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:25.628130  3720 consensus_queue.cc:1048] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.643467  3720 consensus_queue.cc:1048] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.689008  3740 consensus_queue.cc:1048] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:25.720860  3705 consensus_queue.cc:1048] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:25.723603  3545 consensus_peers.cc:597] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.771188  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:25.780735  3619 consensus_peers.cc:597] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.951608  3545 consensus_peers.cc:597] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:25.979151  3545 consensus_peers.cc:597] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:26.690557  3779 raft_consensus.cc:493] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd94a5cc3aa0446f8736ce8ff59ac65f)
I20260709 13:13:26.691125  3779 raft_consensus.cc:515] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:26.694387  3779 leader_election.cc:290] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:26.696964  3779 raft_consensus.cc:493] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:26.697623  3779 raft_consensus.cc:515] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:26.700846  3779 leader_election.cc:290] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933), cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527)
I20260709 13:13:26.733235  3780 raft_consensus.cc:493] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd94a5cc3aa0446f8736ce8ff59ac65f)
I20260709 13:13:26.735255  3780 raft_consensus.cc:515] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:26.736953  3780 leader_election.cc:290] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:26.738343  3580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:26.752975  3580 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 1.
I20260709 13:13:26.754755  3620 leader_election.cc:304] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: 
I20260709 13:13:26.755839  3781 raft_consensus.cc:2804] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.756275  3781 raft_consensus.cc:493] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd94a5cc3aa0446f8736ce8ff59ac65f)
I20260709 13:13:26.756722  3781 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.764865  3781 raft_consensus.cc:515] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
W20260709 13:13:26.772305  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:26.791175  3580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:26.791850  3580 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.792614  3654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:26.793004  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3" is_pre_election: true
I20260709 13:13:26.793466  3654 raft_consensus.cc:2393] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ba6bf810a864db593372c571bba1a67 in current term 2: Already voted for candidate 5d12ee7ead55455d843508760c81bcc3 in this term.
I20260709 13:13:26.793673  3656 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 1.
I20260709 13:13:26.797765  3546 leader_election.cc:304] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: 
I20260709 13:13:26.798686  3779 raft_consensus.cc:2804] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.799064  3779 raft_consensus.cc:493] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:26.799386  3779 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.799839  3781 leader_election.cc:290] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
W20260709 13:13:26.800791  3619 leader_election.cc:336] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111)
W20260709 13:13:26.804176  3545 leader_election.cc:336] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111)
W20260709 13:13:26.804503  3619 leader_election.cc:336] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111)
I20260709 13:13:26.804572  3545 leader_election.cc:304] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67; no voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f
W20260709 13:13:26.805655  3545 leader_election.cc:336] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111)
I20260709 13:13:26.807184  3779 raft_consensus.cc:515] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:26.807479  3580 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:26.808178  3784 raft_consensus.cc:2749] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:26.808810  3620 leader_election.cc:304] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: cd94a5cc3aa0446f8736ce8ff59ac65f
I20260709 13:13:26.809449  3779 leader_election.cc:290] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 election: Requested vote from peers 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933), cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527)
I20260709 13:13:26.810098  3781 raft_consensus.cc:2804] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.810213  3654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:26.810657  3781 raft_consensus.cc:697] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:26.810958  3654 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.811452  3781 consensus_queue.cc:237] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
W20260709 13:13:26.815189  3545 leader_election.cc:336] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111)
I20260709 13:13:26.817443  3654 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 2.
I20260709 13:13:26.818686  3546 leader_election.cc:304] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: cd94a5cc3aa0446f8736ce8ff59ac65f
I20260709 13:13:26.819489  3784 raft_consensus.cc:2804] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.819883  3784 raft_consensus.cc:697] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:26.820744  3784 consensus_queue.cc:237] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:26.821723  3781 raft_consensus.cc:493] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd94a5cc3aa0446f8736ce8ff59ac65f)
I20260709 13:13:26.822314  3781 raft_consensus.cc:515] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:26.825011  3781 leader_election.cc:290] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:26.825656  3580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67" is_pre_election: true
I20260709 13:13:26.822515  3404 catalog_manager.cc:5697] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 1 to 2, leader changed from cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65) to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:26.826331  3580 raft_consensus.cc:2468] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 1.
I20260709 13:13:26.827939  3620 leader_election.cc:304] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: 
I20260709 13:13:26.828583  3781 raft_consensus.cc:2804] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:13:26.829020  3781 raft_consensus.cc:493] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd94a5cc3aa0446f8736ce8ff59ac65f)
I20260709 13:13:26.829435  3781 raft_consensus.cc:3060] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:26.829433  3402 catalog_manager.cc:5697] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 1 to 2, leader changed from cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65) to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:26.834142  3619 leader_election.cc:336] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111)
I20260709 13:13:26.836963  3781 raft_consensus.cc:515] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:26.840123  3781 leader_election.cc:290] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:26.841040  3580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9cfb1606e6f4e1f855c7447d37795f7" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:26.841684  3580 raft_consensus.cc:3060] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:13:26.843432  3619 leader_election.cc:336] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111)
I20260709 13:13:26.847151  3580 raft_consensus.cc:2468] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:26.848140  3620 leader_election.cc:304] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: cd94a5cc3aa0446f8736ce8ff59ac65f
I20260709 13:13:26.848753  3781 raft_consensus.cc:2804] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:26.849161  3781 raft_consensus.cc:697] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:26.849937  3781 consensus_queue.cc:237] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:26.856704  3402 catalog_manager.cc:5697] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 1 to 2, leader changed from cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65) to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:27.129803  3545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111) [suppressed 131 similar messages]
I20260709 13:13:27.216471  3654 raft_consensus.cc:1275] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:13:27.217773  3784 consensus_queue.cc:1048] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:13:27.232553  3545 consensus_peers.cc:597] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.235061  3580 raft_consensus.cc:1275] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.236433  3781 consensus_queue.cc:1048] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:27.249111  3619 consensus_peers.cc:597] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:27.297996  3619 consensus_peers.cc:597] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:27.422151  3580 raft_consensus.cc:1275] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:27.423466  3787 consensus_queue.cc:1048] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:27.785190  3677 debug-util.cc:398] Leaking SignalData structure 0x7b08000310e0 after lost signal to thread 28568
W20260709 13:13:27.786180  3677 debug-util.cc:398] Leaking SignalData structure 0x7b080024c980 after lost signal to thread 3439
W20260709 13:13:27.787189  3677 debug-util.cc:398] Leaking SignalData structure 0x7b08002eae40 after lost signal to thread 3606
W20260709 13:13:27.788064  3677 debug-util.cc:398] Leaking SignalData structure 0x7b0800151680 after lost signal to thread 3680
W20260709 13:13:27.789417  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:28.110662  3619 consensus_peers.cc:597] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.139005  3545 consensus_peers.cc:597] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.205966  3545 consensus_peers.cc:597] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.286473  3619 consensus_peers.cc:597] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.520761  3619 consensus_peers.cc:597] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.691669  3545 consensus_peers.cc:597] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.782259  3545 consensus_peers.cc:597] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:28.790604  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:29.559868  3545 consensus_peers.cc:597] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:29.567499  3619 consensus_peers.cc:597] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:29.720922  3619 consensus_peers.cc:597] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:13:29.791697  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:30.491317  3545 consensus_peers.cc:597] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:30.606396  3545 consensus_peers.cc:597] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:30.617844  3619 consensus_peers.cc:597] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:13:30.792713  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:13:30.968477  3619 consensus_peers.cc:597] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:31.022879 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:31.029325  3805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.031361  3806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:31.031677  3808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:31.032442 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:31.033869 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:31.034126 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:31.034299 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602811034281 us; error 0 us; skew 500 ppm
I20260709 13:13:31.034822 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:31.037063 28565 webserver.cc:533] Webserver started at http://127.27.229.65:45887/ using document root <none> and password file <none>
I20260709 13:13:31.037545 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:31.037696 28565 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:13:31.041253 28565 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:13:31.044971  3813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:31.045717 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:13:31.046051 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
format_stamp: "Formatted at 2026-07-09 13:13:23 on dist-test-slave-twc1"
I20260709 13:13:31.046342 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:31.064210 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:31.065327 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:31.066773 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:31.070215  3820 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:13:31.081818  3619 consensus_peers.cc:597] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:31.122454 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:13:31.122836 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:13:31.123157 28565 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:13:31.128036  3820 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.141202  3820 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.141964  3820 tablet_bootstrap.cc:492] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.142534  3820 ts_tablet_manager.cc:1403] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:13:31.144505  3820 raft_consensus.cc:359] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.145005  3820 raft_consensus.cc:740] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.145556  3820 consensus_queue.cc:260] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.147794  3820 ts_tablet_manager.cc:1434] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:13:31.148533  3820 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.160386  3820 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:13:31.161177  3820 tablet_bootstrap.cc:492] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.161715  3820 ts_tablet_manager.cc:1403] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:13:31.163635  3820 raft_consensus.cc:359] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:31.164301  3820 raft_consensus.cc:740] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.164911  3820 consensus_queue.cc:260] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:31.166682  3820 ts_tablet_manager.cc:1434] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:13:31.167273 28565 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:13:31.167441  3820 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.167572 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.044s	user 0.044s	sys 0.000s
I20260709 13:13:31.180241  3820 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.181123  3820 tablet_bootstrap.cc:492] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.181821  3820 ts_tablet_manager.cc:1403] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
W20260709 13:13:31.183372  3545 consensus_peers.cc:597] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:13:31.184406  3820 raft_consensus.cc:359] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.185088  3820 raft_consensus.cc:740] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.185719  3820 consensus_queue.cc:260] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.187402  3820 ts_tablet_manager.cc:1434] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:31.188092  3820 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.201069  3820 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.202139  3820 tablet_bootstrap.cc:492] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.202865  3820 ts_tablet_manager.cc:1403] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:13:31.204947  3820 raft_consensus.cc:359] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.205658  3820 raft_consensus.cc:740] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.206317  3820 consensus_queue.cc:260] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.208438  3820 ts_tablet_manager.cc:1434] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:13:31.209254  3820 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.223309  3820 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.224272  3820 tablet_bootstrap.cc:492] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.224978  3820 ts_tablet_manager.cc:1403] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:13:31.226598 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:46527
I20260709 13:13:31.226753  3882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:46527 every 8 connection(s)
I20260709 13:13:31.227480  3820 raft_consensus.cc:359] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.228029  3820 raft_consensus.cc:740] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.228668  3820 consensus_queue.cc:260] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.230592  3820 ts_tablet_manager.cc:1434] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
W20260709 13:13:31.230754  3884 tablet.cc:2406] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:31.231417 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.231534  3820 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.248745  3820 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.249799  3820 tablet_bootstrap.cc:492] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.250555  3820 ts_tablet_manager.cc:1403] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:13:31.252823  3820 raft_consensus.cc:359] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.253582  3820 raft_consensus.cc:740] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.254333  3820 consensus_queue.cc:260] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.255795  3820 ts_tablet_manager.cc:1434] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:31.256611  3820 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.265443  3820 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.266093  3820 tablet_bootstrap.cc:492] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.266588  3820 ts_tablet_manager.cc:1403] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:13:31.268575  3820 raft_consensus.cc:359] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.269091  3820 raft_consensus.cc:740] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.269626  3820 consensus_queue.cc:260] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.271080  3820 ts_tablet_manager.cc:1434] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:31.271636  3820 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.281065  3820 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.282008  3820 tablet_bootstrap.cc:492] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.282274  3883 heartbeater.cc:344] Connected to a master server at 127.27.229.126:38899
I20260709 13:13:31.282681  3883 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:31.282759  3820 ts_tablet_manager.cc:1403] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:13:31.282459  3656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1df9edf20307470ba72f256250994a02"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
mode: GRACEFUL
new_leader_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:13:31.283321  3656 raft_consensus.cc:606] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Received request to transfer leadership to TS 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:31.283584  3883 heartbeater.cc:507] Master 127.27.229.126:38899 requested a full tablet report, sending...
I20260709 13:13:31.285041  3820 raft_consensus.cc:359] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.285620  3820 raft_consensus.cc:740] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.287516  3820 consensus_queue.cc:260] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.289346  3404 ts_manager.cc:194] Re-registered known tserver with Master: cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527)
I20260709 13:13:31.289450  3820 ts_tablet_manager.cc:1434] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:31.290297  3820 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.297230  3582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
mode: GRACEFUL
new_leader_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:13:31.297982  3582 raft_consensus.cc:606] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Received request to transfer leadership to TS 5d12ee7ead55455d843508760c81bcc3
I20260709 13:13:31.299337  3404 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48988
I20260709 13:13:31.299382 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:31.300133 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:31.300844 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:31.302855  3883 heartbeater.cc:499] Master 127.27.229.126:38899 was elected leader, sending a full tablet report...
I20260709 13:13:31.303406  3820 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.304215  3820 tablet_bootstrap.cc:492] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.304752  3820 ts_tablet_manager.cc:1403] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:13:31.306589  3820 raft_consensus.cc:359] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.307083  3820 raft_consensus.cc:740] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.307665  3820 consensus_queue.cc:260] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.309635  3820 ts_tablet_manager.cc:1434] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:31.310426  3820 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap starting.
I20260709 13:13:31.314106  3784 raft_consensus.cc:993] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67: : Instructing follower 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:31.314628  3894 raft_consensus.cc:1081] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Signalling peer 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:31.316113  3656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:13:31.316629  3656 raft_consensus.cc:493] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.316915  3656 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.322810  3656 raft_consensus.cc:515] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.323413  3820 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:13:31.325397  3656 leader_election.cc:290] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:31.325640  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:31.326298  3582 raft_consensus.cc:3055] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:31.326589  3582 raft_consensus.cc:740] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:31.327280  3582 consensus_queue.cc:260] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.328142  3582 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.330227  3820 tablet_bootstrap.cc:492] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Bootstrap complete.
I20260709 13:13:31.331157  3820 ts_tablet_manager.cc:1403] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.004s
I20260709 13:13:31.334684  3582 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:31.334803  3820 raft_consensus.cc:359] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.335698  3820 raft_consensus.cc:740] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd94a5cc3aa0446f8736ce8ff59ac65f, State: Initialized, Role: FOLLOWER
I20260709 13:13:31.336412  3820 consensus_queue.cc:260] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.336584  3620 leader_election.cc:304] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, 5d12ee7ead55455d843508760c81bcc3; no voters: 
I20260709 13:13:31.337631  3787 raft_consensus.cc:2804] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:31.339728  3820 ts_tablet_manager.cc:1434] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:31.341450  3787 raft_consensus.cc:697] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:31.342788  3787 consensus_queue.cc:237] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.347898  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:31.348755  3857 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.352103  3404 catalog_manager.cc:5697] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 1 to 2, leader changed from 0ba6bf810a864db593372c571bba1a67 (127.27.229.66) to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:31.354842  3857 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:31.383952  3856 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.389112  3856 pending_rounds.cc:85] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Aborting all ops after (but not including) 0
I20260709 13:13:31.389328  3856 pending_rounds.cc:107] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:13:31.389497  3856 raft_consensus.cc:2889] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:13:31.417845  3856 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.612434  3856 raft_consensus.cc:3060] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:31.692517  3787 raft_consensus.cc:993] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3: : Instructing follower 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:31.693022  3897 raft_consensus.cc:1081] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Signalling peer 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:31.694752  3582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1df9edf20307470ba72f256250994a02"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:31.695238  3582 raft_consensus.cc:493] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:31.695552  3582 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.701233  3582 raft_consensus.cc:515] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.703347  3582 leader_election.cc:290] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 3 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:31.705957  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:31.707054  3856 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.707090  3654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:31.707729  3654 raft_consensus.cc:3055] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:31.708067  3654 raft_consensus.cc:740] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:31.708866  3654 consensus_queue.cc:260] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.710402  3654 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:31.714545  3856 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 3.
I20260709 13:13:31.715795  3545 leader_election.cc:304] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:31.716625  3784 raft_consensus.cc:2804] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:31.717257  3784 raft_consensus.cc:697] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:31.717533  3654 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 3.
I20260709 13:13:31.718142  3784 consensus_queue.cc:237] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:31.725610  3404 catalog_manager.cc:5697] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 2 to 3, leader changed from 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67) to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:31.787454  3582 raft_consensus.cc:1275] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.788760  3897 consensus_queue.cc:1048] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:31.793743  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:31.800077  3856 raft_consensus.cc:1275] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:31.801792  3912 consensus_queue.cc:1048] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:32.191047  3656 raft_consensus.cc:1275] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.192795  3913 consensus_queue.cc:1048] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:32.203776  3856 raft_consensus.cc:1275] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:32.205657  3894 consensus_queue.cc:1048] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:32.310379 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.319187  3656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
mode: GRACEFUL
new_leader_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:13:32.319783  3656 raft_consensus.cc:606] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Received request to transfer leadership to TS 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:32.322584  3582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
mode: GRACEFUL
new_leader_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:13:32.323063  3582 raft_consensus.cc:606] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Received request to transfer leadership to TS 5d12ee7ead55455d843508760c81bcc3
I20260709 13:13:32.324285 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:32.324785 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:32.325502 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:32.705498  3894 raft_consensus.cc:993] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67: : Instructing follower 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:32.705992  3913 raft_consensus.cc:1081] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Signalling peer 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:32.707489  3656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:13:32.707960  3656 raft_consensus.cc:493] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.708231  3656 raft_consensus.cc:3060] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.716292  3656 raft_consensus.cc:515] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:32.717872  3656 leader_election.cc:290] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:32.718737  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:32.719117  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbb4507428bc43acae7c5d3024486ff6" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:32.719583  3856 raft_consensus.cc:3060] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.719749  3582 raft_consensus.cc:3055] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:32.720151  3582 raft_consensus.cc:740] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:32.721189  3582 consensus_queue.cc:260] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:32.722770  3582 raft_consensus.cc:3060] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.728830  3856 raft_consensus.cc:2468] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:32.732180  3619 leader_election.cc:304] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:32.732151  3582 raft_consensus.cc:2468] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:32.733265  3921 raft_consensus.cc:2804] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:32.733971  3921 raft_consensus.cc:697] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:32.734939  3921 consensus_queue.cc:237] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:32.742604  3403 catalog_manager.cc:5697] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 1 to 2, leader changed from 0ba6bf810a864db593372c571bba1a67 (127.27.229.66) to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:32.794896  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:32.811518  3897 raft_consensus.cc:993] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3: : Instructing follower 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:32.812228  3912 raft_consensus.cc:1081] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Signalling peer 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:32.814235  3582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:32.814692  3582 raft_consensus.cc:493] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:32.814940  3582 raft_consensus.cc:3060] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.820708  3582 raft_consensus.cc:515] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:32.822453  3582 leader_election.cc:290] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:32.823356  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:32.823519  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9c8cffe39240f194a1496c6b44c74d" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:32.824065  3856 raft_consensus.cc:3060] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.824116  3656 raft_consensus.cc:3055] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:32.824505  3656 raft_consensus.cc:740] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:32.825204  3656 consensus_queue.cc:260] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:32.826256  3656 raft_consensus.cc:3060] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:32.829479  3856 raft_consensus.cc:2468] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 2.
I20260709 13:13:32.830896  3545 leader_election.cc:304] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:32.831697  3656 raft_consensus.cc:2468] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 2.
I20260709 13:13:32.831846  3927 raft_consensus.cc:2804] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:32.832474  3927 raft_consensus.cc:697] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:32.833352  3927 consensus_queue.cc:237] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:32.840296  3403 catalog_manager.cc:5697] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 1 to 2, leader changed from 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67) to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.158883  3582 raft_consensus.cc:1275] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.160121  3912 consensus_queue.cc:1048] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.170183  3856 raft_consensus.cc:1275] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.172036  3897 consensus_queue.cc:1048] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.329669  3857 raft_consensus.cc:1275] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.330960  3894 consensus_queue.cc:1048] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.331779 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.339955  3656 raft_consensus.cc:1275] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:33.341842  3894 consensus_queue.cc:1048] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:33.342538  3582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50b04597f96d4062b53206268810e90b"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
mode: GRACEFUL
new_leader_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:13:33.343303  3582 raft_consensus.cc:606] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Received request to transfer leadership to TS 5d12ee7ead55455d843508760c81bcc3
I20260709 13:13:33.347087  3654 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
mode: GRACEFUL
new_leader_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:13:33.351632  3654 raft_consensus.cc:606] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Received request to transfer leadership to TS 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:33.353298 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:33.354064 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:33.354835 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:33.547806  3912 raft_consensus.cc:993] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3: : Instructing follower 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:33.548352  3912 raft_consensus.cc:1081] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Signalling peer 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:33.549778  3582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:33.550273  3582 raft_consensus.cc:493] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.550583  3582 raft_consensus.cc:3060] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.556308  3582 raft_consensus.cc:515] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:33.558000  3582 leader_election.cc:290] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:33.558895  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:33.558941  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2ee121cd1a4799bac90ced8983060a" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:33.559501  3656 raft_consensus.cc:3055] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.559749  3857 raft_consensus.cc:3060] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.559813  3656 raft_consensus.cc:740] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:33.560633  3656 consensus_queue.cc:260] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:33.561538  3656 raft_consensus.cc:3060] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.566066  3857 raft_consensus.cc:2468] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 2.
I20260709 13:13:33.566313  3656 raft_consensus.cc:2468] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 2.
I20260709 13:13:33.567217  3545 leader_election.cc:304] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:33.567903  3927 raft_consensus.cc:2804] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.568322  3927 raft_consensus.cc:697] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:33.569128  3927 consensus_queue.cc:237] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:33.576767  3403 catalog_manager.cc:5697] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 1 to 2, leader changed from 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67) to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:33.748693  3927 raft_consensus.cc:993] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67: : Instructing follower 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:33.749182  3894 raft_consensus.cc:1081] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Signalling peer 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:33.750613  3656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50b04597f96d4062b53206268810e90b"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:13:33.751045  3656 raft_consensus.cc:493] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:33.751291  3656 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.756145  3656 raft_consensus.cc:515] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:33.757640  3656 leader_election.cc:290] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:33.758544  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:33.758592  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:33.759148  3856 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.759235  3582 raft_consensus.cc:3055] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:33.759598  3582 raft_consensus.cc:740] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:33.760195  3582 consensus_queue.cc:260] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:33.761109  3582 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:33.764699  3856 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:33.766007  3619 leader_election.cc:304] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:33.766868  3921 raft_consensus.cc:2804] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:33.767356  3921 raft_consensus.cc:697] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:33.768255  3582 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 2.
I20260709 13:13:33.768416  3921 consensus_queue.cc:237] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:33.775831  3403 catalog_manager.cc:5697] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 1 to 2, leader changed from 0ba6bf810a864db593372c571bba1a67 (127.27.229.66) to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 2 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:33.795881  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:34.054184  3656 raft_consensus.cc:1275] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.055509  3927 consensus_queue.cc:1048] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.064725  3856 raft_consensus.cc:1275] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.066876  3894 consensus_queue.cc:1048] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.313345  3582 raft_consensus.cc:1275] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.314519  3921 consensus_queue.cc:1048] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.329797  3856 raft_consensus.cc:1275] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:34.332052  3953 consensus_queue.cc:1048] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:34.365841 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.374631  3582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1df9edf20307470ba72f256250994a02"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
mode: GRACEFUL
new_leader_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:13:34.375133  3582 raft_consensus.cc:606] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Received request to transfer leadership to TS 5d12ee7ead55455d843508760c81bcc3
I20260709 13:13:34.377491  3656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
mode: GRACEFUL
new_leader_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:13:34.377981  3656 raft_consensus.cc:606] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Received request to transfer leadership to TS 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:34.378974 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:34.379449 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:34.379973 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:34.403363  3927 raft_consensus.cc:993] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67: : Instructing follower 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:34.403867  3894 raft_consensus.cc:1081] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Signalling peer 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:34.405254  3656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1df9edf20307470ba72f256250994a02"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:13:34.405723  3656 raft_consensus.cc:493] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.406029  3656 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.411931  3656 raft_consensus.cc:515] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:34.413476  3656 leader_election.cc:290] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 4 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977)
I20260709 13:13:34.414247  3856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:34.414463  3582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1df9edf20307470ba72f256250994a02" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:34.414893  3856 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.414980  3582 raft_consensus.cc:3055] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:13:34.415373  3582 raft_consensus.cc:740] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:34.416064  3582 consensus_queue.cc:260] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:34.417034  3582 raft_consensus.cc:3060] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:13:34.420187  3856 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 4.
I20260709 13:13:34.421376  3619 leader_election.cc:304] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:34.422025  3953 raft_consensus.cc:2804] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:13:34.422403  3953 raft_consensus.cc:697] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 4 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:34.422704  3582 raft_consensus.cc:2468] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 4.
I20260709 13:13:34.423319  3953 consensus_queue.cc:237] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:34.430163  3404 catalog_manager.cc:5697] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 3 to 4, leader changed from 0ba6bf810a864db593372c571bba1a67 (127.27.229.66) to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 4 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:34.789454  3954 raft_consensus.cc:993] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3: : Instructing follower 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:34.789891  3953 raft_consensus.cc:1081] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Signalling peer 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:34.791463  3582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:34.791878  3582 raft_consensus.cc:493] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:34.792104  3582 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:34.796820  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:34.797012  3582 raft_consensus.cc:515] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:34.798758  3582 leader_election.cc:290] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 3 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:34.799546  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:34.799690  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7817d7c24b9b4594a65351429f8dd214" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:34.800247  3857 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.800288  3656 raft_consensus.cc:3055] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:34.800617  3656 raft_consensus.cc:740] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:34.801294  3656 consensus_queue.cc:260] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:34.802342  3656 raft_consensus.cc:3060] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:34.807014  3857 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 3.
I20260709 13:13:34.808009  3545 leader_election.cc:304] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:34.808279  3656 raft_consensus.cc:2468] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 3.
I20260709 13:13:34.808681  3894 raft_consensus.cc:2804] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:34.809165  3894 raft_consensus.cc:697] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:34.810111  3894 consensus_queue.cc:237] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:34.817404  3404 catalog_manager.cc:5697] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 2 to 3, leader changed from 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67) to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:34.829365  3857 raft_consensus.cc:1275] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 4 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:34.830633  3953 consensus_queue.cc:1048] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:34.845680  3582 raft_consensus.cc:1275] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 4 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:13:34.847239  3965 consensus_queue.cc:1048] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:35.332821  3656 raft_consensus.cc:1275] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.334139  3894 consensus_queue.cc:1048] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.344447  3856 raft_consensus.cc:1275] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.346174  3970 consensus_queue.cc:1048] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.386173 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.393697  3580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
mode: GRACEFUL
new_leader_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:50242
I20260709 13:13:35.394244  3580 raft_consensus.cc:606] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Received request to transfer leadership to TS 5d12ee7ead55455d843508760c81bcc3
I20260709 13:13:35.396894  3656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50b04597f96d4062b53206268810e90b"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
mode: GRACEFUL
new_leader_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:45632
I20260709 13:13:35.397380  3656 raft_consensus.cc:606] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Received request to transfer leadership to TS 0ba6bf810a864db593372c571bba1a67
I20260709 13:13:35.398536 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:35.398985 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:35.399492 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:35.408531  3964 raft_consensus.cc:993] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3: : Instructing follower 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:35.409071  3953 raft_consensus.cc:1081] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Signalling peer 0ba6bf810a864db593372c571bba1a67 to start an election
I20260709 13:13:35.410498  3580 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50b04597f96d4062b53206268810e90b"
dest_uuid: "0ba6bf810a864db593372c571bba1a67"
 from {username='slave'} at 127.0.0.1:50212
I20260709 13:13:35.411019  3580 raft_consensus.cc:493] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.411300  3580 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.416952  3580 raft_consensus.cc:515] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:35.418718  3580 leader_election.cc:290] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 3 election: Requested vote from peers cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527), 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67:43933)
I20260709 13:13:35.419508  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:35.419715  3656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50b04597f96d4062b53206268810e90b" candidate_uuid: "0ba6bf810a864db593372c571bba1a67" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
I20260709 13:13:35.420256  3857 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.420284  3656 raft_consensus.cc:3055] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:35.420761  3656 raft_consensus.cc:740] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:35.421500  3656 consensus_queue.cc:260] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:35.422698  3656 raft_consensus.cc:3060] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.427620  3857 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 3.
I20260709 13:13:35.429004  3545 leader_election.cc:304] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ba6bf810a864db593372c571bba1a67, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:35.429436  3656 raft_consensus.cc:2468] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ba6bf810a864db593372c571bba1a67 in term 3.
I20260709 13:13:35.429782  3894 raft_consensus.cc:2804] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:35.430367  3894 raft_consensus.cc:697] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Becoming Leader. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:35.431121  3894 consensus_queue.cc:237] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } }
I20260709 13:13:35.438400  3403 catalog_manager.cc:5697] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 reported cstate change: term changed from 2 to 3, leader changed from 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67) to 0ba6bf810a864db593372c571bba1a67 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "0ba6bf810a864db593372c571bba1a67" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:35.494074  3970 raft_consensus.cc:993] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67: : Instructing follower 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:35.494535  3894 raft_consensus.cc:1081] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Signalling peer 5d12ee7ead55455d843508760c81bcc3 to start an election
I20260709 13:13:35.495898  3656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553"
dest_uuid: "5d12ee7ead55455d843508760c81bcc3"
 from {username='slave'} at 127.0.0.1:45620
I20260709 13:13:35.496330  3656 raft_consensus.cc:493] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:35.496587  3656 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.501328  3656 raft_consensus.cc:515] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:35.502724  3656 leader_election.cc:290] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 3 election: Requested vote from peers 0ba6bf810a864db593372c571bba1a67 (127.27.229.66:43977), cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527)
I20260709 13:13:35.503587  3580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0ba6bf810a864db593372c571bba1a67"
I20260709 13:13:35.503774  3857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0508b02b59b54a43ad7bb79594be2553" candidate_uuid: "5d12ee7ead55455d843508760c81bcc3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f"
I20260709 13:13:35.504324  3580 raft_consensus.cc:3055] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:35.504428  3857 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.504719  3580 raft_consensus.cc:740] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ba6bf810a864db593372c571bba1a67, State: Running, Role: LEADER
I20260709 13:13:35.505724  3580 consensus_queue.cc:260] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:35.507093  3580 raft_consensus.cc:3060] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:35.512252  3857 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 3.
I20260709 13:13:35.513572  3619 leader_election.cc:304] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d12ee7ead55455d843508760c81bcc3, cd94a5cc3aa0446f8736ce8ff59ac65f; no voters: 
I20260709 13:13:35.514390  3953 raft_consensus.cc:2804] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:35.514513  3580 raft_consensus.cc:2468] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d12ee7ead55455d843508760c81bcc3 in term 3.
I20260709 13:13:35.514909  3953 raft_consensus.cc:697] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 3 LEADER]: Becoming Leader. State: Replica: 5d12ee7ead55455d843508760c81bcc3, State: Running, Role: LEADER
I20260709 13:13:35.516184  3953 consensus_queue.cc:237] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } }
I20260709 13:13:35.523641  3403 catalog_manager.cc:5697] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 reported cstate change: term changed from 2 to 3, leader changed from 0ba6bf810a864db593372c571bba1a67 (127.27.229.66) to 5d12ee7ead55455d843508760c81bcc3 (127.27.229.67). New cstate: current_term: 3 leader_uuid: "5d12ee7ead55455d843508760c81bcc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:35.797885  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:35.895021  3656 raft_consensus.cc:1275] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.896247  3894 consensus_queue.cc:1048] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d12ee7ead55455d843508760c81bcc3" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 43933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.905550  3857 raft_consensus.cc:1275] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Refusing update from remote peer 0ba6bf810a864db593372c571bba1a67: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:35.907207  3970 consensus_queue.cc:1048] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:35.953739  3857 raft_consensus.cc:1275] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:35.954943  3953 consensus_queue.cc:1048] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd94a5cc3aa0446f8736ce8ff59ac65f" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:35.965057  3580 raft_consensus.cc:1275] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Refusing update from remote peer 5d12ee7ead55455d843508760c81bcc3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:13:35.966441  3986 consensus_queue.cc:1048] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ba6bf810a864db593372c571bba1a67" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 43977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:36.405484 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:36.434072 28565 tablet_server.cc:179] TabletServer@127.27.229.65:46527 shutting down...
W20260709 13:13:36.447544  3619 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 84 similar messages]
W20260709 13:13:36.451159  3619 consensus_peers.cc:597] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:36.460029  3545 consensus_peers.cc:597] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.465617 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.466681 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.467958 28565 raft_consensus.cc:2243] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.468473 28565 raft_consensus.cc:2272] T 709ed03df6c54248adf1c61cb1aff23d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.471164 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.471908 28565 raft_consensus.cc:2243] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.472378 28565 raft_consensus.cc:2272] T ad9c8cffe39240f194a1496c6b44c74d P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.474690 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.475308 28565 raft_consensus.cc:2243] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.475757 28565 raft_consensus.cc:2272] T a7fecc51298045668569ed36c69fbc4f P cd94a5cc3aa0446f8736ce8ff59ac65f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.478190 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.478801 28565 raft_consensus.cc:2243] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.479209 28565 raft_consensus.cc:2272] T bbb4507428bc43acae7c5d3024486ff6 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.481325 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.481889 28565 raft_consensus.cc:2243] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.482378 28565 raft_consensus.cc:2272] T 9b2ee121cd1a4799bac90ced8983060a P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.484555 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.485107 28565 raft_consensus.cc:2243] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.485496 28565 raft_consensus.cc:2272] T 7817d7c24b9b4594a65351429f8dd214 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.487744 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.488270 28565 raft_consensus.cc:2243] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.488711 28565 raft_consensus.cc:2272] T 0508b02b59b54a43ad7bb79594be2553 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.491493 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.492334 28565 raft_consensus.cc:2243] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.492803 28565 raft_consensus.cc:2272] T 1df9edf20307470ba72f256250994a02 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.494935 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.495419 28565 raft_consensus.cc:2243] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.495827 28565 raft_consensus.cc:2272] T 50b04597f96d4062b53206268810e90b P cd94a5cc3aa0446f8736ce8ff59ac65f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.498546 28565 tablet_replica.cc:333] stopping tablet replica
I20260709 13:13:36.499054 28565 raft_consensus.cc:2243] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.499485 28565 raft_consensus.cc:2272] T b9cfb1606e6f4e1f855c7447d37795f7 P cd94a5cc3aa0446f8736ce8ff59ac65f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:36.518325  3545 consensus_peers.cc:597] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.526346 28565 tablet_server.cc:196] TabletServer@127.27.229.65:46527 shutdown complete.
W20260709 13:13:36.536270  3545 consensus_peers.cc:597] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:36.562505  3545 consensus_peers.cc:597] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.563411 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
W20260709 13:13:36.584281  3619 consensus_peers.cc:597] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 -> Peer cd94a5cc3aa0446f8736ce8ff59ac65f (127.27.229.65:46527): Couldn't send request to peer cd94a5cc3aa0446f8736ce8ff59ac65f. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:46527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:36.586309 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.587038 28565 tablet_replica.cc:333] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.587801 28565 raft_consensus.cc:2243] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.588624 28565 raft_consensus.cc:2272] T a7fecc51298045668569ed36c69fbc4f P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.590919 28565 tablet_replica.cc:333] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.591478 28565 raft_consensus.cc:2243] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.592202 28565 raft_consensus.cc:2272] T 9b2ee121cd1a4799bac90ced8983060a P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.594156 28565 tablet_replica.cc:333] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.594683 28565 raft_consensus.cc:2243] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.595093 28565 raft_consensus.cc:2272] T 0508b02b59b54a43ad7bb79594be2553 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.597468 28565 tablet_replica.cc:333] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.598084 28565 raft_consensus.cc:2243] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.598814 28565 raft_consensus.cc:2272] T 7817d7c24b9b4594a65351429f8dd214 P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.600744 28565 tablet_replica.cc:333] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.601250 28565 raft_consensus.cc:2243] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.602015 28565 raft_consensus.cc:2272] T ad9c8cffe39240f194a1496c6b44c74d P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.604079 28565 tablet_replica.cc:333] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.604614 28565 raft_consensus.cc:2243] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.605080 28565 raft_consensus.cc:2272] T 709ed03df6c54248adf1c61cb1aff23d P 0ba6bf810a864db593372c571bba1a67 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.607118 28565 tablet_replica.cc:333] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.607666 28565 raft_consensus.cc:2243] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.608070 28565 raft_consensus.cc:2272] T bbb4507428bc43acae7c5d3024486ff6 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.610066 28565 tablet_replica.cc:333] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.610528 28565 raft_consensus.cc:2243] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.610906 28565 raft_consensus.cc:2272] T 1df9edf20307470ba72f256250994a02 P 0ba6bf810a864db593372c571bba1a67 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.612852 28565 tablet_replica.cc:333] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.613310 28565 raft_consensus.cc:2243] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.613767 28565 raft_consensus.cc:2272] T b9cfb1606e6f4e1f855c7447d37795f7 P 0ba6bf810a864db593372c571bba1a67 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.615756 28565 tablet_replica.cc:333] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67: stopping tablet replica
I20260709 13:13:36.616210 28565 raft_consensus.cc:2243] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.616917 28565 raft_consensus.cc:2272] T 50b04597f96d4062b53206268810e90b P 0ba6bf810a864db593372c571bba1a67 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.648226 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
I20260709 13:13:36.670794 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
I20260709 13:13:36.696257 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:36.696940 28565 tablet_replica.cc:333] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.697607 28565 raft_consensus.cc:2243] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.698150 28565 raft_consensus.cc:2272] T a7fecc51298045668569ed36c69fbc4f P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.700363 28565 tablet_replica.cc:333] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.700941 28565 raft_consensus.cc:2243] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.701357 28565 raft_consensus.cc:2272] T 9b2ee121cd1a4799bac90ced8983060a P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.703413 28565 tablet_replica.cc:333] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.703962 28565 raft_consensus.cc:2243] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.704378 28565 raft_consensus.cc:2272] T 7817d7c24b9b4594a65351429f8dd214 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.706408 28565 tablet_replica.cc:333] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.706987 28565 raft_consensus.cc:2243] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.707728 28565 raft_consensus.cc:2272] T bbb4507428bc43acae7c5d3024486ff6 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.709730 28565 tablet_replica.cc:333] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.710369 28565 raft_consensus.cc:2243] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.710770 28565 raft_consensus.cc:2272] T 50b04597f96d4062b53206268810e90b P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.713110 28565 tablet_replica.cc:333] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.713622 28565 raft_consensus.cc:2243] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.714473 28565 raft_consensus.cc:2272] T b9cfb1606e6f4e1f855c7447d37795f7 P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.716558 28565 tablet_replica.cc:333] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.717113 28565 raft_consensus.cc:2243] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.717828 28565 raft_consensus.cc:2272] T 1df9edf20307470ba72f256250994a02 P 5d12ee7ead55455d843508760c81bcc3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.719944 28565 tablet_replica.cc:333] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.720405 28565 raft_consensus.cc:2243] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.721239 28565 raft_consensus.cc:2272] T 709ed03df6c54248adf1c61cb1aff23d P 5d12ee7ead55455d843508760c81bcc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.723351 28565 tablet_replica.cc:333] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.723795 28565 raft_consensus.cc:2243] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:36.724208 28565 raft_consensus.cc:2272] T ad9c8cffe39240f194a1496c6b44c74d P 5d12ee7ead55455d843508760c81bcc3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.726050 28565 tablet_replica.cc:333] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3: stopping tablet replica
I20260709 13:13:36.726507 28565 raft_consensus.cc:2243] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.727219 28565 raft_consensus.cc:2272] T 0508b02b59b54a43ad7bb79594be2553 P 5d12ee7ead55455d843508760c81bcc3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.775269 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
W20260709 13:13:36.798995  3453 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:13:36.800017 28565 master.cc:562] Master@127.27.229.126:38899 shutting down...
I20260709 13:13:36.821774 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:36.822376 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:36.822701 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P 65e571166af44535b7411e1bf1fbe63d: stopping tablet replica
I20260709 13:13:36.842751 28565 master.cc:584] Master@127.27.229.126:38899 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13256 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:13:36.884177 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:34783
I20260709 13:13:36.885298 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:36.891091  3999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:36.891124  3998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.892190 28565 server_base.cc:1061] running on GCE node
W20260709 13:13:36.892364  4001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:36.893297 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:36.893487 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:36.893657 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602816893639 us; error 0 us; skew 500 ppm
I20260709 13:13:36.894229 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:36.896624 28565 webserver.cc:533] Webserver started at http://127.27.229.126:44847/ using document root <none> and password file <none>
I20260709 13:13:36.897140 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:36.897320 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:36.897578 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:36.898887 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "c3fe66523bc1489d86e3ee87d64e7cfd"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-twc1"
I20260709 13:13:36.903432 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:36.906963  4006 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:36.907684 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:36.907986 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "c3fe66523bc1489d86e3ee87d64e7cfd"
format_stamp: "Formatted at 2026-07-09 13:13:36 on dist-test-slave-twc1"
I20260709 13:13:36.908254 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:36.928977 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:36.930294 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:36.967334 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:34783
I20260709 13:13:36.967434  4057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:34783 every 8 connection(s)
I20260709 13:13:36.971215  4058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:36.982509  4058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd: Bootstrap starting.
I20260709 13:13:36.987332  4058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:36.991532  4058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd: No bootstrap required, opened a new log
I20260709 13:13:36.993805  4058 raft_consensus.cc:359] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" member_type: VOTER }
I20260709 13:13:36.994349  4058 raft_consensus.cc:385] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:36.994541  4058 raft_consensus.cc:740] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3fe66523bc1489d86e3ee87d64e7cfd, State: Initialized, Role: FOLLOWER
I20260709 13:13:36.995096  4058 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" member_type: VOTER }
I20260709 13:13:36.995529  4058 raft_consensus.cc:399] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:36.995714  4058 raft_consensus.cc:493] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:36.995926  4058 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.000766  4058 raft_consensus.cc:515] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" member_type: VOTER }
I20260709 13:13:37.001286  4058 leader_election.cc:304] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3fe66523bc1489d86e3ee87d64e7cfd; no voters: 
I20260709 13:13:37.002381  4058 leader_election.cc:290] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:37.002782  4061 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.004077  4061 raft_consensus.cc:697] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 1 LEADER]: Becoming Leader. State: Replica: c3fe66523bc1489d86e3ee87d64e7cfd, State: Running, Role: LEADER
I20260709 13:13:37.004740  4061 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" member_type: VOTER }
I20260709 13:13:37.005257  4058 sys_catalog.cc:565] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:37.009539  4063 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3fe66523bc1489d86e3ee87d64e7cfd. Latest consensus state: current_term: 1 leader_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" member_type: VOTER } }
I20260709 13:13:37.010325  4063 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:37.014168  4062 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3fe66523bc1489d86e3ee87d64e7cfd" member_type: VOTER } }
I20260709 13:13:37.015326  4062 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:37.016182  4067 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:37.022857  4067 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:37.027215 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:37.031499  4067 catalog_manager.cc:1383] Generated new cluster ID: 4e6f9fefce254b46bd68c8b554ffa554
I20260709 13:13:37.031800  4067 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:37.048405  4067 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:37.049742  4067 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:37.067325  4067 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd: Generated new TSK 0
I20260709 13:13:37.067914  4067 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:37.094998 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.101287  4079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.102412  4080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.104174  4082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.104174 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:37.105548 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:37.105748 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.105868 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602817105857 us; error 0 us; skew 500 ppm
I20260709 13:13:37.106415 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.108855 28565 webserver.cc:533] Webserver started at http://127.27.229.65:39491/ using document root <none> and password file <none>
I20260709 13:13:37.109325 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.109524 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.109800 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.111044 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-twc1"
I20260709 13:13:37.115733 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:37.119248  4087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.120038 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:37.120332 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-twc1"
I20260709 13:13:37.120616 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.139515 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.140791 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.142277 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:37.144627 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:37.144836 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.145081 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:37.145247 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.185675 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:38621
I20260709 13:13:37.185767  4149 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:38621 every 8 connection(s)
I20260709 13:13:37.190785 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.199115  4155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.199283  4154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.202562  4157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.202590 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:37.204507 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:37.204708  4150 heartbeater.cc:344] Connected to a master server at 127.27.229.126:34783
W20260709 13:13:37.204736 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.205224 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602817205201 us; error 0 us; skew 500 ppm
I20260709 13:13:37.205283  4150 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:37.206036 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.206283  4150 heartbeater.cc:507] Master 127.27.229.126:34783 requested a full tablet report, sending...
I20260709 13:13:37.208652 28565 webserver.cc:533] Webserver started at http://127.27.229.66:34847/ using document root <none> and password file <none>
I20260709 13:13:37.208761  4023 ts_manager.cc:194] Registered new tserver with Master: 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65:38621)
I20260709 13:13:37.209220 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.209445 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.209748 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.210852  4023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46584
I20260709 13:13:37.210917 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "8f2d94994b154e6aad0b4404297d3aa0"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-twc1"
I20260709 13:13:37.216166 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:37.219537  4162 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.220273 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:37.220589 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "8f2d94994b154e6aad0b4404297d3aa0"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-twc1"
I20260709 13:13:37.220928 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.230595 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.231768 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.233196 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:37.235522 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:37.235726 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.235953 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:37.236105 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.275341 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:36143
I20260709 13:13:37.275478  4224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:36143 every 8 connection(s)
I20260709 13:13:37.280052 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:37.287326  4228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:37.288573  4229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.291649 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:37.292371  4225 heartbeater.cc:344] Connected to a master server at 127.27.229.126:34783
W20260709 13:13:37.292511  4231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:37.292790  4225 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:37.293673 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:13:37.293773  4225 heartbeater.cc:507] Master 127.27.229.126:34783 requested a full tablet report, sending...
W20260709 13:13:37.294010 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:37.294288 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602817294267 us; error 0 us; skew 500 ppm
I20260709 13:13:37.295035 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:37.296244  4023 ts_manager.cc:194] Registered new tserver with Master: 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66:36143)
I20260709 13:13:37.297703 28565 webserver.cc:533] Webserver started at http://127.27.229.67:38097/ using document root <none> and password file <none>
I20260709 13:13:37.298048  4023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46588
I20260709 13:13:37.298293 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:37.298578 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:37.298834 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:37.300490 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-twc1"
I20260709 13:13:37.305055 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:37.308414  4236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.309234 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:37.309544 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
format_stamp: "Formatted at 2026-07-09 13:13:37 on dist-test-slave-twc1"
I20260709 13:13:37.309825 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:37.326709 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:37.327853 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:37.329281 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:37.331535 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:37.331735 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.331959 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:37.332108 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:37.371337 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:39625
I20260709 13:13:37.371465  4298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:39625 every 8 connection(s)
I20260709 13:13:37.385978  4299 heartbeater.cc:344] Connected to a master server at 127.27.229.126:34783
I20260709 13:13:37.386451  4299 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:37.387213  4299 heartbeater.cc:507] Master 127.27.229.126:34783 requested a full tablet report, sending...
I20260709 13:13:37.389129  4023 ts_manager.cc:194] Registered new tserver with Master: aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:37.389297 28565 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014844743s
I20260709 13:13:37.390552  4023 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46592
I20260709 13:13:37.414947  4023 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46604:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:37.417140  4023 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:37.461433  4190 tablet_service.cc:1511] Processing CreateTablet for tablet 5edc539f479540008d4d7e70ab56cab3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=62482e89499248d38cb5c9ada0e79037]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.463078  4189 tablet_service.cc:1511] Processing CreateTablet for tablet 72f0d2cf9f624a5095798a51276baf25 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=62482e89499248d38cb5c9ada0e79037]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.463702  4190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5edc539f479540008d4d7e70ab56cab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.464639  4189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f0d2cf9f624a5095798a51276baf25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.465298  4115 tablet_service.cc:1511] Processing CreateTablet for tablet 5edc539f479540008d4d7e70ab56cab3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=62482e89499248d38cb5c9ada0e79037]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.466668  4115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5edc539f479540008d4d7e70ab56cab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.468139  4263 tablet_service.cc:1511] Processing CreateTablet for tablet 72f0d2cf9f624a5095798a51276baf25 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=62482e89499248d38cb5c9ada0e79037]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.468416  4114 tablet_service.cc:1511] Processing CreateTablet for tablet 72f0d2cf9f624a5095798a51276baf25 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=62482e89499248d38cb5c9ada0e79037]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.469560  4263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f0d2cf9f624a5095798a51276baf25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.469739  4114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72f0d2cf9f624a5095798a51276baf25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.475169  4264 tablet_service.cc:1511] Processing CreateTablet for tablet 5edc539f479540008d4d7e70ab56cab3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=62482e89499248d38cb5c9ada0e79037]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.476665  4264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5edc539f479540008d4d7e70ab56cab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.509161  4314 tablet_bootstrap.cc:492] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0: Bootstrap starting.
I20260709 13:13:37.511247  4316 tablet_bootstrap.cc:492] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded: Bootstrap starting.
I20260709 13:13:37.517206  4314 tablet_bootstrap.cc:654] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.517668  4315 tablet_bootstrap.cc:492] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7: Bootstrap starting.
I20260709 13:13:37.519415  4316 tablet_bootstrap.cc:654] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.523741  4314 tablet_bootstrap.cc:492] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0: No bootstrap required, opened a new log
I20260709 13:13:37.524466  4314 ts_tablet_manager.cc:1403] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:13:37.525990  4315 tablet_bootstrap.cc:654] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.526245  4316 tablet_bootstrap.cc:492] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded: No bootstrap required, opened a new log
I20260709 13:13:37.526752  4316 ts_tablet_manager.cc:1403] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:13:37.526859  4314 raft_consensus.cc:359] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.527671  4314 raft_consensus.cc:385] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.528113  4314 raft_consensus.cc:740] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f2d94994b154e6aad0b4404297d3aa0, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.529495  4314 consensus_queue.cc:260] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.530305  4316 raft_consensus.cc:359] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.531093  4316 raft_consensus.cc:385] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.531451  4316 raft_consensus.cc:740] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab83de0a1a74f80bf7b15d29ea97ded, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.531898  4225 heartbeater.cc:499] Master 127.27.229.126:34783 was elected leader, sending a full tablet report...
I20260709 13:13:37.532043  4315 tablet_bootstrap.cc:492] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7: No bootstrap required, opened a new log
I20260709 13:13:37.532420  4314 ts_tablet_manager.cc:1434] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:37.532637  4315 ts_tablet_manager.cc:1403] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 13:13:37.532482  4316 consensus_queue.cc:260] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.533766  4314 tablet_bootstrap.cc:492] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0: Bootstrap starting.
I20260709 13:13:37.535490  4299 heartbeater.cc:499] Master 127.27.229.126:34783 was elected leader, sending a full tablet report...
I20260709 13:13:37.535998  4316 ts_tablet_manager.cc:1434] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:37.536118  4315 raft_consensus.cc:359] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.537050  4315 raft_consensus.cc:385] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.537385  4315 raft_consensus.cc:740] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.538604  4316 tablet_bootstrap.cc:492] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded: Bootstrap starting.
I20260709 13:13:37.538340  4315 consensus_queue.cc:260] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.545313  4314 tablet_bootstrap.cc:654] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.546439  4316 tablet_bootstrap.cc:654] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.551021  4150 heartbeater.cc:499] Master 127.27.229.126:34783 was elected leader, sending a full tablet report...
I20260709 13:13:37.551560  4315 ts_tablet_manager.cc:1434] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:13:37.552637  4315 tablet_bootstrap.cc:492] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7: Bootstrap starting.
I20260709 13:13:37.559304  4315 tablet_bootstrap.cc:654] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:37.560765  4314 tablet_bootstrap.cc:492] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0: No bootstrap required, opened a new log
I20260709 13:13:37.561488  4314 ts_tablet_manager.cc:1403] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.007s
I20260709 13:13:37.563302  4316 tablet_bootstrap.cc:492] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded: No bootstrap required, opened a new log
I20260709 13:13:37.563892  4316 ts_tablet_manager.cc:1403] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:13:37.564709  4314 raft_consensus.cc:359] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.565567  4314 raft_consensus.cc:385] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.565897  4314 raft_consensus.cc:740] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f2d94994b154e6aad0b4404297d3aa0, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.566900  4316 raft_consensus.cc:359] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.566962  4314 consensus_queue.cc:260] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.569437  4314 ts_tablet_manager.cc:1434] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:13:37.567898  4316 raft_consensus.cc:385] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.570544  4316 raft_consensus.cc:740] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab83de0a1a74f80bf7b15d29ea97ded, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.571455  4316 consensus_queue.cc:260] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.573392  4316 ts_tablet_manager.cc:1434] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:13:37.577289  4315 tablet_bootstrap.cc:492] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7: No bootstrap required, opened a new log
I20260709 13:13:37.578014  4315 ts_tablet_manager.cc:1403] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.019s
I20260709 13:13:37.581022  4315 raft_consensus.cc:359] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.581720  4315 raft_consensus.cc:385] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:37.582020  4315 raft_consensus.cc:740] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Initialized, Role: FOLLOWER
I20260709 13:13:37.582628  4315 consensus_queue.cc:260] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.584705  4315 ts_tablet_manager.cc:1434] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:37.805269  4322 raft_consensus.cc:493] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.805759  4322 raft_consensus.cc:515] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.808050  4322 leader_election.cc:290] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625), 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66:36143)
I20260709 13:13:37.818208  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5edc539f479540008d4d7e70ab56cab3" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" is_pre_election: true
I20260709 13:13:37.818208  4200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5edc539f479540008d4d7e70ab56cab3" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f2d94994b154e6aad0b4404297d3aa0" is_pre_election: true
I20260709 13:13:37.818967  4274 raft_consensus.cc:2468] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 0.
I20260709 13:13:37.819026  4200 raft_consensus.cc:2468] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 0.
I20260709 13:13:37.820161  4091 leader_election.cc:304] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, aab83de0a1a74f80bf7b15d29ea97ded; no voters: 
I20260709 13:13:37.820936  4322 raft_consensus.cc:2804] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.821295  4322 raft_consensus.cc:493] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.821527  4322 raft_consensus.cc:3060] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.826857  4322 raft_consensus.cc:515] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.828399  4322 leader_election.cc:290] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 election: Requested vote from peers aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625), 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66:36143)
I20260709 13:13:37.829229  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5edc539f479540008d4d7e70ab56cab3" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
I20260709 13:13:37.829452  4200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5edc539f479540008d4d7e70ab56cab3" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f2d94994b154e6aad0b4404297d3aa0"
I20260709 13:13:37.829802  4274 raft_consensus.cc:3060] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.830034  4200 raft_consensus.cc:3060] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.834002  4320 raft_consensus.cc:493] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:37.834620  4320 raft_consensus.cc:515] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.835882  4274 raft_consensus.cc:2468] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 1.
I20260709 13:13:37.836230  4200 raft_consensus.cc:2468] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 1.
I20260709 13:13:37.836984  4091 leader_election.cc:304] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, aab83de0a1a74f80bf7b15d29ea97ded; no voters: 
I20260709 13:13:37.837371  4320 leader_election.cc:290] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65:38621), aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:37.838174  4322 raft_consensus.cc:2804] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.839807  4322 raft_consensus.cc:697] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 LEADER]: Becoming Leader. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Running, Role: LEADER
I20260709 13:13:37.840812  4322 consensus_queue.cc:237] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } }
I20260709 13:13:37.849876  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f0d2cf9f624a5095798a51276baf25" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" is_pre_election: true
I20260709 13:13:37.850664  4125 raft_consensus.cc:2468] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 0.
I20260709 13:13:37.851270  4023 catalog_manager.cc:5697] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:37.852267  4166 leader_election.cc:304] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, 8f2d94994b154e6aad0b4404297d3aa0; no voters: 
I20260709 13:13:37.853196  4320 raft_consensus.cc:2804] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:37.853506  4320 raft_consensus.cc:493] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:37.853822  4320 raft_consensus.cc:3060] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.854298  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f0d2cf9f624a5095798a51276baf25" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" is_pre_election: true
I20260709 13:13:37.854876  4274 raft_consensus.cc:2468] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 0.
I20260709 13:13:37.860610  4320 raft_consensus.cc:515] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.862426  4320 leader_election.cc:290] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 election: Requested vote from peers 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65:38621), aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:37.863299  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f0d2cf9f624a5095798a51276baf25" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
I20260709 13:13:37.863322  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72f0d2cf9f624a5095798a51276baf25" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
I20260709 13:13:37.863842  4125 raft_consensus.cc:3060] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.863998  4274 raft_consensus.cc:3060] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:37.869196  4274 raft_consensus.cc:2468] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 1.
I20260709 13:13:37.869297  4125 raft_consensus.cc:2468] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 1.
I20260709 13:13:37.870272  4166 leader_election.cc:304] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f2d94994b154e6aad0b4404297d3aa0, aab83de0a1a74f80bf7b15d29ea97ded; no voters: 
I20260709 13:13:37.870949  4320 raft_consensus.cc:2804] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:37.871946  4320 raft_consensus.cc:697] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 LEADER]: Becoming Leader. State: Replica: 8f2d94994b154e6aad0b4404297d3aa0, State: Running, Role: LEADER
I20260709 13:13:37.872632  4320 consensus_queue.cc:237] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:37.880067  4023 catalog_manager.cc:5697] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "8f2d94994b154e6aad0b4404297d3aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:37.964040  4023 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46616:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:37.966063  4023 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:37.988289  4114 tablet_service.cc:1511] Processing CreateTablet for tablet f71a461b46674376af80f40ab94d6af0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=054e65747c924084bef6e512dd77686d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.989634  4114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71a461b46674376af80f40ab94d6af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.989614  4190 tablet_service.cc:1511] Processing CreateTablet for tablet f71a461b46674376af80f40ab94d6af0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=054e65747c924084bef6e512dd77686d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.991042  4190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71a461b46674376af80f40ab94d6af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.991200  4263 tablet_service.cc:1511] Processing CreateTablet for tablet f71a461b46674376af80f40ab94d6af0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=054e65747c924084bef6e512dd77686d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:13:37.992477  4263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71a461b46674376af80f40ab94d6af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.995563  4115 tablet_service.cc:1511] Processing CreateTablet for tablet 04f1f1492d8946b5a1171aa84fdcd41e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=054e65747c924084bef6e512dd77686d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.996845  4115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f1f1492d8946b5a1171aa84fdcd41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:37.997089  4189 tablet_service.cc:1511] Processing CreateTablet for tablet 04f1f1492d8946b5a1171aa84fdcd41e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=054e65747c924084bef6e512dd77686d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:37.998306  4189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f1f1492d8946b5a1171aa84fdcd41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.000303  4264 tablet_service.cc:1511] Processing CreateTablet for tablet 04f1f1492d8946b5a1171aa84fdcd41e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=054e65747c924084bef6e512dd77686d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:13:38.001551  4264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04f1f1492d8946b5a1171aa84fdcd41e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:38.009315  4316 tablet_bootstrap.cc:492] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: Bootstrap starting.
I20260709 13:13:38.012979  4315 tablet_bootstrap.cc:492] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7: Bootstrap starting.
I20260709 13:13:38.015877  4316 tablet_bootstrap.cc:654] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:38.021689  4071 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:38.020000  4315 tablet_bootstrap.cc:654] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.025522  4314 tablet_bootstrap.cc:492] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0: Bootstrap starting.
I20260709 13:13:38.033378  4314 tablet_bootstrap.cc:654] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.037083  4316 tablet_bootstrap.cc:492] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: No bootstrap required, opened a new log
I20260709 13:13:38.037654  4316 ts_tablet_manager.cc:1403] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.008s
I20260709 13:13:38.038950  4315 tablet_bootstrap.cc:492] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7: No bootstrap required, opened a new log
I20260709 13:13:38.039429  4315 ts_tablet_manager.cc:1403] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent bootstrapping tablet: real 0.027s	user 0.001s	sys 0.013s
I20260709 13:13:38.039974  4314 tablet_bootstrap.cc:492] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0: No bootstrap required, opened a new log
I20260709 13:13:38.040535  4314 ts_tablet_manager.cc:1403] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:13:38.040601  4316 raft_consensus.cc:359] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.041426  4316 raft_consensus.cc:385] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.041728  4316 raft_consensus.cc:740] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab83de0a1a74f80bf7b15d29ea97ded, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.041723  4315 raft_consensus.cc:359] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.042459  4315 raft_consensus.cc:385] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.042776  4315 raft_consensus.cc:740] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.042791  4316 consensus_queue.cc:260] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.043641  4314 raft_consensus.cc:359] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.044471  4314 raft_consensus.cc:385] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.044836  4314 raft_consensus.cc:740] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f2d94994b154e6aad0b4404297d3aa0, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.045300  4316 ts_tablet_manager.cc:1434] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:38.045601  4314 consensus_queue.cc:260] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.046464  4316 tablet_bootstrap.cc:492] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded: Bootstrap starting.
I20260709 13:13:38.043447  4315 consensus_queue.cc:260] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.050462  4314 ts_tablet_manager.cc:1434] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:13:38.051755  4314 tablet_bootstrap.cc:492] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0: Bootstrap starting.
I20260709 13:13:38.053015  4316 tablet_bootstrap.cc:654] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.057881  4315 ts_tablet_manager.cc:1434] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:13:38.058604  4316 tablet_bootstrap.cc:492] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded: No bootstrap required, opened a new log
I20260709 13:13:38.059211  4316 ts_tablet_manager.cc:1403] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.002s
I20260709 13:13:38.059541  4315 tablet_bootstrap.cc:492] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7: Bootstrap starting.
I20260709 13:13:38.062312  4316 raft_consensus.cc:359] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.063169  4316 raft_consensus.cc:385] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.063534  4316 raft_consensus.cc:740] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aab83de0a1a74f80bf7b15d29ea97ded, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.064350  4316 consensus_queue.cc:260] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.066231  4315 tablet_bootstrap.cc:654] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.068858  4316 ts_tablet_manager.cc:1434] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:13:38.072840  4315 tablet_bootstrap.cc:492] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7: No bootstrap required, opened a new log
I20260709 13:13:38.073055  4314 tablet_bootstrap.cc:654] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:38.073462  4315 ts_tablet_manager.cc:1403] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:13:38.076900  4315 raft_consensus.cc:359] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.077627  4315 raft_consensus.cc:385] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.077939  4315 raft_consensus.cc:740] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.078642  4315 consensus_queue.cc:260] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.079027  4314 tablet_bootstrap.cc:492] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0: No bootstrap required, opened a new log
I20260709 13:13:38.079617  4314 ts_tablet_manager.cc:1403] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.001s
I20260709 13:13:38.080402  4315 ts_tablet_manager.cc:1434] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:13:38.082417  4314 raft_consensus.cc:359] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.083003  4314 raft_consensus.cc:385] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:38.083240  4314 raft_consensus.cc:740] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f2d94994b154e6aad0b4404297d3aa0, State: Initialized, Role: FOLLOWER
I20260709 13:13:38.083837  4314 consensus_queue.cc:260] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.085850  4314 ts_tablet_manager.cc:1434] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:38.134081  4320 raft_consensus.cc:493] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.134625  4320 raft_consensus.cc:515] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.136270  4320 leader_election.cc:290] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65:38621), aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:38.137142  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" is_pre_election: true
I20260709 13:13:38.137442  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" is_pre_election: true
I20260709 13:13:38.137943  4125 raft_consensus.cc:2468] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 0.
I20260709 13:13:38.138087  4274 raft_consensus.cc:2468] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 0.
I20260709 13:13:38.139096  4166 leader_election.cc:304] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, 8f2d94994b154e6aad0b4404297d3aa0; no voters: 
I20260709 13:13:38.139789  4320 raft_consensus.cc:2804] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.140081  4320 raft_consensus.cc:493] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.140336  4320 raft_consensus.cc:3060] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.145439  4320 raft_consensus.cc:515] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.147051  4320 leader_election.cc:290] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 election: Requested vote from peers 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65:38621), aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:38.147944  4125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
I20260709 13:13:38.148159  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e" candidate_uuid: "8f2d94994b154e6aad0b4404297d3aa0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
I20260709 13:13:38.148517  4125 raft_consensus.cc:3060] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.148684  4274 raft_consensus.cc:3060] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.153640  4274 raft_consensus.cc:2468] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 1.
I20260709 13:13:38.153643  4125 raft_consensus.cc:2468] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f2d94994b154e6aad0b4404297d3aa0 in term 1.
I20260709 13:13:38.154860  4166 leader_election.cc:304] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, 8f2d94994b154e6aad0b4404297d3aa0; no voters: 
I20260709 13:13:38.155639  4320 raft_consensus.cc:2804] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.156160  4320 raft_consensus.cc:697] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 LEADER]: Becoming Leader. State: Replica: 8f2d94994b154e6aad0b4404297d3aa0, State: Running, Role: LEADER
I20260709 13:13:38.156869  4320 consensus_queue.cc:237] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.163965  4322 raft_consensus.cc:493] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:38.164520  4322 raft_consensus.cc:515] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.164101  4020 catalog_manager.cc:5697] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "8f2d94994b154e6aad0b4404297d3aa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.166676  4322 leader_election.cc:290] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66:36143), aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:38.167387  4200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f2d94994b154e6aad0b4404297d3aa0" is_pre_election: true
I20260709 13:13:38.167734  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" is_pre_election: true
I20260709 13:13:38.167975  4200 raft_consensus.cc:2468] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 0.
I20260709 13:13:38.168418  4274 raft_consensus.cc:2468] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 0.
I20260709 13:13:38.169137  4090 leader_election.cc:304] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, 8f2d94994b154e6aad0b4404297d3aa0; no voters: 
I20260709 13:13:38.169983  4322 raft_consensus.cc:2804] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:38.170334  4322 raft_consensus.cc:493] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:38.170655  4322 raft_consensus.cc:3060] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.176142  4322 raft_consensus.cc:515] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.177668  4322 leader_election.cc:290] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 election: Requested vote from peers 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66:36143), aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:38.178607  4200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f2d94994b154e6aad0b4404297d3aa0"
I20260709 13:13:38.178691  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
I20260709 13:13:38.179230  4200 raft_consensus.cc:3060] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.179281  4274 raft_consensus.cc:3060] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:38.184343  4200 raft_consensus.cc:2468] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 1.
I20260709 13:13:38.184345  4274 raft_consensus.cc:2468] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 1.
I20260709 13:13:38.185500  4091 leader_election.cc:304] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, aab83de0a1a74f80bf7b15d29ea97ded; no voters: 
I20260709 13:13:38.186254  4322 raft_consensus.cc:2804] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:38.186746  4322 raft_consensus.cc:697] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 LEADER]: Becoming Leader. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Running, Role: LEADER
I20260709 13:13:38.187426  4322 consensus_queue.cc:237] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.194229  4020 catalog_manager.cc:5697] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.247660  4200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e"
dest_uuid: "8f2d94994b154e6aad0b4404297d3aa0"
mode: GRACEFUL
new_leader_uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
 from {username='slave'} at 127.0.0.1:47236
I20260709 13:13:38.248193  4200 raft_consensus.cc:606] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 LEADER]: Received request to transfer leadership to TS 1876270ba3074bcab9ec1d8e5df63ae7
I20260709 13:13:38.288959  4320 consensus_queue.cc:1048] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.295396  4320 consensus_queue.cc:1048] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.377418  4322 consensus_queue.cc:1048] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.388845  4355 consensus_queue.cc:1048] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:38.585541  4355 consensus_queue.cc:1048] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.596220  4322 consensus_queue.cc:1048] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.636178  4332 consensus_queue.cc:1048] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.642556  4320 raft_consensus.cc:993] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0: : Instructing follower 1876270ba3074bcab9ec1d8e5df63ae7 to start an election
I20260709 13:13:38.643173  4332 raft_consensus.cc:1081] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 LEADER]: Signalling peer 1876270ba3074bcab9ec1d8e5df63ae7 to start an election
I20260709 13:13:38.645010  4124 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e"
dest_uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
 from {username='slave'} at 127.0.0.1:40848
I20260709 13:13:38.646836  4124 raft_consensus.cc:493] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:38.647244  4124 raft_consensus.cc:3060] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.649592  4320 consensus_queue.cc:1048] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:38.654026  4124 raft_consensus.cc:515] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.659802  4124 leader_election.cc:290] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 2 election: Requested vote from peers 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66:36143), aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67:39625)
I20260709 13:13:38.660548  4200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f2d94994b154e6aad0b4404297d3aa0"
I20260709 13:13:38.660778  4274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04f1f1492d8946b5a1171aa84fdcd41e" candidate_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
I20260709 13:13:38.661207  4200 raft_consensus.cc:3055] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:38.661437  4274 raft_consensus.cc:3060] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.661580  4200 raft_consensus.cc:740] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8f2d94994b154e6aad0b4404297d3aa0, State: Running, Role: LEADER
I20260709 13:13:38.662539  4200 consensus_queue.cc:260] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.663894  4200 raft_consensus.cc:3060] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:38.668062  4274 raft_consensus.cc:2468] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 2.
I20260709 13:13:38.669239  4200 raft_consensus.cc:2468] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1876270ba3074bcab9ec1d8e5df63ae7 in term 2.
I20260709 13:13:38.669255  4091 leader_election.cc:304] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1876270ba3074bcab9ec1d8e5df63ae7, aab83de0a1a74f80bf7b15d29ea97ded; no voters: 
I20260709 13:13:38.670442  4322 raft_consensus.cc:2804] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:38.670910  4322 raft_consensus.cc:697] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 LEADER]: Becoming Leader. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Running, Role: LEADER
I20260709 13:13:38.671705  4322 consensus_queue.cc:237] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:38.678258  4020 catalog_manager.cc:5697] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 reported cstate change: term changed from 1 to 2, leader changed from 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66) to 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:38.703282 28565 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:13:38.705652 28565 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:13:38.706228 28565 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:13:38.721277  4124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0"
dest_uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
mode: GRACEFUL
new_leader_uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
 from {username='slave'} at 127.0.0.1:40864
I20260709 13:13:38.721812  4124 raft_consensus.cc:606] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 LEADER]: Received request to transfer leadership to TS aab83de0a1a74f80bf7b15d29ea97ded
I20260709 13:13:38.723028 28565 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:13:39.067030  4274 raft_consensus.cc:1275] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 2 FOLLOWER]: Refusing update from remote peer 1876270ba3074bcab9ec1d8e5df63ae7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.068262  4322 consensus_queue.cc:1048] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.075677  4200 raft_consensus.cc:1275] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 2 FOLLOWER]: Refusing update from remote peer 1876270ba3074bcab9ec1d8e5df63ae7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:39.077693  4355 consensus_queue.cc:1048] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:39.159576  4329 raft_consensus.cc:993] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7: : Instructing follower aab83de0a1a74f80bf7b15d29ea97ded to start an election
I20260709 13:13:39.159987  4355 raft_consensus.cc:1081] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 LEADER]: Signalling peer aab83de0a1a74f80bf7b15d29ea97ded to start an election
I20260709 13:13:39.161417  4274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0"
dest_uuid: "aab83de0a1a74f80bf7b15d29ea97ded"
 from {username='slave'} at 127.0.0.1:42332
I20260709 13:13:39.161990  4274 raft_consensus.cc:493] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:39.162283  4274 raft_consensus.cc:3060] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.167199  4274 raft_consensus.cc:515] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:39.169203  4274 leader_election.cc:290] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [CANDIDATE]: Term 2 election: Requested vote from peers 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65:38621), 8f2d94994b154e6aad0b4404297d3aa0 (127.27.229.66:36143)
I20260709 13:13:39.181704  4200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0" candidate_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8f2d94994b154e6aad0b4404297d3aa0"
I20260709 13:13:39.181945  4124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71a461b46674376af80f40ab94d6af0" candidate_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1876270ba3074bcab9ec1d8e5df63ae7"
I20260709 13:13:39.182276  4200 raft_consensus.cc:3060] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.182583  4124 raft_consensus.cc:3055] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:39.182956  4124 raft_consensus.cc:740] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1876270ba3074bcab9ec1d8e5df63ae7, State: Running, Role: LEADER
I20260709 13:13:39.183709  4124 consensus_queue.cc:260] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:39.184754  4124 raft_consensus.cc:3060] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:39.187949  4200 raft_consensus.cc:2468] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aab83de0a1a74f80bf7b15d29ea97ded in term 2.
I20260709 13:13:39.189167  4239 leader_election.cc:304] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f2d94994b154e6aad0b4404297d3aa0, aab83de0a1a74f80bf7b15d29ea97ded; no voters: 
I20260709 13:13:39.189905  4321 raft_consensus.cc:2804] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:39.189867  4124 raft_consensus.cc:2468] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aab83de0a1a74f80bf7b15d29ea97ded in term 2.
I20260709 13:13:39.191226  4321 raft_consensus.cc:697] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 2 LEADER]: Becoming Leader. State: Replica: aab83de0a1a74f80bf7b15d29ea97ded, State: Running, Role: LEADER
I20260709 13:13:39.192112  4321 consensus_queue.cc:237] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } }
I20260709 13:13:39.197783  4020 catalog_manager.cc:5697] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded reported cstate change: term changed from 1 to 2, leader changed from 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65) to aab83de0a1a74f80bf7b15d29ea97ded (127.27.229.67). New cstate: current_term: 2 leader_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1876270ba3074bcab9ec1d8e5df63ae7" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 38621 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f2d94994b154e6aad0b4404297d3aa0" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 36143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aab83de0a1a74f80bf7b15d29ea97ded" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 39625 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:39.337266 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
I20260709 13:13:39.355968 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:39.356546 28565 tablet_replica.cc:333] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7: stopping tablet replica
I20260709 13:13:39.357090 28565 raft_consensus.cc:2243] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.357892 28565 raft_consensus.cc:2272] T 04f1f1492d8946b5a1171aa84fdcd41e P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.360159 28565 tablet_replica.cc:333] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7: stopping tablet replica
I20260709 13:13:39.360674 28565 raft_consensus.cc:2243] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.361047 28565 raft_consensus.cc:2272] T f71a461b46674376af80f40ab94d6af0 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.363451 28565 tablet_replica.cc:333] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7: stopping tablet replica
I20260709 13:13:39.364166 28565 raft_consensus.cc:2243] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.365185 28565 raft_consensus.cc:2272] T 5edc539f479540008d4d7e70ab56cab3 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:39.366642  4166 consensus_peers.cc:597] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 -> Peer 1876270ba3074bcab9ec1d8e5df63ae7 (127.27.229.65:38621): Couldn't send request to peer 1876270ba3074bcab9ec1d8e5df63ae7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:39.367525 28565 tablet_replica.cc:333] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7: stopping tablet replica
I20260709 13:13:39.368124 28565 raft_consensus.cc:2243] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.368542 28565 raft_consensus.cc:2272] T 72f0d2cf9f624a5095798a51276baf25 P 1876270ba3074bcab9ec1d8e5df63ae7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.391633 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
I20260709 13:13:39.403609 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
I20260709 13:13:39.421558 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:39.422247 28565 tablet_replica.cc:333] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0: stopping tablet replica
I20260709 13:13:39.422824 28565 raft_consensus.cc:2243] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.423300 28565 raft_consensus.cc:2272] T 04f1f1492d8946b5a1171aa84fdcd41e P 8f2d94994b154e6aad0b4404297d3aa0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.425382 28565 tablet_replica.cc:333] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0: stopping tablet replica
I20260709 13:13:39.425884 28565 raft_consensus.cc:2243] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.426681 28565 raft_consensus.cc:2272] T 72f0d2cf9f624a5095798a51276baf25 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.428534 28565 tablet_replica.cc:333] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0: stopping tablet replica
I20260709 13:13:39.429009 28565 raft_consensus.cc:2243] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.429387 28565 raft_consensus.cc:2272] T f71a461b46674376af80f40ab94d6af0 P 8f2d94994b154e6aad0b4404297d3aa0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.431532 28565 tablet_replica.cc:333] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0: stopping tablet replica
I20260709 13:13:39.431985 28565 raft_consensus.cc:2243] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.432389 28565 raft_consensus.cc:2272] T 5edc539f479540008d4d7e70ab56cab3 P 8f2d94994b154e6aad0b4404297d3aa0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.444425 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
I20260709 13:13:39.456012 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
I20260709 13:13:39.472463 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:39.473034 28565 tablet_replica.cc:333] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded: stopping tablet replica
I20260709 13:13:39.473562 28565 raft_consensus.cc:2243] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.474076 28565 raft_consensus.cc:2272] T 04f1f1492d8946b5a1171aa84fdcd41e P aab83de0a1a74f80bf7b15d29ea97ded [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.476223 28565 tablet_replica.cc:333] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: stopping tablet replica
I20260709 13:13:39.476737 28565 raft_consensus.cc:2243] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.477312 28565 pending_rounds.cc:70] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: Trying to abort 1 pending ops.
I20260709 13:13:39.477473 28565 pending_rounds.cc:77] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305637147417952256 op_type: NO_OP noop_request { }
I20260709 13:13:39.477748 28565 raft_consensus.cc:2889] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:39.478034 28565 raft_consensus.cc:2272] T f71a461b46674376af80f40ab94d6af0 P aab83de0a1a74f80bf7b15d29ea97ded [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.480463 28565 tablet_replica.cc:333] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded: stopping tablet replica
I20260709 13:13:39.480950 28565 raft_consensus.cc:2243] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.481336 28565 raft_consensus.cc:2272] T 5edc539f479540008d4d7e70ab56cab3 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.483325 28565 tablet_replica.cc:333] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded: stopping tablet replica
I20260709 13:13:39.483773 28565 raft_consensus.cc:2243] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:39.484184 28565 raft_consensus.cc:2272] T 72f0d2cf9f624a5095798a51276baf25 P aab83de0a1a74f80bf7b15d29ea97ded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.495569 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
I20260709 13:13:39.507014 28565 master.cc:562] Master@127.27.229.126:34783 shutting down...
I20260709 13:13:39.521863 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:39.522460 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:39.522774 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P c3fe66523bc1489d86e3ee87d64e7cfd: stopping tablet replica
I20260709 13:13:39.540771 28565 master.cc:584] Master@127.27.229.126:34783 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2683 ms)
[----------] 6 tests from LeaderRebalancerTest (234439 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:13:39.568356 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:41665
I20260709 13:13:39.569489 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.574435  4373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.574435  4372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.576056  4375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.577425 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:39.578289 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.578482 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.578634 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602819578606 us; error 0 us; skew 500 ppm
I20260709 13:13:39.579141 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.581537 28565 webserver.cc:533] Webserver started at http://127.27.229.126:38961/ using document root <none> and password file <none>
I20260709 13:13:39.582069 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.582264 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.582530 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.583573 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "9e5d5b965b8840bd8dd12844f982a112"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.588065 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:13:39.591514  4380 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.592264 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:39.592561 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "9e5d5b965b8840bd8dd12844f982a112"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.592823 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:39.613080 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:39.614120 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:39.648597 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:41665
I20260709 13:13:39.648700  4431 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:41665 every 8 connection(s)
I20260709 13:13:39.652398  4432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:39.663203  4432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112: Bootstrap starting.
I20260709 13:13:39.667840  4432 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:39.671933  4432 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112: No bootstrap required, opened a new log
I20260709 13:13:39.674000  4432 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e5d5b965b8840bd8dd12844f982a112" member_type: VOTER }
I20260709 13:13:39.674412  4432 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:39.674592  4432 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e5d5b965b8840bd8dd12844f982a112, State: Initialized, Role: FOLLOWER
I20260709 13:13:39.675076  4432 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e5d5b965b8840bd8dd12844f982a112" member_type: VOTER }
I20260709 13:13:39.675520  4432 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:39.675711  4432 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:39.675940  4432 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:39.680830  4432 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e5d5b965b8840bd8dd12844f982a112" member_type: VOTER }
I20260709 13:13:39.681344  4432 leader_election.cc:304] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e5d5b965b8840bd8dd12844f982a112; no voters: 
I20260709 13:13:39.682432  4432 leader_election.cc:290] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:39.682741  4435 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:39.684173  4435 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 1 LEADER]: Becoming Leader. State: Replica: 9e5d5b965b8840bd8dd12844f982a112, State: Running, Role: LEADER
I20260709 13:13:39.684752  4435 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e5d5b965b8840bd8dd12844f982a112" member_type: VOTER }
I20260709 13:13:39.685252  4432 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:39.687680  4436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e5d5b965b8840bd8dd12844f982a112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e5d5b965b8840bd8dd12844f982a112" member_type: VOTER } }
I20260709 13:13:39.687753  4437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e5d5b965b8840bd8dd12844f982a112. Latest consensus state: current_term: 1 leader_uuid: "9e5d5b965b8840bd8dd12844f982a112" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e5d5b965b8840bd8dd12844f982a112" member_type: VOTER } }
I20260709 13:13:39.688441  4436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:39.688899  4437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:39.691815  4441 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:39.698877  4441 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:39.702126 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:39.709120  4441 catalog_manager.cc:1383] Generated new cluster ID: 15a8fc712c104e6087fde41c7e8dec4d
I20260709 13:13:39.709438  4441 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:39.735255  4441 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:39.736472  4441 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:39.752290  4441 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112: Generated new TSK 0
I20260709 13:13:39.752851  4441 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:39.768399 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.774327  4453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.775594  4454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.776396  4456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.776867 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:39.777712 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.777909 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.778112 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602819778093 us; error 0 us; skew 500 ppm
I20260709 13:13:39.778640 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.780941 28565 webserver.cc:533] Webserver started at http://127.27.229.65:36319/ using document root <none> and password file <none>
I20260709 13:13:39.781416 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.781630 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.781891 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.783015 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "59324aad473f43b6afa1dd69094a82d9"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.787573 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:13:39.790943  4461 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.791733 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:39.792007 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "59324aad473f43b6afa1dd69094a82d9"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.792251 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:39.805961 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:39.807082 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:39.808460 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:39.810748 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:39.810945 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.811205 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:39.811348 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.849179 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:44795
I20260709 13:13:39.849283  4523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:44795 every 8 connection(s)
I20260709 13:13:39.853820 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.860949  4528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.862015  4529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.863785  4531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.864601 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:39.866447 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.866663 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.866824 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602819866808 us; error 0 us; skew 500 ppm
I20260709 13:13:39.867414  4524 heartbeater.cc:344] Connected to a master server at 127.27.229.126:41665
I20260709 13:13:39.867488 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.867875  4524 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:39.868690  4524 heartbeater.cc:507] Master 127.27.229.126:41665 requested a full tablet report, sending...
I20260709 13:13:39.870360 28565 webserver.cc:533] Webserver started at http://127.27.229.66:46321/ using document root <none> and password file <none>
I20260709 13:13:39.871088 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.870981  4397 ts_manager.cc:194] Registered new tserver with Master: 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795)
I20260709 13:13:39.871469 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.871826 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.873271 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.873567  4397 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35740
I20260709 13:13:39.878140 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:39.881716  4536 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.882587 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:39.882879 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.883149 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:39.897022 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:39.898142 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:39.899504 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:39.901714 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:39.901935 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.902173 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:39.902320 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.940080 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:33263
I20260709 13:13:39.940179  4598 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:33263 every 8 connection(s)
I20260709 13:13:39.944804 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:39.951169  4602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.952296  4603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:39.955334  4605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:39.956316 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:39.956218  4599 heartbeater.cc:344] Connected to a master server at 127.27.229.126:41665
I20260709 13:13:39.957015  4599 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:39.957579 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:39.957895 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:39.957973  4599 heartbeater.cc:507] Master 127.27.229.126:41665 requested a full tablet report, sending...
I20260709 13:13:39.958185 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602819958164 us; error 0 us; skew 500 ppm
I20260709 13:13:39.959038 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:39.960546  4397 ts_manager.cc:194] Registered new tserver with Master: d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:39.961633 28565 webserver.cc:533] Webserver started at http://127.27.229.67:42893/ using document root <none> and password file <none>
I20260709 13:13:39.962215 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:39.962193  4397 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35742
I20260709 13:13:39.962597 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:39.962882 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:39.964010 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "0858cdfc2547473c99e557330fa1ddaa"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.968335 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:13:39.971720  4610 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:39.972448 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:13:39.972743 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "0858cdfc2547473c99e557330fa1ddaa"
format_stamp: "Formatted at 2026-07-09 13:13:39 on dist-test-slave-twc1"
I20260709 13:13:39.973026 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:40.002982 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:40.004070 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:40.005501 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:40.007776 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:40.008001 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:40.008220 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:40.008368 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:40.045791 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:33723
I20260709 13:13:40.045907  4672 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:33723 every 8 connection(s)
I20260709 13:13:40.058995  4673 heartbeater.cc:344] Connected to a master server at 127.27.229.126:41665
I20260709 13:13:40.059453  4673 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:40.060175  4673 heartbeater.cc:507] Master 127.27.229.126:41665 requested a full tablet report, sending...
I20260709 13:13:40.062086  4397 ts_manager.cc:194] Registered new tserver with Master: 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.062554 28565 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013560695s
I20260709 13:13:40.063427  4397 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35752
I20260709 13:13:40.087457  4397 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35760:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:40.090013  4397 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:40.155923  4489 tablet_service.cc:1511] Processing CreateTablet for tablet ea459e87d00644419a36f8872ae4078c (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:40.155923  4488 tablet_service.cc:1511] Processing CreateTablet for tablet 83fce1e7194f4a25b5dcfa67bcca3bc5 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:40.157507  4489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea459e87d00644419a36f8872ae4078c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.157718  4638 tablet_service.cc:1511] Processing CreateTablet for tablet ea459e87d00644419a36f8872ae4078c (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:40.159073  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea459e87d00644419a36f8872ae4078c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.160214  4637 tablet_service.cc:1511] Processing CreateTablet for tablet 83fce1e7194f4a25b5dcfa67bcca3bc5 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:40.161572  4637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fce1e7194f4a25b5dcfa67bcca3bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.156056  4487 tablet_service.cc:1511] Processing CreateTablet for tablet 90d9414d059e4a8a8b699a0a45e434f1 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:40.163333  4487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d9414d059e4a8a8b699a0a45e434f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.164650  4635 tablet_service.cc:1511] Processing CreateTablet for tablet ebe00d12d3da4a6bbbfb207dbbd86b2f (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:40.166111  4635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe00d12d3da4a6bbbfb207dbbd86b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.166276  4488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fce1e7194f4a25b5dcfa67bcca3bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.158944  4636 tablet_service.cc:1511] Processing CreateTablet for tablet 90d9414d059e4a8a8b699a0a45e434f1 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:40.169317  4636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d9414d059e4a8a8b699a0a45e434f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.168646  4634 tablet_service.cc:1511] Processing CreateTablet for tablet 419cf52b840c4905a2643a40bbff51e9 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:40.162943  4486 tablet_service.cc:1511] Processing CreateTablet for tablet ebe00d12d3da4a6bbbfb207dbbd86b2f (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:40.170781  4486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe00d12d3da4a6bbbfb207dbbd86b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.174731  4633 tablet_service.cc:1511] Processing CreateTablet for tablet b9d2295fe5ef4121b5e5008c1ed29b7b (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:40.179111  4485 tablet_service.cc:1511] Processing CreateTablet for tablet 419cf52b840c4905a2643a40bbff51e9 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:40.180827  4485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419cf52b840c4905a2643a40bbff51e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.182619  4632 tablet_service.cc:1511] Processing CreateTablet for tablet 5d46235579ed4b40abf4ebadfcdb3e31 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:40.187160  4631 tablet_service.cc:1511] Processing CreateTablet for tablet 49bd3a8a37594b6f8ebee90240db8a21 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:40.185565  4484 tablet_service.cc:1511] Processing CreateTablet for tablet b9d2295fe5ef4121b5e5008c1ed29b7b (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:40.189592  4484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d2295fe5ef4121b5e5008c1ed29b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.192795  4630 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbd9bc437a747c384b5227ae8a1c544 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:40.194622  4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419cf52b840c4905a2643a40bbff51e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.199164  4633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d2295fe5ef4121b5e5008c1ed29b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.200945  4630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbd9bc437a747c384b5227ae8a1c544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.202664  4631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bd3a8a37594b6f8ebee90240db8a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.205313  4632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d46235579ed4b40abf4ebadfcdb3e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.207641  4483 tablet_service.cc:1511] Processing CreateTablet for tablet 5d46235579ed4b40abf4ebadfcdb3e31 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:40.209317  4483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d46235579ed4b40abf4ebadfcdb3e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.272464  4482 tablet_service.cc:1511] Processing CreateTablet for tablet 49bd3a8a37594b6f8ebee90240db8a21 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:40.278666  4482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bd3a8a37594b6f8ebee90240db8a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.290648  4688 tablet_bootstrap.cc:492] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.303083  4487 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbd9bc437a747c384b5227ae8a1c544 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:40.304441  4564 tablet_service.cc:1511] Processing CreateTablet for tablet ea459e87d00644419a36f8872ae4078c (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:40.305907  4564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea459e87d00644419a36f8872ae4078c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.307051  4563 tablet_service.cc:1511] Processing CreateTablet for tablet 83fce1e7194f4a25b5dcfa67bcca3bc5 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:40.316928  4563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83fce1e7194f4a25b5dcfa67bcca3bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.308233  4562 tablet_service.cc:1511] Processing CreateTablet for tablet 90d9414d059e4a8a8b699a0a45e434f1 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:40.319562  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d9414d059e4a8a8b699a0a45e434f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.309340  4561 tablet_service.cc:1511] Processing CreateTablet for tablet ebe00d12d3da4a6bbbfb207dbbd86b2f (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:40.322002  4561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe00d12d3da4a6bbbfb207dbbd86b2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.310444  4560 tablet_service.cc:1511] Processing CreateTablet for tablet 419cf52b840c4905a2643a40bbff51e9 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:40.324539  4560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419cf52b840c4905a2643a40bbff51e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.311632  4559 tablet_service.cc:1511] Processing CreateTablet for tablet b9d2295fe5ef4121b5e5008c1ed29b7b (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:40.326972  4559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d2295fe5ef4121b5e5008c1ed29b7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.312783  4558 tablet_service.cc:1511] Processing CreateTablet for tablet 5d46235579ed4b40abf4ebadfcdb3e31 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:40.329365  4558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d46235579ed4b40abf4ebadfcdb3e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.314127  4557 tablet_service.cc:1511] Processing CreateTablet for tablet 49bd3a8a37594b6f8ebee90240db8a21 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:40.331405  4557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bd3a8a37594b6f8ebee90240db8a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.334074  4556 tablet_service.cc:1511] Processing CreateTablet for tablet 7cbd9bc437a747c384b5227ae8a1c544 (DEFAULT_TABLE table=test-workload [id=4206beb4259d4bbc9abf3c5d97530fab]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:40.335438  4556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbd9bc437a747c384b5227ae8a1c544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.354041  4688 tablet_bootstrap.cc:654] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.304538  4487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cbd9bc437a747c384b5227ae8a1c544. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:40.379671  4688 tablet_bootstrap.cc:492] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.380492  4688 ts_tablet_manager.cc:1403] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.090s	user 0.006s	sys 0.006s
I20260709 13:13:40.384066  4688 raft_consensus.cc:359] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.385002  4688 raft_consensus.cc:385] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.385332  4688 raft_consensus.cc:740] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.386206  4688 consensus_queue.cc:260] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.389248  4688 ts_tablet_manager.cc:1434] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:40.390497  4688 tablet_bootstrap.cc:492] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.394184  4524 heartbeater.cc:499] Master 127.27.229.126:41665 was elected leader, sending a full tablet report...
I20260709 13:13:40.397120  4688 tablet_bootstrap.cc:654] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.446762  4693 tablet_bootstrap.cc:492] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:40.463517  4693 tablet_bootstrap.cc:654] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.479460  4689 tablet_bootstrap.cc:492] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.485066  4688 tablet_bootstrap.cc:492] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.485599  4688 ts_tablet_manager.cc:1403] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.095s	user 0.036s	sys 0.057s
I20260709 13:13:40.486308  4693 tablet_bootstrap.cc:492] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:40.486894  4693 ts_tablet_manager.cc:1403] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.012s
I20260709 13:13:40.487738  4689 tablet_bootstrap.cc:654] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.488021  4688 raft_consensus.cc:359] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.488648  4688 raft_consensus.cc:385] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.488885  4688 raft_consensus.cc:740] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.489568  4688 consensus_queue.cc:260] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.491693  4688 ts_tablet_manager.cc:1434] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.007s
I20260709 13:13:40.489830  4693 raft_consensus.cc:359] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.492486  4693 raft_consensus.cc:385] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.492604  4688 tablet_bootstrap.cc:492] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.492865  4689 tablet_bootstrap.cc:492] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.492820  4693 raft_consensus.cc:740] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.493512  4689 ts_tablet_manager.cc:1403] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:13:40.494033  4693 consensus_queue.cc:260] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.496855  4689 raft_consensus.cc:359] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.497749  4689 raft_consensus.cc:385] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.498077  4689 raft_consensus.cc:740] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.498914  4689 consensus_queue.cc:260] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.499734  4688 tablet_bootstrap.cc:654] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.506155  4599 heartbeater.cc:499] Master 127.27.229.126:41665 was elected leader, sending a full tablet report...
I20260709 13:13:40.506692  4693 ts_tablet_manager.cc:1434] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 13:13:40.508013  4693 tablet_bootstrap.cc:492] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:40.511876  4688 tablet_bootstrap.cc:492] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.512518  4688 ts_tablet_manager.cc:1403] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:13:40.515421  4688 raft_consensus.cc:359] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.515960  4693 tablet_bootstrap.cc:654] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.516215  4688 raft_consensus.cc:385] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.516589  4688 raft_consensus.cc:740] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.516865  4673 heartbeater.cc:499] Master 127.27.229.126:41665 was elected leader, sending a full tablet report...
I20260709 13:13:40.517560  4688 consensus_queue.cc:260] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.520262  4688 ts_tablet_manager.cc:1434] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:40.516433  4689 ts_tablet_manager.cc:1434] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:13:40.521827  4688 tablet_bootstrap.cc:492] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.526306  4689 tablet_bootstrap.cc:492] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.528568  4688 tablet_bootstrap.cc:654] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.533612  4689 tablet_bootstrap.cc:654] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.540122  4688 tablet_bootstrap.cc:492] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.540670  4688 ts_tablet_manager.cc:1403] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:13:40.543473  4688 raft_consensus.cc:359] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.544252  4688 raft_consensus.cc:385] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.544564  4688 raft_consensus.cc:740] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.545943  4689 tablet_bootstrap.cc:492] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.545555  4688 consensus_queue.cc:260] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.546670  4689 ts_tablet_manager.cc:1403] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:13:40.550119  4688 ts_tablet_manager.cc:1434] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:13:40.549957  4689 raft_consensus.cc:359] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.550774  4689 raft_consensus.cc:385] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.551141  4689 raft_consensus.cc:740] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.551298  4688 tablet_bootstrap.cc:492] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.552119  4689 consensus_queue.cc:260] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.554839  4689 ts_tablet_manager.cc:1434] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:40.555900  4689 tablet_bootstrap.cc:492] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.557871  4688 tablet_bootstrap.cc:654] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.568691  4689 tablet_bootstrap.cc:654] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.570959  4688 tablet_bootstrap.cc:492] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.571650  4688 ts_tablet_manager.cc:1403] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.002s
I20260709 13:13:40.572137  4693 tablet_bootstrap.cc:492] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:40.572817  4693 ts_tablet_manager.cc:1403] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.043s
I20260709 13:13:40.574676  4688 raft_consensus.cc:359] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.575309  4688 raft_consensus.cc:385] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.575578  4688 raft_consensus.cc:740] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.575860  4693 raft_consensus.cc:359] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.576223  4688 consensus_queue.cc:260] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.576787  4693 raft_consensus.cc:385] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.577162  4693 raft_consensus.cc:740] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.578413  4688 ts_tablet_manager.cc:1434] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:40.578159  4693 consensus_queue.cc:260] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.580149  4688 tablet_bootstrap.cc:492] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.581357  4693 ts_tablet_manager.cc:1434] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:13:40.582527  4693 tablet_bootstrap.cc:492] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:40.587127  4688 tablet_bootstrap.cc:654] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.588361  4693 tablet_bootstrap.cc:654] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.591502  4696 raft_consensus.cc:493] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.592060  4696 raft_consensus.cc:515] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.593452  4689 tablet_bootstrap.cc:492] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.594023  4689 ts_tablet_manager.cc:1403] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.007s
I20260709 13:13:40.597174  4689 raft_consensus.cc:359] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.598400  4697 raft_consensus.cc:493] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.598606  4696 leader_election.cc:290] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.598990  4697 raft_consensus.cc:515] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.601856  4697 leader_election.cc:290] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:40.597944  4689 raft_consensus.cc:385] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.608094  4689 raft_consensus.cc:740] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.610157  4689 consensus_queue.cc:260] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.614274  4689 ts_tablet_manager.cc:1434] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:13:40.615471  4689 tablet_bootstrap.cc:492] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.622850  4691 raft_consensus.cc:493] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.623574  4691 raft_consensus.cc:515] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.630422  4691 leader_election.cc:290] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.650014  4691 raft_consensus.cc:493] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.650169  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:40.650635  4691 raft_consensus.cc:515] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.651010  4499 raft_consensus.cc:2468] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 0.
I20260709 13:13:40.654846  4693 tablet_bootstrap.cc:492] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:40.655181  4691 leader_election.cc:290] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.655453  4693 ts_tablet_manager.cc:1403] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.000s
I20260709 13:13:40.656471  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:40.657123  4689 tablet_bootstrap.cc:654] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.656404  4537 leader_election.cc:304] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
W20260709 13:13:40.658345  4613 leader_election.cc:343] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.659264  4696 raft_consensus.cc:2804] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.659689  4696 raft_consensus.cc:493] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.660028  4696 raft_consensus.cc:3060] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.668992  4696 raft_consensus.cc:515] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.671463  4693 raft_consensus.cc:359] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.672375  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:40.673172  4499 raft_consensus.cc:3060] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.682996  4688 tablet_bootstrap.cc:492] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.683645  4688 ts_tablet_manager.cc:1403] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.104s	user 0.048s	sys 0.050s
I20260709 13:13:40.683936  4696 leader_election.cc:290] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.683542  4499 raft_consensus.cc:2468] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 1.
I20260709 13:13:40.686002  4537 leader_election.cc:304] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:40.687781  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:40.688058  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:40.688251  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:40.686967  4688 raft_consensus.cc:359] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.689340  4688 raft_consensus.cc:385] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.689597  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:40.689674  4688 raft_consensus.cc:740] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
W20260709 13:13:40.689708  4463 leader_election.cc:343] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.690665  4689 tablet_bootstrap.cc:492] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
W20260709 13:13:40.691078  4463 leader_election.cc:343] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.691211  4689 ts_tablet_manager.cc:1403] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.011s
I20260709 13:13:40.690936  4688 consensus_queue.cc:260] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
W20260709 13:13:40.691776  4464 leader_election.cc:343] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.692209  4464 leader_election.cc:304] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9; no voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:40.672338  4693 raft_consensus.cc:385] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.694331  4693 raft_consensus.cc:740] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.695504  4689 raft_consensus.cc:359] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.696273  4689 raft_consensus.cc:385] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.696549  4688 ts_tablet_manager.cc:1434] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.007s
I20260709 13:13:40.696704  4693 consensus_queue.cc:260] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.697690  4688 tablet_bootstrap.cc:492] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.696563  4689 raft_consensus.cc:740] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.699055  4691 raft_consensus.cc:2749] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:13:40.697798  4445 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:40.700134  4689 consensus_queue.cc:260] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.702399  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:40.704361  4689 ts_tablet_manager.cc:1434] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:13:40.704703  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:40.705487  4689 tablet_bootstrap.cc:492] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.704993  4696 raft_consensus.cc:2804] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:40.706359  4538 leader_election.cc:343] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:13:40.707404  4538 leader_election.cc:343] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.707883  4688 tablet_bootstrap.cc:654] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.697763  4574 raft_consensus.cc:2468] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:40.711324  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:40.712636  4689 tablet_bootstrap.cc:654] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:40.713110  4611 leader_election.cc:343] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.713757  4611 leader_election.cc:304] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa; no voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:40.714722  4697 raft_consensus.cc:2749] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:40.716725  4464 leader_election.cc:304] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa
I20260709 13:13:40.718122  4691 raft_consensus.cc:2804] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.718564  4691 raft_consensus.cc:493] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.718894  4691 raft_consensus.cc:3060] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.725641  4689 tablet_bootstrap.cc:492] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.726336  4689 ts_tablet_manager.cc:1403] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:13:40.727845  4691 raft_consensus.cc:515] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.728516  4696 raft_consensus.cc:697] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:40.729627  4696 consensus_queue.cc:237] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.731411  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:40.729458  4689 raft_consensus.cc:359] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.732167  4574 raft_consensus.cc:3060] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.732427  4689 raft_consensus.cc:385] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.733376  4689 raft_consensus.cc:740] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.734175  4689 consensus_queue.cc:260] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.736476  4689 ts_tablet_manager.cc:1434] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:13:40.737476  4697 raft_consensus.cc:493] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.738057  4697 raft_consensus.cc:515] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.740149  4697 leader_election.cc:290] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:40.741807  4574 raft_consensus.cc:2468] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:40.743412  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:40.744258  4573 raft_consensus.cc:2468] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:40.737493  4689 tablet_bootstrap.cc:492] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.745322  4464 leader_election.cc:304] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:40.746591  4613 leader_election.cc:304] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:40.747555  4697 raft_consensus.cc:2804] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.747921  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:40.748728  4499 raft_consensus.cc:2468] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:40.747925  4697 raft_consensus.cc:493] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.750360  4697 raft_consensus.cc:3060] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.757113  4689 tablet_bootstrap.cc:654] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.755036  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:40.765602  4647 raft_consensus.cc:3060] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.767849  4697 raft_consensus.cc:515] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.771227  4688 tablet_bootstrap.cc:492] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.771816  4688 ts_tablet_manager.cc:1403] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.074s	user 0.031s	sys 0.026s
I20260709 13:13:40.772235  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:40.772974  4499 raft_consensus.cc:3060] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.754422  4691 leader_election.cc:290] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.774324  4691 raft_consensus.cc:2804] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.774801  4691 raft_consensus.cc:697] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:40.774916  4688 raft_consensus.cc:359] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.775758  4688 raft_consensus.cc:385] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.776149  4688 raft_consensus.cc:740] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.776929  4688 consensus_queue.cc:260] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.775718  4691 consensus_queue.cc:237] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.779290  4688 ts_tablet_manager.cc:1434] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:40.780341  4688 tablet_bootstrap.cc:492] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.781780  4499 raft_consensus.cc:2468] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:40.787295  4647 raft_consensus.cc:2468] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:40.789829  4611 leader_election.cc:304] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:40.783675  4693 ts_tablet_manager.cc:1434] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.128s	user 0.015s	sys 0.030s
I20260709 13:13:40.784687  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:40.792307  4574 raft_consensus.cc:3060] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.791690  4397 catalog_manager.cc:5697] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.787950  4688 tablet_bootstrap.cc:654] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.789126  4689 tablet_bootstrap.cc:492] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.799853  4689 ts_tablet_manager.cc:1403] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.015s
I20260709 13:13:40.803014  4395 catalog_manager.cc:5697] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:40.803617  4689 raft_consensus.cc:359] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.804610  4689 raft_consensus.cc:385] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.804952  4689 raft_consensus.cc:740] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.788887  4697 leader_election.cc:290] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:40.806749  4693 tablet_bootstrap.cc:492] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:40.805840  4689 consensus_queue.cc:260] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.809154  4574 raft_consensus.cc:2468] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:40.809811  4689 ts_tablet_manager.cc:1434] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:40.811065  4689 tablet_bootstrap.cc:492] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.806710  4697 raft_consensus.cc:2804] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.820598  4689 tablet_bootstrap.cc:654] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.832197  4693 tablet_bootstrap.cc:654] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.837643  4688 tablet_bootstrap.cc:492] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.838387  4688 ts_tablet_manager.cc:1403] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.004s
W20260709 13:13:40.839406  4611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:44795, user_credentials={real_user=slave}} blocked reactor thread for 49658.3us
I20260709 13:13:40.839152  4697 raft_consensus.cc:697] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:40.841143  4697 consensus_queue.cc:237] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.842447  4688 raft_consensus.cc:359] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.843222  4688 raft_consensus.cc:385] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.843497  4688 raft_consensus.cc:740] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.844091  4688 consensus_queue.cc:260] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.847231  4688 ts_tablet_manager.cc:1434] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:40.849828  4724 raft_consensus.cc:493] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.850464  4724 raft_consensus.cc:515] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.853058  4724 leader_election.cc:290] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:40.854454  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:40.854790  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:40.855600  4499 raft_consensus.cc:2468] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:40.857147  4611 leader_election.cc:304] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
W20260709 13:13:40.858299  4613 leader_election.cc:343] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.859275  4724 raft_consensus.cc:2804] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.859787  4724 raft_consensus.cc:493] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.860169  4688 tablet_bootstrap.cc:492] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:40.862607  4689 tablet_bootstrap.cc:492] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.863277  4689 ts_tablet_manager.cc:1403] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.018s
I20260709 13:13:40.860176  4724 raft_consensus.cc:3060] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.866863  4689 raft_consensus.cc:359] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.867951  4689 raft_consensus.cc:385] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.868273  4689 raft_consensus.cc:740] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.868400  4693 tablet_bootstrap.cc:492] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:40.869037  4693 ts_tablet_manager.cc:1403] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.002s
I20260709 13:13:40.869266  4689 consensus_queue.cc:260] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:40.872193  4689 ts_tablet_manager.cc:1434] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:13:40.872303  4693 raft_consensus.cc:359] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.873320  4693 raft_consensus.cc:385] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.873420  4689 tablet_bootstrap.cc:492] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.873757  4693 raft_consensus.cc:740] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.874754  4693 consensus_queue.cc:260] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.876956  4693 ts_tablet_manager.cc:1434] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:40.879405  4688 tablet_bootstrap.cc:654] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.880162  4693 tablet_bootstrap.cc:492] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:40.882508  4689 tablet_bootstrap.cc:654] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.887835  4689 tablet_bootstrap.cc:492] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.888263  4689 ts_tablet_manager.cc:1403] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:13:40.888516  4724 raft_consensus.cc:515] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.890278  4689 raft_consensus.cc:359] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.891023  4689 raft_consensus.cc:385] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.891310  4689 raft_consensus.cc:740] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.890739  4724 leader_election.cc:290] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:40.891937  4689 consensus_queue.cc:260] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.892263  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:40.894229  4689 ts_tablet_manager.cc:1434] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:13:40.894954  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:40.895265  4689 tablet_bootstrap.cc:492] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:40.892647  4396 catalog_manager.cc:5697] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
W20260709 13:13:40.895947  4613 leader_election.cc:343] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.896624  4499 raft_consensus.cc:3060] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.901449  4689 tablet_bootstrap.cc:654] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.905263  4693 tablet_bootstrap.cc:654] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.909627  4499 raft_consensus.cc:2468] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:40.910377  4691 raft_consensus.cc:493] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.911010  4691 raft_consensus.cc:515] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.911367  4611 leader_election.cc:304] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:40.911554  4688 tablet_bootstrap.cc:492] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:40.912245  4688 ts_tablet_manager.cc:1403] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.015s
I20260709 13:13:40.914156  4724 raft_consensus.cc:2804] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.914808  4724 raft_consensus.cc:697] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:40.915616  4688 raft_consensus.cc:359] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.916577  4688 raft_consensus.cc:385] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.916917  4688 raft_consensus.cc:740] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.917534  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:40.918092  4688 consensus_queue.cc:260] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
W20260709 13:13:40.919157  4464 leader_election.cc:343] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.915731  4724 consensus_queue.cc:237] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.924424  4691 leader_election.cc:290] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.918054  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:40.925519  4647 raft_consensus.cc:2468] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:40.927270  4463 leader_election.cc:304] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:40.928680  4691 raft_consensus.cc:2804] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.929126  4691 raft_consensus.cc:493] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.929471  4691 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.932137  4688 ts_tablet_manager.cc:1434] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:13:40.939549  4721 raft_consensus.cc:493] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:40.940249  4721 raft_consensus.cc:515] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.941131  4691 raft_consensus.cc:515] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.943346  4691 leader_election.cc:290] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.944106  4693 tablet_bootstrap.cc:492] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:40.944721  4693 ts_tablet_manager.cc:1403] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.012s
I20260709 13:13:40.946398  4689 tablet_bootstrap.cc:492] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:40.946950  4689 ts_tablet_manager.cc:1403] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.052s	user 0.031s	sys 0.012s
I20260709 13:13:40.947227  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:40.947899  4648 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.947480  4693 raft_consensus.cc:359] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.948387  4693 raft_consensus.cc:385] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.948273  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
W20260709 13:13:40.949954  4463 leader_election.cc:343] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.950187  4693 raft_consensus.cc:740] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.950264  4689 raft_consensus.cc:359] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.951205  4689 raft_consensus.cc:385] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.950944  4693 consensus_queue.cc:260] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.951474  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:40.951545  4689 raft_consensus.cc:740] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.951857  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:40.952256  4574 raft_consensus.cc:2468] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:40.952716  4689 consensus_queue.cc:260] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.953393  4693 ts_tablet_manager.cc:1434] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
W20260709 13:13:40.954209  4464 leader_election.cc:343] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:40.955047  4464 leader_election.cc:304] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa
I20260709 13:13:40.955211  4689 ts_tablet_manager.cc:1434] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:40.956035  4691 raft_consensus.cc:2804] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:40.956424  4691 raft_consensus.cc:493] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:40.956775  4691 raft_consensus.cc:3060] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.957193  4693 tablet_bootstrap.cc:492] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:40.959290  4721 leader_election.cc:290] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.962152  4648 raft_consensus.cc:2468] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:40.963483  4463 leader_election.cc:304] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:40.964745  4721 raft_consensus.cc:2804] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.964874  4691 raft_consensus.cc:515] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.965381  4693 tablet_bootstrap.cc:654] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:40.968118  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:40.968329  4691 leader_election.cc:290] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:40.968760  4574 raft_consensus.cc:3060] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.969280  4395 catalog_manager.cc:5697] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:40.976207  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:40.977049  4648 raft_consensus.cc:3060] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:40.979108  4721 raft_consensus.cc:697] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:40.980075  4721 consensus_queue.cc:237] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.983295  4693 tablet_bootstrap.cc:492] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:40.983945  4693 ts_tablet_manager.cc:1403] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 13:13:40.987345  4693 raft_consensus.cc:359] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.987969  4693 raft_consensus.cc:385] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:40.988202  4693 raft_consensus.cc:740] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:40.988812  4693 consensus_queue.cc:260] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.989009  4574 raft_consensus.cc:2468] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:40.990542  4464 leader_election.cc:304] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:40.990909  4693 ts_tablet_manager.cc:1434] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:40.992105  4693 tablet_bootstrap.cc:492] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:40.992147  4738 raft_consensus.cc:2804] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:40.992818  4738 raft_consensus.cc:697] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:40.993738  4738 consensus_queue.cc:237] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:40.998795  4648 raft_consensus.cc:2468] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:40.999557  4693 tablet_bootstrap.cc:654] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.008765  4693 tablet_bootstrap.cc:492] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:41.009472  4693 ts_tablet_manager.cc:1403] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:13:41.012676  4693 raft_consensus.cc:359] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.013343  4693 raft_consensus.cc:385] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.013590  4693 raft_consensus.cc:740] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.014284  4693 consensus_queue.cc:260] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.015976  4693 ts_tablet_manager.cc:1434] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:41.017001  4693 tablet_bootstrap.cc:492] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:41.016250  4396 catalog_manager.cc:5697] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.023929  4693 tablet_bootstrap.cc:654] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.029065  4693 tablet_bootstrap.cc:492] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:41.029500  4693 ts_tablet_manager.cc:1403] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 13:13:41.030844  4397 catalog_manager.cc:5697] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.031411  4693 raft_consensus.cc:359] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.032020  4693 raft_consensus.cc:385] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.032222  4693 raft_consensus.cc:740] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.032819  4693 consensus_queue.cc:260] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.034312  4693 ts_tablet_manager.cc:1434] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:13:41.035063  4693 tablet_bootstrap.cc:492] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:41.040546  4693 tablet_bootstrap.cc:654] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:41.042953  4721 raft_consensus.cc:493] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.043589  4721 raft_consensus.cc:515] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.045048  4693 tablet_bootstrap.cc:492] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:41.045568  4693 ts_tablet_manager.cc:1403] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:13:41.046942  4721 leader_election.cc:290] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.047153  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:41.047786  4574 raft_consensus.cc:2468] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:41.048010  4693 raft_consensus.cc:359] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.048674  4693 raft_consensus.cc:385] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:41.048938  4693 raft_consensus.cc:740] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:41.048781  4464 leader_election.cc:304] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:41.049480  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:41.049815  4721 raft_consensus.cc:2804] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:41.049759  4693 consensus_queue.cc:260] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.050336  4721 raft_consensus.cc:493] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.050200  4648 raft_consensus.cc:2468] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:41.050645  4721 raft_consensus.cc:3060] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.051986  4693 ts_tablet_manager.cc:1434] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:13:41.056587  4721 raft_consensus.cc:515] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.058451  4721 leader_election.cc:290] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.059564  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:41.059499  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.060320  4574 raft_consensus.cc:3060] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.060376  4648 raft_consensus.cc:3060] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.068041  4574 raft_consensus.cc:2468] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:41.068041  4648 raft_consensus.cc:2468] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:41.069280  4463 leader_election.cc:304] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:41.069968  4721 raft_consensus.cc:2804] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.070446  4721 raft_consensus.cc:697] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:41.071223  4721 consensus_queue.cc:237] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.078322  4396 catalog_manager.cc:5697] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.213478  4696 consensus_queue.cc:1048] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.223650  4648 raft_consensus.cc:3060] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.231704  4721 consensus_queue.cc:1048] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.232785  4716 consensus_queue.cc:1048] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:41.242283  4697 raft_consensus.cc:493] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.242791  4697 raft_consensus.cc:515] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.244968  4697 leader_election.cc:290] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:41.245090  4721 consensus_queue.cc:1048] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.246690  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbd9bc437a747c384b5227ae8a1c544" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:41.247323  4499 raft_consensus.cc:2468] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:41.247503  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbd9bc437a747c384b5227ae8a1c544" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:41.248222  4574 raft_consensus.cc:2468] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:41.250974  4613 leader_election.cc:304] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:41.252257  4724 raft_consensus.cc:2804] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:41.252650  4724 raft_consensus.cc:493] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.253039  4724 raft_consensus.cc:3060] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.253285  4697 raft_consensus.cc:493] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.253791  4697 raft_consensus.cc:515] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.255967  4697 leader_election.cc:290] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:41.257782  4498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:41.258556  4498 raft_consensus.cc:2468] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:41.259815  4611 leader_election.cc:304] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:41.260463  4724 raft_consensus.cc:515] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.261713  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:41.262461  4573 raft_consensus.cc:2468] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:41.263090  4724 leader_election.cc:290] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:41.264353  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbd9bc437a747c384b5227ae8a1c544" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:41.265031  4573 raft_consensus.cc:3060] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.265482  4697 raft_consensus.cc:2804] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:41.265403  4498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cbd9bc437a747c384b5227ae8a1c544" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:41.265967  4697 raft_consensus.cc:493] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:41.266360  4697 raft_consensus.cc:3060] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.271246  4573 raft_consensus.cc:2468] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:41.272372  4613 leader_election.cc:304] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:41.273192  4724 raft_consensus.cc:2804] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.272897  4697 raft_consensus.cc:515] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.273690  4724 raft_consensus.cc:697] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:41.274473  4724 consensus_queue.cc:237] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.275758  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:41.276106  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:41.276467  4499 raft_consensus.cc:3060] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.276722  4573 raft_consensus.cc:3060] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.278090  4697 leader_election.cc:290] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:41.283676  4499 raft_consensus.cc:2468] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:41.284806  4611 leader_election.cc:304] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:41.285272  4573 raft_consensus.cc:2468] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:41.285583  4724 raft_consensus.cc:2804] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:41.285034  4396 catalog_manager.cc:5697] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.286749  4724 raft_consensus.cc:697] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:41.287537  4724 consensus_queue.cc:237] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.298322  4396 catalog_manager.cc:5697] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:41.327970  4724 consensus_queue.cc:1048] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.339676  4756 consensus_queue.cc:1048] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:41.345193  4716 raft_consensus.cc:493] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.345706  4716 raft_consensus.cc:515] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.347923  4716 leader_election.cc:290] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.349067  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:41.349071  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:41.350196  4648 raft_consensus.cc:2393] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d841b7678b5f4a279c9b24c5c3095fd2 in current term 1: Already voted for candidate 59324aad473f43b6afa1dd69094a82d9 in this term.
I20260709 13:13:41.351087  4538 leader_election.cc:304] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:41.351776  4716 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.357369  4696 raft_consensus.cc:493] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:41.357649  4716 raft_consensus.cc:2749] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:41.358018  4696 raft_consensus.cc:515] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.360002  4696 leader_election.cc:290] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.360754  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:41.360998  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:41.361481  4499 raft_consensus.cc:2393] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d841b7678b5f4a279c9b24c5c3095fd2 in current term 1: Already voted for candidate 0858cdfc2547473c99e557330fa1ddaa in this term.
I20260709 13:13:41.362412  4537 leader_election.cc:304] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:41.363059  4696 raft_consensus.cc:3060] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.368135  4696 raft_consensus.cc:2749] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:41.392647  4756 consensus_queue.cc:1048] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.392697  4721 consensus_queue.cc:1048] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:41.408121  4691 consensus_queue.cc:1048] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.413218  4730 consensus_queue.cc:1048] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:41.446959  4573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
mode: GRACEFUL
new_leader_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:33522
I20260709 13:13:41.447492  4573 raft_consensus.cc:606] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Received request to transfer leadership to TS 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:41.460605  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
mode: GRACEFUL
new_leader_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:13:41.461205  4648 raft_consensus.cc:606] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Received request to transfer leadership to TS 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:41.465981  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
mode: GRACEFUL
new_leader_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:13:41.466487  4648 raft_consensus.cc:606] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Received request to transfer leadership to TS 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:41.481428  4499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
mode: GRACEFUL
new_leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:13:41.482082  4499 raft_consensus.cc:606] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Received request to transfer leadership to TS d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:41.487110  4499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
mode: GRACEFUL
new_leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:13:41.487588  4499 raft_consensus.cc:606] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Received request to transfer leadership to TS d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:41.492265  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
mode: GRACEFUL
new_leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:13:41.492791  4648 raft_consensus.cc:606] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Received request to transfer leadership to TS d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:41.497658  4499 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
mode: GRACEFUL
new_leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:35744
I20260709 13:13:41.498173  4499 raft_consensus.cc:606] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Received request to transfer leadership to TS d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:41.553715  4721 consensus_queue.cc:1048] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.554482  4691 consensus_queue.cc:1048] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.560001  4691 consensus_queue.cc:1048] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.583822  4721 raft_consensus.cc:993] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9: : Instructing follower d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.584419  4769 raft_consensus.cc:1081] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Signalling peer d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.590667  4572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33514
I20260709 13:13:41.597307  4770 consensus_queue.cc:1048] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.598363  4572 raft_consensus.cc:493] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.598901  4572 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.608927  4721 raft_consensus.cc:993] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9: : Instructing follower d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.609550  4770 raft_consensus.cc:1081] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Signalling peer d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.611359  4573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33514
I20260709 13:13:41.611470  4572 raft_consensus.cc:515] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.612001  4573 raft_consensus.cc:493] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.612514  4573 raft_consensus.cc:3060] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.616143  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:41.616844  4499 raft_consensus.cc:3055] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.617149  4499 raft_consensus.cc:740] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:41.617830  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.617983  4499 consensus_queue.cc:260] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.618574  4647 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.619184  4499 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.619930  4573 raft_consensus.cc:515] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.622488  4573 leader_election.cc:290] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.623148  4498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:41.623797  4498 raft_consensus.cc:3055] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.624153  4498 raft_consensus.cc:740] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:41.623704  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419cf52b840c4905a2643a40bbff51e9" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.624818  4648 raft_consensus.cc:3060] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.625720  4498 consensus_queue.cc:260] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.627035  4498 raft_consensus.cc:3060] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.632457  4648 raft_consensus.cc:2468] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:41.638630  4538 leader_election.cc:304] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:41.637267  4647 raft_consensus.cc:2468] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:41.639530  4696 raft_consensus.cc:2804] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.639551  4572 leader_election.cc:290] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.640107  4696 raft_consensus.cc:697] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:41.641331  4696 consensus_queue.cc:237] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.643558  4498 raft_consensus.cc:2468] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:41.645504  4538 leader_election.cc:304] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:41.645522  4499 raft_consensus.cc:2468] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:41.646458  4696 raft_consensus.cc:2804] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.647125  4696 raft_consensus.cc:697] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:41.647929  4696 consensus_queue.cc:237] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.649513  4397 catalog_manager.cc:5697] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 1 to 2, leader changed from 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65) to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.661512  4397 catalog_manager.cc:5697] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 1 to 2, leader changed from 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65) to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.707681  4730 consensus_queue.cc:1048] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.717311  4499 raft_consensus.cc:3060] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:41.725342  4756 consensus_queue.cc:1048] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.730702  4721 raft_consensus.cc:993] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9: : Instructing follower d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.731180  4721 raft_consensus.cc:1081] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Signalling peer d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.732726  4572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33514
I20260709 13:13:41.733289  4572 raft_consensus.cc:493] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.733671  4572 raft_consensus.cc:3060] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.738236  4716 raft_consensus.cc:993] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2: : Instructing follower 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:41.738729  4696 raft_consensus.cc:1081] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Signalling peer 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:41.741691  4499 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:35714
I20260709 13:13:41.742324  4499 raft_consensus.cc:493] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.742115  4730 consensus_queue.cc:1048] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.742734  4499 raft_consensus.cc:3060] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.743001  4756 consensus_queue.cc:1048] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.743489  4572 raft_consensus.cc:515] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.753238  4498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:41.753983  4498 raft_consensus.cc:3055] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.754106  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d2295fe5ef4121b5e5008c1ed29b7b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.754429  4498 raft_consensus.cc:740] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:41.754799  4647 raft_consensus.cc:3060] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.755476  4498 consensus_queue.cc:260] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.755878  4756 raft_consensus.cc:993] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa: : Instructing follower 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:41.756534  4756 raft_consensus.cc:1081] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Signalling peer 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:41.757865  4498 raft_consensus.cc:3060] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.757449  4499 raft_consensus.cc:515] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:41.758430  4497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:35730
I20260709 13:13:41.759094  4497 raft_consensus.cc:493] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.759469  4497 raft_consensus.cc:3060] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.762647  4499 leader_election.cc:290] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Requested vote from peers 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:41.764591  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.765254  4648 raft_consensus.cc:3060] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.765328  4498 raft_consensus.cc:2468] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:41.768782  4537 leader_election.cc:304] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:41.769673  4696 raft_consensus.cc:2804] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.770177  4696 raft_consensus.cc:697] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:41.770942  4696 consensus_queue.cc:237] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.776307  4648 raft_consensus.cc:2468] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:41.777314  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea459e87d00644419a36f8872ae4078c" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:41.777622  4463 leader_election.cc:304] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:41.777050  4497 raft_consensus.cc:515] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.778010  4572 leader_election.cc:290] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.778649  4721 raft_consensus.cc:2804] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.779168  4496 raft_consensus.cc:1240] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Rejecting Update request from peer 0858cdfc2547473c99e557330fa1ddaa for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:41.779168  4721 raft_consensus.cc:697] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:41.782684  4721 consensus_queue.cc:237] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:41.778090  4647 raft_consensus.cc:2468] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:41.778337  4573 raft_consensus.cc:3055] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.785189  4573 raft_consensus.cc:740] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:41.785805  4730 consensus_queue.cc:1059] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:41.786099  4573 consensus_queue.cc:260] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } }
I20260709 13:13:41.784042  4397 catalog_manager.cc:5697] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 1 to 2, leader changed from 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65) to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.786890  4697 raft_consensus.cc:3055] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.787266  4697 raft_consensus.cc:740] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:41.787472  4573 raft_consensus.cc:3060] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.788195  4697 consensus_queue.cc:260] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.789113  4697 raft_consensus.cc:3060] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.793160  4724 raft_consensus.cc:993] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa: : Instructing follower 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:41.793684  4724 raft_consensus.cc:1081] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Signalling peer 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:41.795192  4573 raft_consensus.cc:2468] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:41.796717  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.798131  4496 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:35730
I20260709 13:13:41.798755  4496 raft_consensus.cc:493] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.799141  4496 raft_consensus.cc:3060] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.799221  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d9414d059e4a8a8b699a0a45e434f1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:41.799906  4572 raft_consensus.cc:3060] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.799937  4395 catalog_manager.cc:5697] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 1 to 2, leader changed from d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66) to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.806983  4496 raft_consensus.cc:515] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.808866  4572 raft_consensus.cc:2468] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:41.809406  4496 leader_election.cc:290] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.796087  4497 leader_election.cc:290] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.811813  4464 leader_election.cc:304] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:41.812140  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.812443  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83fce1e7194f4a25b5dcfa67bcca3bc5" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:41.812879  4648 raft_consensus.cc:3055] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.812992  4572 raft_consensus.cc:3060] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.813274  4648 raft_consensus.cc:740] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:41.814240  4648 consensus_queue.cc:260] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.815588  4648 raft_consensus.cc:3060] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.816994  4721 raft_consensus.cc:2804] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.818140  4721 raft_consensus.cc:697] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:41.818980  4721 consensus_queue.cc:237] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.820755  4572 raft_consensus.cc:2468] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:41.821247  4647 raft_consensus.cc:2468] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:41.822126  4464 leader_election.cc:304] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:41.822707  4648 raft_consensus.cc:2468] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:41.822976  4770 raft_consensus.cc:2804] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:41.823508  4770 raft_consensus.cc:697] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:41.824231  4770 consensus_queue.cc:237] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.828647  4395 catalog_manager.cc:5697] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 1 to 2, leader changed from 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67) to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.841305  4395 catalog_manager.cc:5697] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 1 to 2, leader changed from 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67) to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:41.977321  4756 raft_consensus.cc:993] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa: : Instructing follower d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.978224  4697 raft_consensus.cc:1081] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Signalling peer d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:41.980602  4572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:13:41.981849  4572 raft_consensus.cc:493] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:41.982460  4572 raft_consensus.cc:3060] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.991285  4572 raft_consensus.cc:515] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:41.993150  4572 leader_election.cc:290] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:41.995175  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:41.995111  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d46235579ed4b40abf4ebadfcdb3e31" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:41.996210  4648 raft_consensus.cc:3055] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:41.996387  4496 raft_consensus.cc:3060] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:41.996645  4648 raft_consensus.cc:740] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:41.997941  4648 consensus_queue.cc:260] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:42.000128  4648 raft_consensus.cc:3060] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:42.006907  4496 raft_consensus.cc:2468] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:42.008528  4537 leader_election.cc:304] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:42.009395  4648 raft_consensus.cc:2468] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:42.009524  4696 raft_consensus.cc:2804] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:42.010140  4696 raft_consensus.cc:697] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:42.011510  4696 consensus_queue.cc:237] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:42.018956  4395 catalog_manager.cc:5697] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 1 to 2, leader changed from 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67) to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:42.064028  4648 raft_consensus.cc:1275] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.065547  4696 consensus_queue.cc:1048] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.079406  4496 raft_consensus.cc:1275] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.081107  4777 consensus_queue.cc:1048] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:42.114962  4496 raft_consensus.cc:1275] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.116248  4777 consensus_queue.cc:1048] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.130894  4648 raft_consensus.cc:1275] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.132339  4777 consensus_queue.cc:1048] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.165370  4648 raft_consensus.cc:1275] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.166818  4770 consensus_queue.cc:1048] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.176541  4572 raft_consensus.cc:1275] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.178524  4769 consensus_queue.cc:1048] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:42.197667  4572 raft_consensus.cc:1275] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.198880  4769 consensus_queue.cc:1048] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.209599  4648 raft_consensus.cc:1275] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.211108  4769 consensus_queue.cc:1048] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.309288  4496 raft_consensus.cc:1275] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.310912  4777 consensus_queue.cc:1048] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.321107  4648 raft_consensus.cc:1275] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.323282  4696 consensus_queue.cc:1048] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.356083  4648 raft_consensus.cc:1275] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.357343  4769 consensus_queue.cc:1048] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.367798  4572 raft_consensus.cc:1275] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.369354  4770 consensus_queue.cc:1048] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.423629  4648 raft_consensus.cc:1275] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.424911  4696 consensus_queue.cc:1048] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:42.434214  4496 raft_consensus.cc:1275] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:42.436053  4777 consensus_queue.cc:1048] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:44.528973  4396 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45292:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:44.531595  4396 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:44.585454  4487 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab87b2041d240eb8b3f517f2dac9e14 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:44.586750  4558 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab87b2041d240eb8b3f517f2dac9e14 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:44.587355  4487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab87b2041d240eb8b3f517f2dac9e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.588326  4558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab87b2041d240eb8b3f517f2dac9e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.590744  4634 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab87b2041d240eb8b3f517f2dac9e14 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:44.592342  4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab87b2041d240eb8b3f517f2dac9e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.592434  4635 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3f659b03144956baed52244d91d9cc (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:44.596989  4630 tablet_service.cc:1511] Processing CreateTablet for tablet c961e86c5aa249d48e99b91b96361cf1 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:44.598994  4560 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3f659b03144956baed52244d91d9cc (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:44.600510  4560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3f659b03144956baed52244d91d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.603092  4638 tablet_service.cc:1511] Processing CreateTablet for tablet 6246c1262d61468eae1af4da2c7a720b (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:44.607811  4483 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3f659b03144956baed52244d91d9cc (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:44.609340  4483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3f659b03144956baed52244d91d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.611200  4485 tablet_service.cc:1511] Processing CreateTablet for tablet c961e86c5aa249d48e99b91b96361cf1 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:44.612586  4636 tablet_service.cc:1511] Processing CreateTablet for tablet 304f0732e0a44e979a2800654c98d323 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:44.614001  4482 tablet_service.cc:1511] Processing CreateTablet for tablet 6246c1262d61468eae1af4da2c7a720b (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:44.619562  4633 tablet_service.cc:1511] Processing CreateTablet for tablet b67df054428f4e2aa1793a55d8673c72 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:44.612668  4485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c961e86c5aa249d48e99b91b96361cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.623865  4557 tablet_service.cc:1511] Processing CreateTablet for tablet 6246c1262d61468eae1af4da2c7a720b (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:44.625357  4557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6246c1262d61468eae1af4da2c7a720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.625025  4561 tablet_service.cc:1511] Processing CreateTablet for tablet 304f0732e0a44e979a2800654c98d323 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:44.625588  4636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304f0732e0a44e979a2800654c98d323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.626799  4633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67df054428f4e2aa1793a55d8673c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.626489  4484 tablet_service.cc:1511] Processing CreateTablet for tablet b67df054428f4e2aa1793a55d8673c72 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:44.627131  4486 tablet_service.cc:1511] Processing CreateTablet for tablet 304f0732e0a44e979a2800654c98d323 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:44.626483  4561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304f0732e0a44e979a2800654c98d323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.628473  4486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304f0732e0a44e979a2800654c98d323. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.630503  4482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6246c1262d61468eae1af4da2c7a720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.631131  4489 tablet_service.cc:1511] Processing CreateTablet for tablet 5090d38316e8499ab5e2da4f5c729223 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.632495  4489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5090d38316e8499ab5e2da4f5c729223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.624313  4637 tablet_service.cc:1511] Processing CreateTablet for tablet 5090d38316e8499ab5e2da4f5c729223 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.627542  4630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c961e86c5aa249d48e99b91b96361cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.636729  4484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67df054428f4e2aa1793a55d8673c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.637277  4635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3f659b03144956baed52244d91d9cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.639601  4637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5090d38316e8499ab5e2da4f5c729223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.622087  4562 tablet_service.cc:1511] Processing CreateTablet for tablet c961e86c5aa249d48e99b91b96361cf1 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:44.644660  4562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c961e86c5aa249d48e99b91b96361cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.646349  4638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6246c1262d61468eae1af4da2c7a720b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.647256  4556 tablet_service.cc:1511] Processing CreateTablet for tablet b67df054428f4e2aa1793a55d8673c72 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:44.648703  4556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b67df054428f4e2aa1793a55d8673c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.648504  4564 tablet_service.cc:1511] Processing CreateTablet for tablet 5090d38316e8499ab5e2da4f5c729223 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:44.649892  4564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5090d38316e8499ab5e2da4f5c729223. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.686389  4488 tablet_service.cc:1511] Processing CreateTablet for tablet 73fbee1663964faa86557d022a4f1e6b (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.687906  4488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fbee1663964faa86557d022a4f1e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.690119  4559 tablet_service.cc:1511] Processing CreateTablet for tablet 73fbee1663964faa86557d022a4f1e6b (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.691555  4559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fbee1663964faa86557d022a4f1e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.724385  4631 tablet_service.cc:1511] Processing CreateTablet for tablet 73fbee1663964faa86557d022a4f1e6b (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:44.725903  4631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fbee1663964faa86557d022a4f1e6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.737479  4481 tablet_service.cc:1511] Processing CreateTablet for tablet ecd333db42324b90bec2830bc628d7a7 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.742724  4560 tablet_service.cc:1511] Processing CreateTablet for tablet ecd333db42324b90bec2830bc628d7a7 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.747943  4560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd333db42324b90bec2830bc628d7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.749320  4481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd333db42324b90bec2830bc628d7a7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:44.746816  4445 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:44.749974  4634 tablet_service.cc:1511] Processing CreateTablet for tablet ecd333db42324b90bec2830bc628d7a7 (DEFAULT_TABLE table=soft_deleted_table [id=492a42a3c77d4344b690118b03144202]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:44.754720  4634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd333db42324b90bec2830bc628d7a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:44.758006  4794 tablet_bootstrap.cc:492] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:44.767278  4794 tablet_bootstrap.cc:654] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.787060  4795 tablet_bootstrap.cc:492] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:44.787319  4796 tablet_bootstrap.cc:492] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:44.794478  4795 tablet_bootstrap.cc:654] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.803755  4796 tablet_bootstrap.cc:654] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.808760  4795 tablet_bootstrap.cc:492] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:44.809296  4795 ts_tablet_manager.cc:1403] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:13:44.809464  4794 tablet_bootstrap.cc:492] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:44.810071  4794 ts_tablet_manager.cc:1403] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.007s
I20260709 13:13:44.811864  4795 raft_consensus.cc:359] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.812568  4795 raft_consensus.cc:385] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.812897  4795 raft_consensus.cc:740] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.813459  4794 raft_consensus.cc:359] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.813808  4795 consensus_queue.cc:260] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.814431  4794 raft_consensus.cc:385] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.814821  4794 raft_consensus.cc:740] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.815637  4794 consensus_queue.cc:260] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.816327  4795 ts_tablet_manager.cc:1434] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:13:44.817565  4795 tablet_bootstrap.cc:492] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:44.818454  4794 ts_tablet_manager.cc:1434] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:44.819550  4794 tablet_bootstrap.cc:492] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:44.824545  4795 tablet_bootstrap.cc:654] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.826263  4794 tablet_bootstrap.cc:654] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.836869  4796 tablet_bootstrap.cc:492] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:44.837489  4796 ts_tablet_manager.cc:1403] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.009s
I20260709 13:13:44.840853  4794 tablet_bootstrap.cc:492] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:44.840517  4796 raft_consensus.cc:359] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.841243  4795 tablet_bootstrap.cc:492] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:44.841434  4794 ts_tablet_manager.cc:1403] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:13:44.841580  4796 raft_consensus.cc:385] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.841837  4795 ts_tablet_manager.cc:1403] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.012s
I20260709 13:13:44.842011  4796 raft_consensus.cc:740] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.842867  4796 consensus_queue.cc:260] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.844599  4795 raft_consensus.cc:359] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.845166  4796 ts_tablet_manager.cc:1434] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:44.845216  4795 raft_consensus.cc:385] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.845728  4795 raft_consensus.cc:740] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.846411  4796 tablet_bootstrap.cc:492] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:44.846884  4795 consensus_queue.cc:260] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.847193  4794 raft_consensus.cc:359] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.847965  4794 raft_consensus.cc:385] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.848258  4794 raft_consensus.cc:740] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.849009  4794 consensus_queue.cc:260] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.852319  4795 ts_tablet_manager.cc:1434] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:13:44.853468  4795 tablet_bootstrap.cc:492] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:44.853613  4794 ts_tablet_manager.cc:1434] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:13:44.854714  4794 tablet_bootstrap.cc:492] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:44.860281  4795 tablet_bootstrap.cc:654] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.861364  4794 tablet_bootstrap.cc:654] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.868480  4796 tablet_bootstrap.cc:654] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.870628  4794 tablet_bootstrap.cc:492] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:44.871225  4794 ts_tablet_manager.cc:1403] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:13:44.874585  4794 raft_consensus.cc:359] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.876982  4794 raft_consensus.cc:385] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.877312  4794 raft_consensus.cc:740] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.877981  4795 tablet_bootstrap.cc:492] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:44.878582  4795 ts_tablet_manager.cc:1403] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.025s	user 0.024s	sys 0.000s
I20260709 13:13:44.878134  4794 consensus_queue.cc:260] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.880396  4796 tablet_bootstrap.cc:492] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:44.880728  4794 ts_tablet_manager.cc:1434] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:44.880995  4796 ts_tablet_manager.cc:1403] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.005s
I20260709 13:13:44.881757  4794 tablet_bootstrap.cc:492] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:44.881668  4795 raft_consensus.cc:359] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.882540  4795 raft_consensus.cc:385] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.882850  4795 raft_consensus.cc:740] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.883589  4795 consensus_queue.cc:260] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.884323  4796 raft_consensus.cc:359] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.885093  4796 raft_consensus.cc:385] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.885382  4796 raft_consensus.cc:740] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.886554  4795 ts_tablet_manager.cc:1434] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:44.887682  4795 tablet_bootstrap.cc:492] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:44.890069  4794 tablet_bootstrap.cc:654] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.893707  4795 tablet_bootstrap.cc:654] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.886175  4796 consensus_queue.cc:260] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.908665  4794 tablet_bootstrap.cc:492] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:44.908914  4795 tablet_bootstrap.cc:492] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:44.909248  4794 ts_tablet_manager.cc:1403] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 13:13:44.909310  4796 ts_tablet_manager.cc:1434] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.008s
I20260709 13:13:44.909502  4795 ts_tablet_manager.cc:1403] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.022s	user 0.001s	sys 0.013s
I20260709 13:13:44.910656  4796 tablet_bootstrap.cc:492] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:44.912611  4794 raft_consensus.cc:359] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.913372  4794 raft_consensus.cc:385] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.912931  4795 raft_consensus.cc:359] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.913695  4794 raft_consensus.cc:740] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.913831  4795 raft_consensus.cc:385] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.914243  4795 raft_consensus.cc:740] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.914556  4794 consensus_queue.cc:260] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.914999  4795 consensus_queue.cc:260] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.917109  4794 ts_tablet_manager.cc:1434] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:13:44.918223  4794 tablet_bootstrap.cc:492] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:44.919459  4795 ts_tablet_manager.cc:1434] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:44.920571  4795 tablet_bootstrap.cc:492] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:44.922802  4796 tablet_bootstrap.cc:654] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.924914  4794 tablet_bootstrap.cc:654] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.927084  4795 tablet_bootstrap.cc:654] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.934928  4796 tablet_bootstrap.cc:492] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:44.935497  4796 ts_tablet_manager.cc:1403] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:13:44.936899  4794 tablet_bootstrap.cc:492] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:44.937517  4794 ts_tablet_manager.cc:1403] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:13:44.938638  4796 raft_consensus.cc:359] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.939100  4795 tablet_bootstrap.cc:492] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:44.939491  4796 raft_consensus.cc:385] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.939782  4795 ts_tablet_manager.cc:1403] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:13:44.940025  4796 raft_consensus.cc:740] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.940572  4794 raft_consensus.cc:359] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.941362  4794 raft_consensus.cc:385] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.940888  4796 consensus_queue.cc:260] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.941668  4794 raft_consensus.cc:740] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.942505  4794 consensus_queue.cc:260] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.943360  4796 ts_tablet_manager.cc:1434] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:13:44.942991  4795 raft_consensus.cc:359] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.943822  4795 raft_consensus.cc:385] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.944145  4795 raft_consensus.cc:740] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.944476  4796 tablet_bootstrap.cc:492] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:44.944955  4794 ts_tablet_manager.cc:1434] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:44.945025  4795 consensus_queue.cc:260] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.946379  4794 tablet_bootstrap.cc:492] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:44.950788  4795 ts_tablet_manager.cc:1434] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:13:44.951934  4795 tablet_bootstrap.cc:492] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:44.952307  4796 tablet_bootstrap.cc:654] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.953621  4794 tablet_bootstrap.cc:654] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.954249  4777 raft_consensus.cc:493] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.954789  4777 raft_consensus.cc:515] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.958447  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:44.958670  4795 tablet_bootstrap.cc:654] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.959148  4647 raft_consensus.cc:2468] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 0.
I20260709 13:13:44.960462  4807 raft_consensus.cc:493] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:44.961007  4807 raft_consensus.cc:515] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.962133  4794 tablet_bootstrap.cc:492] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:44.962687  4794 ts_tablet_manager.cc:1403] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:13:44.963456  4807 leader_election.cc:290] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:44.964948  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:44.961442  4777 leader_election.cc:290] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:44.961016  4538 leader_election.cc:304] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:44.965693  4794 raft_consensus.cc:359] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.968195  4811 raft_consensus.cc:2804] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.968561  4811 raft_consensus.cc:493] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.969043  4811 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.969683  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c961e86c5aa249d48e99b91b96361cf1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:44.973018  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c961e86c5aa249d48e99b91b96361cf1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
W20260709 13:13:44.974383  4537 leader_election.cc:343] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:44.973839  4647 raft_consensus.cc:2468] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:44.977836  4463 leader_election.cc:304] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:44.978863  4807 raft_consensus.cc:2804] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:44.979249  4807 raft_consensus.cc:493] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:44.978870  4794 raft_consensus.cc:385] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.979611  4807 raft_consensus.cc:3060] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.980123  4794 raft_consensus.cc:740] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.980937  4794 consensus_queue.cc:260] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.981945  4572 raft_consensus.cc:2468] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:44.983297  4794 ts_tablet_manager.cc:1434] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:13:44.984382  4794 tablet_bootstrap.cc:492] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:44.987880  4807 raft_consensus.cc:515] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.977790  4811 raft_consensus.cc:515] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.990741  4807 leader_election.cc:290] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:44.990958  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c961e86c5aa249d48e99b91b96361cf1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:44.991721  4572 raft_consensus.cc:3060] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:44.992770  4796 tablet_bootstrap.cc:492] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:44.993175  4811 leader_election.cc:290] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:44.993330  4796 ts_tablet_manager.cc:1403] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.011s
I20260709 13:13:44.995911  4794 tablet_bootstrap.cc:654] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:44.996752  4796 raft_consensus.cc:359] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:44.997534  4796 raft_consensus.cc:385] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:44.997818  4796 raft_consensus.cc:740] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:44.998611  4796 consensus_queue.cc:260] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.001487  4796 ts_tablet_manager.cc:1434] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:45.002674  4796 tablet_bootstrap.cc:492] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:45.003257  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c961e86c5aa249d48e99b91b96361cf1" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:45.004056  4647 raft_consensus.cc:3060] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.007050  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:45.007818  4648 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.011308  4811 raft_consensus.cc:493] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.011889  4811 raft_consensus.cc:515] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.002640  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.013991  4811 leader_election.cc:290] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.016245  4646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.016577  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.017042  4646 raft_consensus.cc:2468] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 0.
W20260709 13:13:45.017736  4537 leader_election.cc:343] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.018376  4538 leader_election.cc:304] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
W20260709 13:13:45.019093  4537 leader_election.cc:343] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.020334  4796 tablet_bootstrap.cc:654] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.024115  4811 raft_consensus.cc:2804] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.030351  4811 raft_consensus.cc:493] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.031425  4756 raft_consensus.cc:493] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.032516  4756 raft_consensus.cc:515] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.035058  4756 leader_election.cc:290] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:45.037230  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.038108  4497 raft_consensus.cc:2468] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:45.039816  4611 leader_election.cc:304] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:45.040923  4756 raft_consensus.cc:2804] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.041340  4756 raft_consensus.cc:493] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.041666  4756 raft_consensus.cc:3060] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.042583  4811 raft_consensus.cc:3060] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.056609  4811 raft_consensus.cc:515] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.059839  4648 raft_consensus.cc:2468] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 1.
I20260709 13:13:45.062832  4646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:45.063620  4646 raft_consensus.cc:3060] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.060416  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.060734  4796 tablet_bootstrap.cc:492] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:45.070451  4796 ts_tablet_manager.cc:1403] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.002s
W20260709 13:13:45.071305  4537 leader_election.cc:343] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.072450  4538 leader_election.cc:304] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:45.073433  4796 raft_consensus.cc:359] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.074262  4796 raft_consensus.cc:385] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.073976  4777 raft_consensus.cc:2804] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.074762  4796 raft_consensus.cc:740] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.075012  4777 raft_consensus.cc:697] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:45.075752  4796 consensus_queue.cc:260] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.076041  4777 consensus_queue.cc:237] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.076915  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.078323  4796 ts_tablet_manager.cc:1434] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 13:13:45.078745  4613 leader_election.cc:343] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.079545  4796 tablet_bootstrap.cc:492] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:45.082427  4756 raft_consensus.cc:515] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.086336  4815 raft_consensus.cc:493] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.094758  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.095669  4496 raft_consensus.cc:3060] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.097561  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
W20260709 13:13:45.100030  4613 leader_election.cc:343] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.105949  4496 raft_consensus.cc:2468] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:45.091028  4796 tablet_bootstrap.cc:654] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.094623  4815 raft_consensus.cc:515] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.107743  4611 leader_election.cc:304] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:45.087384  4811 leader_election.cc:290] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.112535  4648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f659b03144956baed52244d91d9cc" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
W20260709 13:13:45.115121  4538 leader_election.cc:343] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.119570  4756 leader_election.cc:290] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:45.110275  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f659b03144956baed52244d91d9cc" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
W20260709 13:13:45.122635  4537 leader_election.cc:343] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.123147  4537 leader_election.cc:304] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:45.125106  4777 raft_consensus.cc:493] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.125660  4777 raft_consensus.cc:515] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.089473  4647 raft_consensus.cc:2468] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:45.120240  4815 leader_election.cc:290] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.132642  4756 raft_consensus.cc:2804] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.136819  4756 raft_consensus.cc:697] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:45.086817  4646 raft_consensus.cc:2468] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 1.
I20260709 13:13:45.135577  4463 leader_election.cc:304] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:45.140600  4807 raft_consensus.cc:2804] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.141187  4807 raft_consensus.cc:697] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:45.142138  4807 consensus_queue.cc:237] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.147830  4538 leader_election.cc:304] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:45.154080  4777 leader_election.cc:290] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.158846  4777 raft_consensus.cc:2804] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.160121  4777 raft_consensus.cc:697] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:45.148983  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304f0732e0a44e979a2800654c98d323" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.160878  4496 raft_consensus.cc:2468] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 0.
I20260709 13:13:45.162358  4537 leader_election.cc:304] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:45.128343  4811 raft_consensus.cc:2749] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.161067  4777 consensus_queue.cc:237] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.074052  4572 raft_consensus.cc:2468] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:45.132548  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304f0732e0a44e979a2800654c98d323" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.163239  4815 raft_consensus.cc:2804] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.167587  4397 catalog_manager.cc:5697] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.172278  4815 raft_consensus.cc:493] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.172773  4815 raft_consensus.cc:3060] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.178079  4811 raft_consensus.cc:493] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.178653  4811 raft_consensus.cc:515] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
W20260709 13:13:45.178875  4538 leader_election.cc:343] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.180897  4811 leader_election.cc:290] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.139299  4756 consensus_queue.cc:237] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.181618  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
W20260709 13:13:45.186324  4537 leader_election.cc:343] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.183120  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.187870  4794 tablet_bootstrap.cc:492] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:45.187876  4795 tablet_bootstrap.cc:492] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:45.188539  4795 ts_tablet_manager.cc:1403] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.237s	user 0.063s	sys 0.091s
I20260709 13:13:45.188539  4794 ts_tablet_manager.cc:1403] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.204s	user 0.059s	sys 0.099s
I20260709 13:13:45.191917  4795 raft_consensus.cc:359] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.192169  4794 raft_consensus.cc:359] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.192731  4795 raft_consensus.cc:385] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.192894  4794 raft_consensus.cc:385] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.193084  4795 raft_consensus.cc:740] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.193259  4794 raft_consensus.cc:740] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.193990  4795 consensus_queue.cc:260] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.194344  4794 consensus_queue.cc:260] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
W20260709 13:13:45.188045  4538 leader_election.cc:343] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:45.196149  4538 leader_election.cc:304] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:45.197099  4794 ts_tablet_manager.cc:1434] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:13:45.196905  4777 raft_consensus.cc:2749] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.198458  4795 ts_tablet_manager.cc:1434] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:45.198917  4794 tablet_bootstrap.cc:492] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:45.196693  4815 raft_consensus.cc:515] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.199535  4795 tablet_bootstrap.cc:492] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:45.201813  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304f0732e0a44e979a2800654c98d323" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.202520  4496 raft_consensus.cc:3060] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.204195  4796 tablet_bootstrap.cc:492] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:45.204802  4796 ts_tablet_manager.cc:1403] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.048s
I20260709 13:13:45.208276  4794 tablet_bootstrap.cc:654] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.208088  4796 raft_consensus.cc:359] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.208827  4796 raft_consensus.cc:385] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.210987  4796 raft_consensus.cc:740] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.211889  4796 consensus_queue.cc:260] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.209194  4815 leader_election.cc:290] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.210312  4496 raft_consensus.cc:2468] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 1.
I20260709 13:13:45.210433  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304f0732e0a44e979a2800654c98d323" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:45.214089  4647 raft_consensus.cc:3060] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.214780  4795 tablet_bootstrap.cc:654] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.215057  4537 leader_election.cc:304] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:45.216084  4815 raft_consensus.cc:2804] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.216662  4815 raft_consensus.cc:697] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:45.217549  4815 consensus_queue.cc:237] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.219692  4794 tablet_bootstrap.cc:492] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:45.220227  4794 ts_tablet_manager.cc:1403] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.001s
I20260709 13:13:45.219238  4796 ts_tablet_manager.cc:1434] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 13:13:45.221906  4647 raft_consensus.cc:2468] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 1.
I20260709 13:13:45.222381  4796 tablet_bootstrap.cc:492] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:45.223122  4794 raft_consensus.cc:359] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.223930  4794 raft_consensus.cc:385] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.224231  4794 raft_consensus.cc:740] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.224963  4794 consensus_queue.cc:260] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.227233  4794 ts_tablet_manager.cc:1434] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:13:45.228339  4794 tablet_bootstrap.cc:492] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2: Bootstrap starting.
I20260709 13:13:45.230044  4796 tablet_bootstrap.cc:654] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.231660  4795 tablet_bootstrap.cc:492] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:45.232221  4795 ts_tablet_manager.cc:1403] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 13:13:45.235289  4795 raft_consensus.cc:359] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.236032  4795 raft_consensus.cc:385] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.236322  4795 raft_consensus.cc:740] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.237082  4795 consensus_queue.cc:260] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.239864  4396 catalog_manager.cc:5697] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.244796  4795 ts_tablet_manager.cc:1434] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:13:45.245220  4794 tablet_bootstrap.cc:654] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.245957  4795 tablet_bootstrap.cc:492] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:45.253279  4795 tablet_bootstrap.cc:654] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.256623  4796 tablet_bootstrap.cc:492] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:45.256908  4794 tablet_bootstrap.cc:492] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2: No bootstrap required, opened a new log
I20260709 13:13:45.257216  4796 ts_tablet_manager.cc:1403] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.015s
I20260709 13:13:45.257419  4794 ts_tablet_manager.cc:1403] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:13:45.260151  4794 raft_consensus.cc:359] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.260828  4794 raft_consensus.cc:385] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.261103  4794 raft_consensus.cc:740] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.261763  4794 consensus_queue.cc:260] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.262497  4796 raft_consensus.cc:359] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.263278  4796 raft_consensus.cc:385] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.263554  4796 raft_consensus.cc:740] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.263710  4794 ts_tablet_manager.cc:1434] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:13:45.264302  4796 consensus_queue.cc:260] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.266779  4796 ts_tablet_manager.cc:1434] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:13:45.266136  4396 catalog_manager.cc:5697] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.266981  4795 tablet_bootstrap.cc:492] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:45.267499  4795 ts_tablet_manager.cc:1403] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.002s
I20260709 13:13:45.267846  4796 tablet_bootstrap.cc:492] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:45.270277  4795 raft_consensus.cc:359] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.270926  4795 raft_consensus.cc:385] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.271188  4795 raft_consensus.cc:740] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.272034  4795 consensus_queue.cc:260] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.274333  4795 ts_tablet_manager.cc:1434] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:45.274910  4796 tablet_bootstrap.cc:654] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.275323  4795 tablet_bootstrap.cc:492] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa: Bootstrap starting.
I20260709 13:13:45.278822  4396 catalog_manager.cc:5697] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.280776  4796 tablet_bootstrap.cc:492] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:45.281304  4796 ts_tablet_manager.cc:1403] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:13:45.282145  4795 tablet_bootstrap.cc:654] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.281370  4396 catalog_manager.cc:5697] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:45.284659  4796 raft_consensus.cc:359] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.285524  4796 raft_consensus.cc:385] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.285811  4796 raft_consensus.cc:740] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.286589  4796 consensus_queue.cc:260] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.289392  4795 tablet_bootstrap.cc:492] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa: No bootstrap required, opened a new log
I20260709 13:13:45.290066  4795 ts_tablet_manager.cc:1403] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.006s
I20260709 13:13:45.290473  4796 ts_tablet_manager.cc:1434] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:45.291345  4796 tablet_bootstrap.cc:492] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9: Bootstrap starting.
I20260709 13:13:45.292870  4795 raft_consensus.cc:359] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.293576  4795 raft_consensus.cc:385] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.293841  4795 raft_consensus.cc:740] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.294735  4795 consensus_queue.cc:260] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.296530  4795 ts_tablet_manager.cc:1434] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:45.299050  4756 raft_consensus.cc:493] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.299839  4796 tablet_bootstrap.cc:654] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:45.299703  4756 raft_consensus.cc:515] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.302558  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.302843  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.303310  4496 raft_consensus.cc:2468] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:45.303543  4572 raft_consensus.cc:2468] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:45.304818  4611 leader_election.cc:304] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:45.305729  4824 raft_consensus.cc:2804] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.309603  4824 raft_consensus.cc:493] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.309945  4824 raft_consensus.cc:3060] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.305409  4756 leader_election.cc:290] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:45.320415  4824 raft_consensus.cc:515] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.324715  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.325356  4496 raft_consensus.cc:3060] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.336217  4807 raft_consensus.cc:493] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.336894  4807 raft_consensus.cc:515] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.339098  4807 leader_election.cc:290] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.342568  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.345638  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.346048  4496 raft_consensus.cc:2468] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:45.346518  4647 raft_consensus.cc:2393] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59324aad473f43b6afa1dd69094a82d9 in current term 1: Already voted for candidate d841b7678b5f4a279c9b24c5c3095fd2 in this term.
I20260709 13:13:45.347548  4824 leader_election.cc:290] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:45.348692  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:45.349325  4572 raft_consensus.cc:3060] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.355389  4796 tablet_bootstrap.cc:492] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9: No bootstrap required, opened a new log
I20260709 13:13:45.355970  4796 ts_tablet_manager.cc:1403] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.031s
I20260709 13:13:45.355748  4815 raft_consensus.cc:493] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.357033  4815 raft_consensus.cc:515] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.358690  4796 raft_consensus.cc:359] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.359458  4796 raft_consensus.cc:385] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:45.359766  4796 raft_consensus.cc:740] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Initialized, Role: FOLLOWER
I20260709 13:13:45.360484  4796 consensus_queue.cc:260] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.362845  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.362848  4796 ts_tablet_manager.cc:1434] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:45.359261  4815 leader_election.cc:290] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.373411  4572 raft_consensus.cc:2468] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:45.377629  4613 leader_election.cc:304] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:45.378891  4824 raft_consensus.cc:2804] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.379446  4824 raft_consensus.cc:697] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:45.380277  4824 consensus_queue.cc:237] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.439570  4463 leader_election.cc:304] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9; no voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:45.440543  4807 raft_consensus.cc:3060] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.447822  4807 raft_consensus.cc:2749] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.499593  4807 raft_consensus.cc:493] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.500254  4807 raft_consensus.cc:515] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.505939  4807 leader_election.cc:290] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.511579  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.512677  4496 raft_consensus.cc:2393] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d841b7678b5f4a279c9b24c5c3095fd2 in current term 1: Already voted for candidate 0858cdfc2547473c99e557330fa1ddaa in this term.
I20260709 13:13:45.514849  4537 leader_election.cc:304] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:45.515728  4815 raft_consensus.cc:3060] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.523191  4807 raft_consensus.cc:493] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.523731  4815 raft_consensus.cc:2749] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.523872  4807 raft_consensus.cc:515] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.526721  4807 leader_election.cc:290] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.588449  4770 raft_consensus.cc:493] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.589036  4770 raft_consensus.cc:515] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.621798  4770 leader_election.cc:290] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.701447  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f659b03144956baed52244d91d9cc" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.702360  4647 raft_consensus.cc:2468] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:45.774286  4819 raft_consensus.cc:493] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.775076  4819 raft_consensus.cc:515] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.777590  4819 leader_election.cc:290] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.779713  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.780596  4496 raft_consensus.cc:2468] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 0.
I20260709 13:13:45.782123  4537 leader_election.cc:304] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:45.783181  4819 raft_consensus.cc:2804] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.783717  4819 raft_consensus.cc:493] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.784181  4819 raft_consensus.cc:3060] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.791579  4647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.792379  4647 raft_consensus.cc:2393] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59324aad473f43b6afa1dd69094a82d9 in current term 1: Already voted for candidate d841b7678b5f4a279c9b24c5c3095fd2 in this term.
I20260709 13:13:45.795329  4463 leader_election.cc:304] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:45.796205  4840 raft_consensus.cc:2804] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.796571  4840 raft_consensus.cc:493] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.796869  4840 raft_consensus.cc:3060] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.803465  4840 raft_consensus.cc:515] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.805614  4840 leader_election.cc:290] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:45.807862  4643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f659b03144956baed52244d91d9cc" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:45.808637  4643 raft_consensus.cc:3060] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.808794  4841 raft_consensus.cc:493] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.809911  4841 raft_consensus.cc:515] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.810144  4820 consensus_queue.cc:1048] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.813570  4820 raft_consensus.cc:493] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:45.814203  4820 raft_consensus.cc:515] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.817209  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.818023  4573 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:45.819470  4613 leader_election.cc:304] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:45.820914  4841 leader_election.cc:290] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:45.821964  4841 raft_consensus.cc:2804] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.822962  4841 raft_consensus.cc:493] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.823971  4820 leader_election.cc:290] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
W20260709 13:13:45.826109  4445 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:45.831473  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.834882  4841 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.837256  4643 raft_consensus.cc:2468] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:45.838590  4499 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.838955  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9" is_pre_election: true
I20260709 13:13:45.839442  4499 raft_consensus.cc:2468] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:45.840834  4611 leader_election.cc:304] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:45.839715  4497 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 0.
I20260709 13:13:45.842823  4842 raft_consensus.cc:2804] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:45.843271  4842 raft_consensus.cc:493] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:45.843135  4824 consensus_queue.cc:1048] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.843715  4842 raft_consensus.cc:3060] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.844857  4463 leader_election.cc:304] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:45.846668  4841 raft_consensus.cc:515] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.847306  4777 consensus_queue.cc:1048] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.848923  4840 raft_consensus.cc:2804] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.852310  4842 raft_consensus.cc:515] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.855445  4842 leader_election.cc:290] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:45.856766  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:45.856699  4841 leader_election.cc:290] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:45.863870  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f659b03144956baed52244d91d9cc" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.864598  4572 raft_consensus.cc:2468] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 0.
I20260709 13:13:45.864780  4770 consensus_queue.cc:1048] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.864954  4574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:45.865729  4574 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.866112  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.868765  4570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" is_pre_election: true
I20260709 13:13:45.873589  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3f659b03144956baed52244d91d9cc" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:45.874272  4568 raft_consensus.cc:3060] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.877816  4499 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.879374  4646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.882917  4646 raft_consensus.cc:2393] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59324aad473f43b6afa1dd69094a82d9 in current term 1: Already voted for candidate 0858cdfc2547473c99e557330fa1ddaa in this term.
I20260709 13:13:45.883371  4644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa" is_pre_election: true
I20260709 13:13:45.884204  4807 consensus_queue.cc:1048] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.877975  4396 catalog_manager.cc:5697] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:45.884306  4644 raft_consensus.cc:2393] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d841b7678b5f4a279c9b24c5c3095fd2 in current term 1: Already voted for candidate 0858cdfc2547473c99e557330fa1ddaa in this term.
I20260709 13:13:45.887882  4777 consensus_queue.cc:1048] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.885282  4464 leader_election.cc:304] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9; no voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:45.889699  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.892462  4496 raft_consensus.cc:3060] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.891757  4495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.894562  4463 leader_election.cc:304] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9; no voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:45.895987  4770 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:45.900147  4574 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:45.905954  4819 raft_consensus.cc:515] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.889442  4568 raft_consensus.cc:2468] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 1.
I20260709 13:13:45.914992  4819 leader_election.cc:290] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
W20260709 13:13:45.918252  4537 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:44795, user_credentials={real_user=slave}} blocked reactor thread for 46163.6us
I20260709 13:13:45.911041  4573 raft_consensus.cc:2393] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0858cdfc2547473c99e557330fa1ddaa in current term 1: Already voted for candidate d841b7678b5f4a279c9b24c5c3095fd2 in this term.
I20260709 13:13:45.907629  4496 raft_consensus.cc:2468] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:45.924633  4777 consensus_queue.cc:1048] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.919530  4840 raft_consensus.cc:697] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:45.927847  4840 consensus_queue.cc:237] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.927865  4613 leader_election.cc:304] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:45.930162  4807 raft_consensus.cc:2749] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.932387  4777 consensus_queue.cc:1048] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.931696  4815 consensus_queue.cc:1048] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:13:45.929433  4611 leader_election.cc:304] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:45.940032  4842 raft_consensus.cc:2804] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.940469  4820 raft_consensus.cc:2804] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:45.940670  4842 raft_consensus.cc:697] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:45.909412  4770 raft_consensus.cc:2749] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:45.944567  4824 consensus_queue.cc:1048] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.946593  4842 consensus_queue.cc:237] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.941143  4820 raft_consensus.cc:697] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:45.958580  4819 consensus_queue.cc:1048] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:45.958818  4496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:45.959699  4496 raft_consensus.cc:2393] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d841b7678b5f4a279c9b24c5c3095fd2 in current term 1: Already voted for candidate 0858cdfc2547473c99e557330fa1ddaa in this term.
I20260709 13:13:45.960075  4820 consensus_queue.cc:237] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:45.962874  4495 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 1.
I20260709 13:13:45.975517  4842 consensus_queue.cc:1048] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:45.978555  4644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecd333db42324b90bec2830bc628d7a7" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:46.014683  4538 leader_election.cc:304] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d841b7678b5f4a279c9b24c5c3095fd2; no voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:46.020546  4849 raft_consensus.cc:2749] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:46.063750  4396 catalog_manager.cc:5697] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.065799  4396 catalog_manager.cc:5697] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 0 to 1, leader changed from <none> to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:46.075955  4397 catalog_manager.cc:5697] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 1 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.353331  4842 consensus_queue.cc:1048] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.354422  4573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
mode: GRACEFUL
new_leader_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:33522
I20260709 13:13:46.355140  4573 raft_consensus.cc:606] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Received request to transfer leadership to TS 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:46.369340  4842 consensus_queue.cc:1048] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.371438  4573 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
mode: GRACEFUL
new_leader_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:33522
I20260709 13:13:46.372048  4573 raft_consensus.cc:606] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Received request to transfer leadership to TS 59324aad473f43b6afa1dd69094a82d9
I20260709 13:13:46.376039  4807 consensus_queue.cc:1048] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.379868  4842 consensus_queue.cc:1048] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.387382  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
mode: GRACEFUL
new_leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:13:46.388047  4648 raft_consensus.cc:606] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Received request to transfer leadership to TS d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:46.400306  4648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
mode: GRACEFUL
new_leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:13:46.400875  4648 raft_consensus.cc:606] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Received request to transfer leadership to TS d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:46.407354  4820 consensus_queue.cc:1048] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.417685  4845 consensus_queue.cc:1048] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:46.418192  4644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
mode: GRACEFUL
new_leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33530
I20260709 13:13:46.419298  4644 raft_consensus.cc:606] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Received request to transfer leadership to TS d841b7678b5f4a279c9b24c5c3095fd2
I20260709 13:13:46.428450  4842 raft_consensus.cc:993] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: : Instructing follower d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:46.428982  4824 raft_consensus.cc:1081] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Signalling peer d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:46.431533  4573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:13:46.432147  4573 raft_consensus.cc:493] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.432534  4573 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.438966  4573 raft_consensus.cc:515] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.441089  4573 leader_election.cc:290] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:46.442454  4495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:46.442627  4644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:46.443306  4495 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.443382  4644 raft_consensus.cc:3055] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.443872  4644 raft_consensus.cc:740] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:46.444710  4644 consensus_queue.cc:260] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.446010  4644 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.448978  4842 raft_consensus.cc:993] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: : Instructing follower d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:46.449512  4824 raft_consensus.cc:1081] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Signalling peer d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:46.450487  4495 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:46.451328  4573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:13:46.451951  4573 raft_consensus.cc:493] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.452307  4573 raft_consensus.cc:3060] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.452185  4537 leader_election.cc:304] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:46.453104  4849 raft_consensus.cc:2804] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.453056  4644 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:46.453752  4849 raft_consensus.cc:697] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:46.454588  4849 consensus_queue.cc:237] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.458513  4573 raft_consensus.cc:515] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.460742  4573 leader_election.cc:290] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:46.461963  4644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:46.461972  4495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b67df054428f4e2aa1793a55d8673c72" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:46.462778  4644 raft_consensus.cc:3055] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.462826  4495 raft_consensus.cc:3060] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.463198  4644 raft_consensus.cc:740] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:46.463300  4397 catalog_manager.cc:5697] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 1 to 2, leader changed from 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67) to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.464357  4644 consensus_queue.cc:260] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.465653  4644 raft_consensus.cc:3060] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.470759  4495 raft_consensus.cc:2468] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:46.472033  4537 leader_election.cc:304] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:46.472719  4644 raft_consensus.cc:2468] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:46.472837  4844 raft_consensus.cc:2804] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.473397  4844 raft_consensus.cc:697] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:46.474226  4844 consensus_queue.cc:237] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.480185  4397 catalog_manager.cc:5697] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 1 to 2, leader changed from 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67) to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.501480  4842 raft_consensus.cc:993] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: : Instructing follower d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:46.501945  4824 raft_consensus.cc:1081] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Signalling peer d841b7678b5f4a279c9b24c5c3095fd2 to start an election
I20260709 13:13:46.503283  4573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:13:46.503716  4573 raft_consensus.cc:493] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.503963  4573 raft_consensus.cc:3060] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.509155  4573 raft_consensus.cc:515] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.510771  4573 leader_election.cc:290] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:46.511607  4495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:46.511790  4644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5090d38316e8499ab5e2da4f5c729223" candidate_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:46.512293  4495 raft_consensus.cc:3060] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.512354  4644 raft_consensus.cc:3055] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.512749  4644 raft_consensus.cc:740] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:46.513577  4644 consensus_queue.cc:260] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.514844  4644 raft_consensus.cc:3060] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.519418  4495 raft_consensus.cc:2468] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:46.520808  4537 leader_election.cc:304] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59324aad473f43b6afa1dd69094a82d9, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:46.521514  4844 raft_consensus.cc:2804] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.521528  4644 raft_consensus.cc:2468] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d841b7678b5f4a279c9b24c5c3095fd2 in term 2.
I20260709 13:13:46.522096  4844 raft_consensus.cc:697] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Leader. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:46.522830  4844 consensus_queue.cc:237] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.529341  4397 catalog_manager.cc:5697] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 reported cstate change: term changed from 1 to 2, leader changed from 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67) to d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.590236  4849 raft_consensus.cc:993] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: : Instructing follower 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:46.590665  4844 raft_consensus.cc:1081] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Signalling peer 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:46.592052  4495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:35714
I20260709 13:13:46.592519  4495 raft_consensus.cc:493] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.592792  4495 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.597896  4495 raft_consensus.cc:515] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.599557  4495 leader_election.cc:290] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:46.600574  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:46.600613  4644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:46.601339  4573 raft_consensus.cc:3055] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.601406  4644 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.601650  4573 raft_consensus.cc:740] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:46.602432  4573 consensus_queue.cc:260] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.603384  4573 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.606791  4644 raft_consensus.cc:2468] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:46.607892  4463 leader_election.cc:304] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:46.608582  4845 raft_consensus.cc:2804] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.608513  4573 raft_consensus.cc:2468] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:46.609229  4845 raft_consensus.cc:697] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:46.610117  4845 consensus_queue.cc:237] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.612478  4849 raft_consensus.cc:993] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: : Instructing follower 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:46.612986  4844 raft_consensus.cc:1081] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Signalling peer 59324aad473f43b6afa1dd69094a82d9 to start an election
I20260709 13:13:46.615160  4495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
 from {username='slave'} at 127.0.0.1:35714
I20260709 13:13:46.615715  4495 raft_consensus.cc:493] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:46.616111  4495 raft_consensus.cc:3060] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.617717  4397 catalog_manager.cc:5697] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 1 to 2, leader changed from d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66) to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:46.621598  4495 raft_consensus.cc:515] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.623624  4495 leader_election.cc:290] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Requested vote from peers d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263), 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67:33723)
I20260709 13:13:46.624266  4573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:46.624922  4573 raft_consensus.cc:3055] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:46.625015  4644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab87b2041d240eb8b3f517f2dac9e14" candidate_uuid: "59324aad473f43b6afa1dd69094a82d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
I20260709 13:13:46.625293  4573 raft_consensus.cc:740] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:46.625666  4644 raft_consensus.cc:3060] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.626169  4573 consensus_queue.cc:260] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.627509  4573 raft_consensus.cc:3060] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:46.632995  4644 raft_consensus.cc:2468] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:46.634315  4463 leader_election.cc:304] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:46.634594  4573 raft_consensus.cc:2468] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59324aad473f43b6afa1dd69094a82d9 in term 2.
I20260709 13:13:46.635175  4845 raft_consensus.cc:2804] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:46.635648  4845 raft_consensus.cc:697] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Becoming Leader. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:46.636425  4845 consensus_queue.cc:237] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:46.642903  4397 catalog_manager.cc:5697] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 reported cstate change: term changed from 1 to 2, leader changed from d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66) to 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65). New cstate: current_term: 2 leader_uuid: "59324aad473f43b6afa1dd69094a82d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: UNKNOWN } } }
W20260709 13:13:46.796056  4520 debug-util.cc:398] Leaking SignalData structure 0x7b0800136a80 after lost signal to thread 28568
W20260709 13:13:46.797103  4520 debug-util.cc:398] Leaking SignalData structure 0x7b080029bc60 after lost signal to thread 4431
W20260709 13:13:46.798139  4520 debug-util.cc:398] Leaking SignalData structure 0x7b08001741c0 after lost signal to thread 4523
W20260709 13:13:46.799010  4520 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4ae0 after lost signal to thread 4598
W20260709 13:13:46.799885  4520 debug-util.cc:398] Leaking SignalData structure 0x7b080029d1e0 after lost signal to thread 4672
W20260709 13:13:46.800346  4520 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5800 after lost signal to thread 4830
I20260709 13:13:46.971879  4495 raft_consensus.cc:1275] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:46.973277  4849 consensus_queue.cc:1048] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.000774  4644 raft_consensus.cc:1275] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.003486  4644 raft_consensus.cc:1275] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.005254  4849 consensus_queue.cc:1048] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.012064  4849 consensus_queue.cc:1048] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.027081  4644 raft_consensus.cc:1275] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.027619  4495 raft_consensus.cc:1275] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.030823  4849 consensus_queue.cc:1048] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.036706  4844 consensus_queue.cc:1048] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.051841  4496 raft_consensus.cc:1275] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer d841b7678b5f4a279c9b24c5c3095fd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.054567  4849 consensus_queue.cc:1048] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.061591  4573 raft_consensus.cc:1275] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.064021  4879 consensus_queue.cc:1048] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.075344  4644 raft_consensus.cc:1275] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.077178  4845 consensus_queue.cc:1048] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.131098  4573 raft_consensus.cc:1275] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.132606  4807 consensus_queue.cc:1048] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:47.150288  4644 raft_consensus.cc:1275] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Refusing update from remote peer 59324aad473f43b6afa1dd69094a82d9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:47.154273  4807 consensus_queue.cc:1048] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:49.426983  4397 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45292:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:49.453368  4397 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:45292:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:49.481000 28565 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:49.635136  4933 tablet.cc:1724] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.642946  4945 tablet.cc:1724] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:49.671011  4600 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:304f0732e0a44e979a2800654c98d323)
W20260709 13:13:49.688187  4464 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.66:33263, user_credentials={real_user=slave}} blocked reactor thread for 59830.3us
I20260709 13:13:49.638510  4939 tablet.cc:1724] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:49.695516  4463 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:33723, user_credentials={real_user=slave}} blocked reactor thread for 56021.6us
W20260709 13:13:49.747788  4674 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:5c3f659b03144956baed52244d91d9cc)
W20260709 13:13:49.752362  4674 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:5c3f659b03144956baed52244d91d9cc)
I20260709 13:13:49.751828  4942 tablet.cc:1724] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.775595  4943 tablet.cc:1724] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.720899  4937 tablet.cc:1724] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.842377  4942 tablet.cc:1724] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:49.846827  4938 log.cc:927] Time spent T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 13:13:49.719262  4936 tablet.cc:1724] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.864602  4943 tablet.cc:1724] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.894874  4952 tablet.cc:1724] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.940068  4957 tablet.cc:1724] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.954272  4497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
mode: GRACEFUL
new_leader_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:57830
I20260709 13:13:49.954998  4497 raft_consensus.cc:606] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Received request to transfer leadership to TS 0858cdfc2547473c99e557330fa1ddaa
I20260709 13:13:49.976202  4396 catalog_manager.cc:5789] TS 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795) does not have the latest schema for tablet 6246c1262d61468eae1af4da2c7a720b (table soft_deleted_table [id=492a42a3c77d4344b690118b03144202]). Expected version 1 got 0
I20260709 13:13:49.980845  4396 catalog_manager.cc:5789] TS 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795) does not have the latest schema for tablet 4ab87b2041d240eb8b3f517f2dac9e14 (table soft_deleted_table [id=492a42a3c77d4344b690118b03144202]). Expected version 1 got 0
W20260709 13:13:49.989338  4611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.65:44795, user_credentials={real_user=slave}} blocked reactor thread for 54380.6us
I20260709 13:13:49.957190  4939 tablet.cc:1724] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.962047  4933 tablet.cc:1724] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.993803  4958 tablet.cc:1724] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.998428  4960 tablet.cc:1724] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:49.999770  4937 tablet.cc:1724] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.009765  4943 tablet.cc:1724] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.020186  4954 tablet.cc:1724] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.024780  4945 tablet.cc:1724] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:50.034601  4956 log.cc:927] Time spent T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:13:50.043068  4954 tablet.cc:1724] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.051791  4936 tablet.cc:1724] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.020589  4942 tablet.cc:1724] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.071820  4933 tablet.cc:1724] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.081784  4568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
mode: GRACEFUL
new_leader_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:43248
I20260709 13:13:50.082459  4568 raft_consensus.cc:606] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Received request to transfer leadership to TS 0858cdfc2547473c99e557330fa1ddaa
I20260709 13:13:50.085083 28565 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:50.086294 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:50.092840  4936 tablet.cc:1724] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.104223  4568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21"
dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
mode: GRACEFUL
new_leader_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:43248
I20260709 13:13:50.104839  4568 raft_consensus.cc:606] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Received request to transfer leadership to TS 0858cdfc2547473c99e557330fa1ddaa
I20260709 13:13:50.107442  4945 tablet.cc:1724] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.109558  4957 tablet.cc:1724] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.111374  4497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f"
dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
mode: GRACEFUL
new_leader_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:57830
I20260709 13:13:50.112110  4497 raft_consensus.cc:606] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Received request to transfer leadership to TS 0858cdfc2547473c99e557330fa1ddaa
I20260709 13:13:50.114565 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:50.115319 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:50.118145  4958 tablet.cc:1724] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:50.126068  4948 raft_consensus.cc:993] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9: : Instructing follower 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.126667  4948 raft_consensus.cc:1081] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Signalling peer 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.128923  4645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:33526
I20260709 13:13:50.129528  4645 raft_consensus.cc:493] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.129909  4645 raft_consensus.cc:3060] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.157416  4645 raft_consensus.cc:515] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.162846  4645 leader_election.cc:290] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 2 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:50.164881  4568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:50.165650  4568 raft_consensus.cc:3060] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.167042  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe00d12d3da4a6bbbfb207dbbd86b2f" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:50.167778  4497 raft_consensus.cc:3055] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:50.168134  4497 raft_consensus.cc:740] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:50.169027  4497 consensus_queue.cc:260] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.171296  4497 raft_consensus.cc:3060] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:50.174784  4568 raft_consensus.cc:2468] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 2.
I20260709 13:13:50.176281  4613 leader_election.cc:304] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:50.178730  4967 raft_consensus.cc:2804] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:50.179252  4967 raft_consensus.cc:697] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 2 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:50.180123  4967 consensus_queue.cc:237] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.181865  4497 raft_consensus.cc:2468] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 2.
I20260709 13:13:50.185863  4966 raft_consensus.cc:993] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2: : Instructing follower 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.186371  4966 raft_consensus.cc:1081] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Signalling peer 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.189646  4645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:13:50.190311  4645 raft_consensus.cc:493] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.190683  4645 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.199184  4645 raft_consensus.cc:515] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.201170  4645 leader_election.cc:290] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 3 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:50.202368  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:50.205000  4497 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.203080  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bd3a8a37594b6f8ebee90240db8a21" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:50.208897  4572 raft_consensus.cc:3055] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:50.209267  4572 raft_consensus.cc:740] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:50.210117  4572 consensus_queue.cc:260] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.206346  4397 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112: soft_deleted_table [id=492a42a3c77d4344b690118b03144202] alter complete (version 1)
I20260709 13:13:50.211206  4572 raft_consensus.cc:3060] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.217555  4572 raft_consensus.cc:2468] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 3.
I20260709 13:13:50.218734  4613 leader_election.cc:304] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:50.219699  4959 raft_consensus.cc:2804] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:50.220181  4959 raft_consensus.cc:697] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 3 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:50.220932  4497 raft_consensus.cc:2468] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 3.
I20260709 13:13:50.221057  4959 consensus_queue.cc:237] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.229362  4397 catalog_manager.cc:5697] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 1 to 2, leader changed from 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65) to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 2 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.242647  4397 catalog_manager.cc:5697] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 2 to 3, leader changed from d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66) to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 3 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.354609  4889 raft_consensus.cc:993] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: : Instructing follower 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.355036  4948 raft_consensus.cc:1081] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Signalling peer 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.356693  4645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:33526
I20260709 13:13:50.357232  4645 raft_consensus.cc:493] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.357617  4645 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.363524  4645 raft_consensus.cc:515] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.365393  4645 leader_election.cc:290] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 3 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:50.366845  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:50.367486  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6246c1262d61468eae1af4da2c7a720b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:50.367482  4572 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.369218  4497 raft_consensus.cc:3055] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:50.369704  4497 raft_consensus.cc:740] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59324aad473f43b6afa1dd69094a82d9, State: Running, Role: LEADER
I20260709 13:13:50.370747  4497 consensus_queue.cc:260] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.372143  4497 raft_consensus.cc:3060] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.374066  4572 raft_consensus.cc:2468] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 3.
I20260709 13:13:50.375229  4613 leader_election.cc:304] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, d841b7678b5f4a279c9b24c5c3095fd2; no voters: 
I20260709 13:13:50.375850  4959 raft_consensus.cc:2804] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:50.376242  4959 raft_consensus.cc:697] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 3 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:50.377027  4959 consensus_queue.cc:237] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.379710  4497 raft_consensus.cc:2468] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 3.
I20260709 13:13:50.383796  4397 catalog_manager.cc:5697] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 2 to 3, leader changed from 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65) to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 3 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.426710  4964 raft_consensus.cc:993] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: : Instructing follower 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.427364  4890 raft_consensus.cc:1081] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Signalling peer 0858cdfc2547473c99e557330fa1ddaa to start an election
I20260709 13:13:50.428959  4645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b"
dest_uuid: "0858cdfc2547473c99e557330fa1ddaa"
 from {username='slave'} at 127.0.0.1:33510
I20260709 13:13:50.429472  4645 raft_consensus.cc:493] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:50.429831  4645 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.437556  4645 raft_consensus.cc:515] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.439640  4645 leader_election.cc:290] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 3 election: Requested vote from peers 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795), d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263)
I20260709 13:13:50.440265  4572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d841b7678b5f4a279c9b24c5c3095fd2"
I20260709 13:13:50.440686  4497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fbee1663964faa86557d022a4f1e6b" candidate_uuid: "0858cdfc2547473c99e557330fa1ddaa" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "59324aad473f43b6afa1dd69094a82d9"
I20260709 13:13:50.440934  4572 raft_consensus.cc:3055] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:50.441342  4572 raft_consensus.cc:740] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d841b7678b5f4a279c9b24c5c3095fd2, State: Running, Role: LEADER
I20260709 13:13:50.441362  4497 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.442225  4572 consensus_queue.cc:260] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.443413  4572 raft_consensus.cc:3060] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:50.446759  4497 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 3.
I20260709 13:13:50.447952  4611 leader_election.cc:304] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0858cdfc2547473c99e557330fa1ddaa, 59324aad473f43b6afa1dd69094a82d9; no voters: 
I20260709 13:13:50.448735  4959 raft_consensus.cc:2804] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:50.450174  4572 raft_consensus.cc:2468] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0858cdfc2547473c99e557330fa1ddaa in term 3.
I20260709 13:13:50.450302  4959 raft_consensus.cc:697] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 3 LEADER]: Becoming Leader. State: Replica: 0858cdfc2547473c99e557330fa1ddaa, State: Running, Role: LEADER
I20260709 13:13:50.451277  4959 consensus_queue.cc:237] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } }
I20260709 13:13:50.459618  4397 catalog_manager.cc:5697] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa reported cstate change: term changed from 2 to 3, leader changed from d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66) to 0858cdfc2547473c99e557330fa1ddaa (127.27.229.67). New cstate: current_term: 3 leader_uuid: "0858cdfc2547473c99e557330fa1ddaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0858cdfc2547473c99e557330fa1ddaa" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 33723 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:50.628711  4497 raft_consensus.cc:1275] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.630046  4959 consensus_queue.cc:1048] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.653330  4572 raft_consensus.cc:1275] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:50.654707  4961 consensus_queue.cc:1048] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:50.756742  4497 raft_consensus.cc:1275] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:50.758070  4961 consensus_queue.cc:1048] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:50.770875  4572 raft_consensus.cc:1275] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:50.772300  4961 consensus_queue.cc:1048] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:50.803305  4497 raft_consensus.cc:1275] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:50.804818  4961 consensus_queue.cc:1048] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:50.814863  4572 raft_consensus.cc:1275] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:50.816099  4959 consensus_queue.cc:1048] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:50.949424  4572 raft_consensus.cc:1275] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:50.951148  4959 consensus_queue.cc:1048] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "d841b7678b5f4a279c9b24c5c3095fd2" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 33263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:50.959095  4497 raft_consensus.cc:1275] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Refusing update from remote peer 0858cdfc2547473c99e557330fa1ddaa: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:50.960502  4959 consensus_queue.cc:1048] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "59324aad473f43b6afa1dd69094a82d9" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 44795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:51.180191 28565 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:51.185808 28565 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:51.186267 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:51.191128 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:51.191555 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:52.225193 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
I20260709 13:13:52.258991 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:52.259821 28565 tablet_replica.cc:333] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.260921 28565 raft_consensus.cc:2243] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.262305 28565 raft_consensus.cc:2272] T 5c3f659b03144956baed52244d91d9cc P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.265139 28565 tablet_replica.cc:333] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.265966 28565 raft_consensus.cc:2243] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.266664 28565 raft_consensus.cc:2272] T ecd333db42324b90bec2830bc628d7a7 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.269399 28565 tablet_replica.cc:333] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.270155 28565 raft_consensus.cc:2243] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.270705 28565 raft_consensus.cc:2272] T 73fbee1663964faa86557d022a4f1e6b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.273303 28565 tablet_replica.cc:333] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.273900 28565 raft_consensus.cc:2243] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.274600 28565 raft_consensus.cc:2272] T 6246c1262d61468eae1af4da2c7a720b P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.277305 28565 tablet_replica.cc:333] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.278169 28565 raft_consensus.cc:2243] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.279203 28565 raft_consensus.cc:2272] T c961e86c5aa249d48e99b91b96361cf1 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.281826 28565 tablet_replica.cc:333] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.282509 28565 raft_consensus.cc:2243] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.283133 28565 raft_consensus.cc:2272] T 5090d38316e8499ab5e2da4f5c729223 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.285809 28565 tablet_replica.cc:333] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.286580 28565 raft_consensus.cc:2243] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.287205 28565 raft_consensus.cc:2272] T 304f0732e0a44e979a2800654c98d323 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.290468 28565 tablet_replica.cc:333] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.291268 28565 raft_consensus.cc:2243] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.292122 28565 raft_consensus.cc:2272] T b67df054428f4e2aa1793a55d8673c72 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.295331 28565 tablet_replica.cc:333] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.295992 28565 raft_consensus.cc:2243] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.296537 28565 raft_consensus.cc:2272] T b9d2295fe5ef4121b5e5008c1ed29b7b P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.299003 28565 tablet_replica.cc:333] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.299554 28565 raft_consensus.cc:2243] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.300069 28565 raft_consensus.cc:2272] T 5d46235579ed4b40abf4ebadfcdb3e31 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.302384 28565 tablet_replica.cc:333] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.302891 28565 raft_consensus.cc:2243] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.303853 28565 raft_consensus.cc:2272] T 4ab87b2041d240eb8b3f517f2dac9e14 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.306223 28565 tablet_replica.cc:333] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.306819 28565 raft_consensus.cc:2243] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.307476 28565 raft_consensus.cc:2272] T 419cf52b840c4905a2643a40bbff51e9 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.310616 28565 tablet_replica.cc:333] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.311288 28565 raft_consensus.cc:2243] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.312238 28565 raft_consensus.cc:2272] T 49bd3a8a37594b6f8ebee90240db8a21 P 59324aad473f43b6afa1dd69094a82d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.315141 28565 tablet_replica.cc:333] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.315737 28565 raft_consensus.cc:2243] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.316274 28565 raft_consensus.cc:2272] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.318584 28565 tablet_replica.cc:333] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.319152 28565 raft_consensus.cc:2243] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.319644 28565 raft_consensus.cc:2272] T 7cbd9bc437a747c384b5227ae8a1c544 P 59324aad473f43b6afa1dd69094a82d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.322235 28565 tablet_replica.cc:333] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.322757 28565 raft_consensus.cc:2243] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.323701 28565 raft_consensus.cc:2272] T ea459e87d00644419a36f8872ae4078c P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.326313 28565 tablet_replica.cc:333] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.326848 28565 raft_consensus.cc:2243] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.327936 28565 raft_consensus.cc:2272] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.331431 28565 tablet_replica.cc:333] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9: stopping tablet replica
I20260709 13:13:52.332005 28565 raft_consensus.cc:2243] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.333262 28565 raft_consensus.cc:2272] T 90d9414d059e4a8a8b699a0a45e434f1 P 59324aad473f43b6afa1dd69094a82d9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.362938  4537 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:13:52.368924  4537 consensus_peers.cc:597] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.376082  4611 consensus_peers.cc:597] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.382970  4537 consensus_peers.cc:597] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.403400 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
W20260709 13:13:52.436296  4611 consensus_peers.cc:597] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.440177  4611 consensus_peers.cc:597] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.457304 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
W20260709 13:13:52.471704  4611 consensus_peers.cc:597] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:52.489137  4537 consensus_peers.cc:597] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.491397 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:52.492221 28565 tablet_replica.cc:333] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.493038 28565 raft_consensus.cc:2243] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.494412 28565 raft_consensus.cc:2272] T b67df054428f4e2aa1793a55d8673c72 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.497526  4613 consensus_peers.cc:597] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa -> Peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Couldn't send request to peer d841b7678b5f4a279c9b24c5c3095fd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.497660 28565 tablet_replica.cc:333] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.498706 28565 raft_consensus.cc:2243] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.499732 28565 raft_consensus.cc:2272] T 5090d38316e8499ab5e2da4f5c729223 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.502007 28565 tablet_replica.cc:333] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.502611 28565 raft_consensus.cc:2243] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.503167 28565 raft_consensus.cc:2272] T c961e86c5aa249d48e99b91b96361cf1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.505590 28565 tablet_replica.cc:333] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.506282 28565 raft_consensus.cc:2243] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.507218 28565 raft_consensus.cc:2272] T 304f0732e0a44e979a2800654c98d323 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.509639 28565 tablet_replica.cc:333] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.510273 28565 raft_consensus.cc:2243] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.510830 28565 raft_consensus.cc:2272] T 5c3f659b03144956baed52244d91d9cc P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.512974 28565 tablet_replica.cc:333] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.513574 28565 raft_consensus.cc:2243] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.514145 28565 raft_consensus.cc:2272] T ecd333db42324b90bec2830bc628d7a7 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.516803 28565 tablet_replica.cc:333] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.517396 28565 raft_consensus.cc:2243] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.517889 28565 raft_consensus.cc:2272] T 73fbee1663964faa86557d022a4f1e6b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.520140 28565 tablet_replica.cc:333] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.520705 28565 raft_consensus.cc:2243] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.521602 28565 raft_consensus.cc:2272] T b9d2295fe5ef4121b5e5008c1ed29b7b P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.523867 28565 tablet_replica.cc:333] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.524441 28565 raft_consensus.cc:2243] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.525309 28565 raft_consensus.cc:2272] T 5d46235579ed4b40abf4ebadfcdb3e31 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.527704 28565 tablet_replica.cc:333] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.528267 28565 raft_consensus.cc:2243] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.528767 28565 raft_consensus.cc:2272] T 90d9414d059e4a8a8b699a0a45e434f1 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.530862 28565 tablet_replica.cc:333] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.531389 28565 raft_consensus.cc:2243] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.531958 28565 raft_consensus.cc:2272] T 4ab87b2041d240eb8b3f517f2dac9e14 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.534116 28565 tablet_replica.cc:333] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.534652 28565 raft_consensus.cc:2243] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.535506 28565 raft_consensus.cc:2272] T 419cf52b840c4905a2643a40bbff51e9 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.537642 28565 tablet_replica.cc:333] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.538177 28565 raft_consensus.cc:2243] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.538708 28565 raft_consensus.cc:2272] T 49bd3a8a37594b6f8ebee90240db8a21 P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.540779 28565 tablet_replica.cc:333] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.541270 28565 raft_consensus.cc:2243] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.541698 28565 raft_consensus.cc:2272] T 7cbd9bc437a747c384b5227ae8a1c544 P d841b7678b5f4a279c9b24c5c3095fd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.543880 28565 tablet_replica.cc:333] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.544420 28565 raft_consensus.cc:2243] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.544852 28565 raft_consensus.cc:2272] T ebe00d12d3da4a6bbbfb207dbbd86b2f P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.547039 28565 tablet_replica.cc:333] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.547546 28565 raft_consensus.cc:2243] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.548080 28565 raft_consensus.cc:2272] T 6246c1262d61468eae1af4da2c7a720b P d841b7678b5f4a279c9b24c5c3095fd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.550225 28565 tablet_replica.cc:333] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.550755 28565 raft_consensus.cc:2243] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.551262 28565 raft_consensus.cc:2272] T ea459e87d00644419a36f8872ae4078c P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.553481 28565 tablet_replica.cc:333] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2: stopping tablet replica
I20260709 13:13:52.554011 28565 raft_consensus.cc:2243] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.554597 28565 raft_consensus.cc:2272] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P d841b7678b5f4a279c9b24c5c3095fd2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:52.557358  4613 consensus_peers.cc:597] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa -> Peer d841b7678b5f4a279c9b24c5c3095fd2 (127.27.229.66:33263): Couldn't send request to peer d841b7678b5f4a279c9b24c5c3095fd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.597127 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
I20260709 13:13:52.636073 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
W20260709 13:13:52.641997  4611 consensus_peers.cc:597] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.666604 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:52.667673 28565 tablet_replica.cc:333] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.668550 28565 raft_consensus.cc:2243] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:13:52.668562  4611 consensus_peers.cc:597] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa -> Peer 59324aad473f43b6afa1dd69094a82d9 (127.27.229.65:44795): Couldn't send request to peer 59324aad473f43b6afa1dd69094a82d9. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:44795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:52.669581 28565 raft_consensus.cc:2272] T ecd333db42324b90bec2830bc628d7a7 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.671818 28565 tablet_replica.cc:333] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.672444 28565 raft_consensus.cc:2243] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.673249 28565 raft_consensus.cc:2272] T 73fbee1663964faa86557d022a4f1e6b P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.675382 28565 tablet_replica.cc:333] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.675930 28565 raft_consensus.cc:2243] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.676407 28565 raft_consensus.cc:2272] T 5c3f659b03144956baed52244d91d9cc P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.678526 28565 tablet_replica.cc:333] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.679105 28565 raft_consensus.cc:2243] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.679559 28565 raft_consensus.cc:2272] T 304f0732e0a44e979a2800654c98d323 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.681607 28565 tablet_replica.cc:333] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.682157 28565 raft_consensus.cc:2243] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.682930 28565 raft_consensus.cc:2272] T 6246c1262d61468eae1af4da2c7a720b P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.685045 28565 tablet_replica.cc:333] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.685561 28565 raft_consensus.cc:2243] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.686086 28565 raft_consensus.cc:2272] T b67df054428f4e2aa1793a55d8673c72 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.688170 28565 tablet_replica.cc:333] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.688681 28565 raft_consensus.cc:2243] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.689527 28565 raft_consensus.cc:2272] T ebe00d12d3da4a6bbbfb207dbbd86b2f P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.691653 28565 tablet_replica.cc:333] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.692206 28565 raft_consensus.cc:2243] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.692674 28565 raft_consensus.cc:2272] T c961e86c5aa249d48e99b91b96361cf1 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.694974 28565 tablet_replica.cc:333] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.695501 28565 raft_consensus.cc:2243] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.696013 28565 raft_consensus.cc:2272] T 5090d38316e8499ab5e2da4f5c729223 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.698096 28565 tablet_replica.cc:333] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.698653 28565 raft_consensus.cc:2243] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.699122 28565 raft_consensus.cc:2272] T 83fce1e7194f4a25b5dcfa67bcca3bc5 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.701102 28565 tablet_replica.cc:333] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.701624 28565 raft_consensus.cc:2243] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.702136 28565 raft_consensus.cc:2272] T ea459e87d00644419a36f8872ae4078c P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.704246 28565 tablet_replica.cc:333] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.704770 28565 raft_consensus.cc:2243] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.705243 28565 raft_consensus.cc:2272] T 90d9414d059e4a8a8b699a0a45e434f1 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.707373 28565 tablet_replica.cc:333] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.707888 28565 raft_consensus.cc:2243] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.708721 28565 raft_consensus.cc:2272] T 7cbd9bc437a747c384b5227ae8a1c544 P 0858cdfc2547473c99e557330fa1ddaa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.710842 28565 tablet_replica.cc:333] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.711387 28565 raft_consensus.cc:2243] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.712044 28565 raft_consensus.cc:2272] T 5d46235579ed4b40abf4ebadfcdb3e31 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.714103 28565 tablet_replica.cc:333] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.714627 28565 raft_consensus.cc:2243] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.715082 28565 raft_consensus.cc:2272] T b9d2295fe5ef4121b5e5008c1ed29b7b P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.717228 28565 tablet_replica.cc:333] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.717799 28565 raft_consensus.cc:2243] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.718647 28565 raft_consensus.cc:2272] T 49bd3a8a37594b6f8ebee90240db8a21 P 0858cdfc2547473c99e557330fa1ddaa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.720849 28565 tablet_replica.cc:333] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.721372 28565 raft_consensus.cc:2243] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.721820 28565 raft_consensus.cc:2272] T 4ab87b2041d240eb8b3f517f2dac9e14 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.723982 28565 tablet_replica.cc:333] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa: stopping tablet replica
I20260709 13:13:52.724474 28565 raft_consensus.cc:2243] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:52.724937 28565 raft_consensus.cc:2272] T 419cf52b840c4905a2643a40bbff51e9 P 0858cdfc2547473c99e557330fa1ddaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.764639 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
I20260709 13:13:52.802066 28565 master.cc:562] Master@127.27.229.126:41665 shutting down...
I20260709 13:13:52.825366 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:52.826052 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:52.826411 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9e5d5b965b8840bd8dd12844f982a112: stopping tablet replica
I20260709 13:13:52.846377 28565 master.cc:584] Master@127.27.229.126:41665 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13327 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:52.895797 28565 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.27.229.126:34401
I20260709 13:13:52.896919 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:52.903096  4995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:52.903187  4996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:52.904069  4998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:52.904179 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:52.905172 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:52.905366 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:52.905522 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602832905503 us; error 0 us; skew 500 ppm
I20260709 13:13:52.906307 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:52.908653 28565 webserver.cc:533] Webserver started at http://127.27.229.126:44815/ using document root <none> and password file <none>
I20260709 13:13:52.909138 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:52.909320 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:52.909596 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:52.910799 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/master-0-root/instance:
uuid: "8885e1783b4a4c5397a1b43c20016a8f"
format_stamp: "Formatted at 2026-07-09 13:13:52 on dist-test-slave-twc1"
I20260709 13:13:52.915123 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:13:52.918421  5003 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:52.919190 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:52.919459 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/master-0-root
uuid: "8885e1783b4a4c5397a1b43c20016a8f"
format_stamp: "Formatted at 2026-07-09 13:13:52 on dist-test-slave-twc1"
I20260709 13:13:52.919700 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:52.929646 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:52.930887 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:52.969027 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.126:34401
I20260709 13:13:52.969131  5054 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.126:34401 every 8 connection(s)
I20260709 13:13:52.973263  5055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:52.985399  5055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f: Bootstrap starting.
I20260709 13:13:52.990381  5055 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:52.994808  5055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f: No bootstrap required, opened a new log
I20260709 13:13:52.997138  5055 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8885e1783b4a4c5397a1b43c20016a8f" member_type: VOTER }
I20260709 13:13:52.997581  5055 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:52.997816  5055 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8885e1783b4a4c5397a1b43c20016a8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:52.998428  5055 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8885e1783b4a4c5397a1b43c20016a8f" member_type: VOTER }
I20260709 13:13:52.998917  5055 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:52.999140  5055 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:52.999409  5055 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:53.004299  5055 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8885e1783b4a4c5397a1b43c20016a8f" member_type: VOTER }
I20260709 13:13:53.004843  5055 leader_election.cc:304] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8885e1783b4a4c5397a1b43c20016a8f; no voters: 
I20260709 13:13:53.006026  5055 leader_election.cc:290] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:53.006454  5058 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:53.007805  5058 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 1 LEADER]: Becoming Leader. State: Replica: 8885e1783b4a4c5397a1b43c20016a8f, State: Running, Role: LEADER
I20260709 13:13:53.008519  5058 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8885e1783b4a4c5397a1b43c20016a8f" member_type: VOTER }
I20260709 13:13:53.008903  5055 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:53.013341  5060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8885e1783b4a4c5397a1b43c20016a8f. Latest consensus state: current_term: 1 leader_uuid: "8885e1783b4a4c5397a1b43c20016a8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8885e1783b4a4c5397a1b43c20016a8f" member_type: VOTER } }
I20260709 13:13:53.013404  5059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8885e1783b4a4c5397a1b43c20016a8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8885e1783b4a4c5397a1b43c20016a8f" member_type: VOTER } }
I20260709 13:13:53.014279  5059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:53.014204  5060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:53.021247  5066 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:53.026314  5066 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:53.027345 28565 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:53.036347  5066 catalog_manager.cc:1383] Generated new cluster ID: b405310ceb4d4104baf9df7d0e5660c5
I20260709 13:13:53.036646  5066 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:53.075001  5066 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:53.076292  5066 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:53.091485  5066 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f: Generated new TSK 0
I20260709 13:13:53.092064  5066 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:53.158591 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:53.164986  5076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.166196  5077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.167639  5079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.168105 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:53.169054 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:53.169245 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:53.169409 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602833169389 us; error 0 us; skew 500 ppm
I20260709 13:13:53.170011 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:53.172318 28565 webserver.cc:533] Webserver started at http://127.27.229.65:33927/ using document root <none> and password file <none>
I20260709 13:13:53.172789 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:53.172958 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:53.173214 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:53.174314 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-0-root/instance:
uuid: "c7c79888505d4f2f86b4b9c06753c04e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-twc1"
I20260709 13:13:53.178768 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:53.182173  5084 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.182928 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:53.183209 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-0-root
uuid: "c7c79888505d4f2f86b4b9c06753c04e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-twc1"
I20260709 13:13:53.183478 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:53.196408 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:53.197681 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:53.199476 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:53.201869 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:53.202131 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.202404 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:53.202579 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.243407 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.65:35527
I20260709 13:13:53.243525  5146 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.65:35527 every 8 connection(s)
I20260709 13:13:53.248456 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:53.255631  5151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.257251  5152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.263824  5147 heartbeater.cc:344] Connected to a master server at 127.27.229.126:34401
I20260709 13:13:53.264392  5147 heartbeater.cc:461] Registering TS with master...
W20260709 13:13:53.264881  5154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.265380  5147 heartbeater.cc:507] Master 127.27.229.126:34401 requested a full tablet report, sending...
I20260709 13:13:53.265539 28565 server_base.cc:1061] running on GCE node
I20260709 13:13:53.266923 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:53.267136 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:53.267303 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602833267284 us; error 0 us; skew 500 ppm
I20260709 13:13:53.267702  5020 ts_manager.cc:194] Registered new tserver with Master: c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:13:53.267827 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:53.269910  5020 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56680
I20260709 13:13:53.270598 28565 webserver.cc:533] Webserver started at http://127.27.229.66:34127/ using document root <none> and password file <none>
I20260709 13:13:53.271245 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:53.271461 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:53.271723 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:53.272876 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-1-root/instance:
uuid: "5b7a9ad7678346938272011c63630e31"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-twc1"
I20260709 13:13:53.277457 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:13:53.280912  5159 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.281698 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:13:53.282019 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-1-root
uuid: "5b7a9ad7678346938272011c63630e31"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-twc1"
I20260709 13:13:53.282295 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:53.362195 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:53.363473 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:53.365002 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:53.367383 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:53.367605 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.367837 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:53.367990 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.409159 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.66:44483
I20260709 13:13:53.409288  5221 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.66:44483 every 8 connection(s)
I20260709 13:13:53.414194 28565 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:53.422996  5225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:53.423275  5226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.424014 28565 server_base.cc:1061] running on GCE node
W20260709 13:13:53.424854  5228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:53.425837 28565 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:53.426131 28565 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:53.426332 28565 hybrid_clock.cc:648] HybridClock initialized: now 1783602833426311 us; error 0 us; skew 500 ppm
I20260709 13:13:53.426966 28565 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:53.428611  5222 heartbeater.cc:344] Connected to a master server at 127.27.229.126:34401
I20260709 13:13:53.428964  5222 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:53.429795  5222 heartbeater.cc:507] Master 127.27.229.126:34401 requested a full tablet report, sending...
I20260709 13:13:53.429827 28565 webserver.cc:533] Webserver started at http://127.27.229.67:43909/ using document root <none> and password file <none>
I20260709 13:13:53.430503 28565 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:53.430704 28565 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:53.430966 28565 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:53.431957  5020 ts_manager.cc:194] Registered new tserver with Master: 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:53.432193 28565 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-2-root/instance:
uuid: "0d88c0686b8f405780417f916e2f273e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-twc1"
I20260709 13:13:53.433470  5020 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56688
I20260709 13:13:53.438179 28565 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:13:53.441828  5233 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.442654 28565 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:53.442962 28565 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-2-root
uuid: "0d88c0686b8f405780417f916e2f273e"
format_stamp: "Formatted at 2026-07-09 13:13:53 on dist-test-slave-twc1"
I20260709 13:13:53.443254 28565 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasknL5WA9/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602584964583-28565-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:53.458042 28565 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:53.459296 28565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:53.460767 28565 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:53.463106 28565 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:53.463313 28565 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.463541 28565 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:53.463693 28565 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:53.503835 28565 rpc_server.cc:307] RPC server started. Bound to: 127.27.229.67:40915
I20260709 13:13:53.503937  5295 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.27.229.67:40915 every 8 connection(s)
I20260709 13:13:53.517972  5296 heartbeater.cc:344] Connected to a master server at 127.27.229.126:34401
I20260709 13:13:53.518438  5296 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:53.519233  5296 heartbeater.cc:507] Master 127.27.229.126:34401 requested a full tablet report, sending...
I20260709 13:13:53.521260  5020 ts_manager.cc:194] Registered new tserver with Master: 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:53.521431 28565 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01461038s
I20260709 13:13:53.523232  5020 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56698
I20260709 13:13:53.549150  5020 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56710:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:53.551983  5020 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:53.638271  5187 tablet_service.cc:1511] Processing CreateTablet for tablet 2daea3d597cc4a4c8935365a2e03a23a (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:53.639801  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2daea3d597cc4a4c8935365a2e03a23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.642035  5112 tablet_service.cc:1511] Processing CreateTablet for tablet 2daea3d597cc4a4c8935365a2e03a23a (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:53.643545  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2daea3d597cc4a4c8935365a2e03a23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.645009  5111 tablet_service.cc:1511] Processing CreateTablet for tablet ff5ea5df379e4100a68c3589be0d9849 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:53.645447  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 9a74b85acbfe4cc3bd5884201482ff4b (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:53.646587  5111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5ea5df379e4100a68c3589be0d9849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.647115  5260 tablet_service.cc:1511] Processing CreateTablet for tablet ff5ea5df379e4100a68c3589be0d9849 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:53.647740  5109 tablet_service.cc:1511] Processing CreateTablet for tablet be940b4505394de29c92782330c934b1 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:53.649151  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be940b4505394de29c92782330c934b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.648979  5259 tablet_service.cc:1511] Processing CreateTablet for tablet 9a74b85acbfe4cc3bd5884201482ff4b (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:53.649664  5108 tablet_service.cc:1511] Processing CreateTablet for tablet 0608bfa534fa4ad38d6ec2edfe7a442f (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:53.650425  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a74b85acbfe4cc3bd5884201482ff4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.650991  5108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0608bfa534fa4ad38d6ec2edfe7a442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.651796  5258 tablet_service.cc:1511] Processing CreateTablet for tablet be940b4505394de29c92782330c934b1 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:53.653200  5258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be940b4505394de29c92782330c934b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.653607  5107 tablet_service.cc:1511] Processing CreateTablet for tablet f0813b7dde9c4fdd993078c4419be9df (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:53.655140  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 2daea3d597cc4a4c8935365a2e03a23a (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:53.655086  5107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0813b7dde9c4fdd993078c4419be9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.656616  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2daea3d597cc4a4c8935365a2e03a23a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.657749  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a74b85acbfe4cc3bd5884201482ff4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.650522  5257 tablet_service.cc:1511] Processing CreateTablet for tablet 0608bfa534fa4ad38d6ec2edfe7a442f (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:53.659404  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0608bfa534fa4ad38d6ec2edfe7a442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.659704  5186 tablet_service.cc:1511] Processing CreateTablet for tablet ff5ea5df379e4100a68c3589be0d9849 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:53.661150  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5ea5df379e4100a68c3589be0d9849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.662755  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5ea5df379e4100a68c3589be0d9849. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.671823  5185 tablet_service.cc:1511] Processing CreateTablet for tablet 9a74b85acbfe4cc3bd5884201482ff4b (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:53.673432  5185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a74b85acbfe4cc3bd5884201482ff4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.679711  5184 tablet_service.cc:1511] Processing CreateTablet for tablet be940b4505394de29c92782330c934b1 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:53.681350  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be940b4505394de29c92782330c934b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.686470  5256 tablet_service.cc:1511] Processing CreateTablet for tablet f0813b7dde9c4fdd993078c4419be9df (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:53.688374  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0813b7dde9c4fdd993078c4419be9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.702389  5183 tablet_service.cc:1511] Processing CreateTablet for tablet 0608bfa534fa4ad38d6ec2edfe7a442f (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:53.703939  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0608bfa534fa4ad38d6ec2edfe7a442f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.711163  5182 tablet_service.cc:1511] Processing CreateTablet for tablet f0813b7dde9c4fdd993078c4419be9df (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:53.712776  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0813b7dde9c4fdd993078c4419be9df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.718657  5106 tablet_service.cc:1511] Processing CreateTablet for tablet 8000d55e864e4f40bc76f6f61c8acfe9 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:53.722229  5311 tablet_bootstrap.cc:492] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:53.729496  5258 tablet_service.cc:1511] Processing CreateTablet for tablet 8000d55e864e4f40bc76f6f61c8acfe9 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:53.731101  5258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8000d55e864e4f40bc76f6f61c8acfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.731518  5311 tablet_bootstrap.cc:654] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.732170  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 8000d55e864e4f40bc76f6f61c8acfe9 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:53.733667  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8000d55e864e4f40bc76f6f61c8acfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.747128  5311 tablet_bootstrap.cc:492] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:53.748805  5311 ts_tablet_manager.cc:1403] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.002s
I20260709 13:13:53.751883  5311 raft_consensus.cc:359] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.752622  5311 raft_consensus.cc:385] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.752928  5311 raft_consensus.cc:740] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.753739  5311 consensus_queue.cc:260] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.761229  5105 tablet_service.cc:1511] Processing CreateTablet for tablet 805755305c3341db9b9faf4823bb827e (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:53.763412  5311 ts_tablet_manager.cc:1434] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:13:53.764840  5296 heartbeater.cc:499] Master 127.27.229.126:34401 was elected leader, sending a full tablet report...
I20260709 13:13:53.765187  5105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805755305c3341db9b9faf4823bb827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.776525  5181 tablet_service.cc:1511] Processing CreateTablet for tablet 805755305c3341db9b9faf4823bb827e (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:53.778173  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805755305c3341db9b9faf4823bb827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.784551  5311 tablet_bootstrap.cc:492] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:53.784854  5106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8000d55e864e4f40bc76f6f61c8acfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.794391  5314 tablet_bootstrap.cc:492] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:53.801193  5314 tablet_bootstrap.cc:654] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.804236  5109 tablet_service.cc:1511] Processing CreateTablet for tablet bbfb0f61fc8542678397012b66fd6377 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:53.805830  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfb0f61fc8542678397012b66fd6377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.807744  5185 tablet_service.cc:1511] Processing CreateTablet for tablet bbfb0f61fc8542678397012b66fd6377 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:53.809129  5185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfb0f61fc8542678397012b66fd6377. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.814240  5314 tablet_bootstrap.cc:492] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:53.814930  5314 ts_tablet_manager.cc:1403] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.016s
I20260709 13:13:53.818096  5315 tablet_bootstrap.cc:492] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:53.818262  5314 raft_consensus.cc:359] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.809249  5261 tablet_service.cc:1511] Processing CreateTablet for tablet 805755305c3341db9b9faf4823bb827e (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:53.819252  5314 raft_consensus.cc:385] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.819770  5314 raft_consensus.cc:740] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.820231  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 805755305c3341db9b9faf4823bb827e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:53.820803  5314 consensus_queue.cc:260] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.823334  5256 tablet_service.cc:1511] Processing CreateTablet for tablet bbfb0f61fc8542678397012b66fd6377 (DEFAULT_TABLE table=test-workload [id=5429cc336386451daddc6e544b67e6cc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:53.824908  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbfb0f61fc8542678397012b66fd6377. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:13:53.872385  5007 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.27.229.65:35527, user_credentials={real_user=slave}} blocked reactor thread for 45655.5us
I20260709 13:13:53.873304  5222 heartbeater.cc:499] Master 127.27.229.126:34401 was elected leader, sending a full tablet report...
I20260709 13:13:53.874459  5311 tablet_bootstrap.cc:654] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.876264  5315 tablet_bootstrap.cc:654] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.881605  5314 ts_tablet_manager.cc:1434] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.066s	user 0.011s	sys 0.021s
I20260709 13:13:53.899899  5314 tablet_bootstrap.cc:492] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:53.906828  5314 tablet_bootstrap.cc:654] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.911216  5315 tablet_bootstrap.cc:492] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:53.911928  5315 ts_tablet_manager.cc:1403] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.017s
I20260709 13:13:53.912676  5311 tablet_bootstrap.cc:492] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:53.913280  5311 ts_tablet_manager.cc:1403] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.007s
I20260709 13:13:53.915275  5315 raft_consensus.cc:359] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.916100  5315 raft_consensus.cc:385] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.916414  5315 raft_consensus.cc:740] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.916252  5311 raft_consensus.cc:359] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.917055  5314 tablet_bootstrap.cc:492] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:53.917117  5311 raft_consensus.cc:385] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.917634  5314 ts_tablet_manager.cc:1403] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.005s
I20260709 13:13:53.917421  5315 consensus_queue.cc:260] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.917613  5311 raft_consensus.cc:740] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.919024  5311 consensus_queue.cc:260] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.920105  5147 heartbeater.cc:499] Master 127.27.229.126:34401 was elected leader, sending a full tablet report...
I20260709 13:13:53.920435  5315 ts_tablet_manager.cc:1434] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.007s
I20260709 13:13:53.920989  5314 raft_consensus.cc:359] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.921582  5315 tablet_bootstrap.cc:492] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:53.921856  5314 raft_consensus.cc:385] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.922214  5314 raft_consensus.cc:740] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.923053  5314 consensus_queue.cc:260] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.925194  5314 ts_tablet_manager.cc:1434] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:13:53.926287  5314 tablet_bootstrap.cc:492] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:53.928217  5311 ts_tablet_manager.cc:1434] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 13:13:53.928742  5315 tablet_bootstrap.cc:654] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.933638  5311 tablet_bootstrap.cc:492] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:53.938024  5314 tablet_bootstrap.cc:654] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.941212  5311 tablet_bootstrap.cc:654] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.943848  5315 tablet_bootstrap.cc:492] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:53.944465  5315 ts_tablet_manager.cc:1403] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:13:53.946841  5311 tablet_bootstrap.cc:492] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:53.947430  5311 ts_tablet_manager.cc:1403] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:13:53.950920  5311 raft_consensus.cc:359] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.951684  5311 raft_consensus.cc:385] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.951974  5311 raft_consensus.cc:740] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.952739  5311 consensus_queue.cc:260] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.953685  5314 tablet_bootstrap.cc:492] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:53.954275  5314 ts_tablet_manager.cc:1403] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.005s
I20260709 13:13:53.956595  5311 ts_tablet_manager.cc:1434] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:53.957180  5314 raft_consensus.cc:359] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.957695  5311 tablet_bootstrap.cc:492] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:53.947378  5315 raft_consensus.cc:359] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:53.958523  5315 raft_consensus.cc:385] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.958832  5315 raft_consensus.cc:740] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.959586  5315 consensus_queue.cc:260] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:53.961691  5315 ts_tablet_manager.cc:1434] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.005s
I20260709 13:13:53.962694  5315 tablet_bootstrap.cc:492] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:53.966807  5311 tablet_bootstrap.cc:654] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.969029  5315 tablet_bootstrap.cc:654] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.970032  5314 raft_consensus.cc:385] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.970420  5314 raft_consensus.cc:740] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.971166  5314 consensus_queue.cc:260] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.972633  5311 tablet_bootstrap.cc:492] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:53.973222  5311 ts_tablet_manager.cc:1403] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:13:53.973412  5314 ts_tablet_manager.cc:1434] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:13:53.974516  5314 tablet_bootstrap.cc:492] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:53.976311  5311 raft_consensus.cc:359] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.977063  5311 raft_consensus.cc:385] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:53.977372  5311 raft_consensus.cc:740] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:53.978302  5311 consensus_queue.cc:260] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:53.981009  5314 tablet_bootstrap.cc:654] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.982544  5311 ts_tablet_manager.cc:1434] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:13:53.983712  5311 tablet_bootstrap.cc:492] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:53.990944  5311 tablet_bootstrap.cc:654] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:53.996640  5315 tablet_bootstrap.cc:492] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:53.996834  5314 tablet_bootstrap.cc:492] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:53.997138  5315 ts_tablet_manager.cc:1403] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.008s
I20260709 13:13:53.997551  5314 ts_tablet_manager.cc:1403] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.014s
I20260709 13:13:54.000120  5311 tablet_bootstrap.cc:492] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:54.000010  5315 raft_consensus.cc:359] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.000730  5315 raft_consensus.cc:385] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.000744  5311 ts_tablet_manager.cc:1403] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:13:54.001057  5315 raft_consensus.cc:740] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.000885  5314 raft_consensus.cc:359] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.001858  5314 raft_consensus.cc:385] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.002231  5314 raft_consensus.cc:740] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.001956  5315 consensus_queue.cc:260] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.003119  5314 consensus_queue.cc:260] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.004123  5311 raft_consensus.cc:359] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.004886  5311 raft_consensus.cc:385] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.005169  5311 raft_consensus.cc:740] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.006134  5311 consensus_queue.cc:260] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.008275  5311 ts_tablet_manager.cc:1434] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:54.009352  5311 tablet_bootstrap.cc:492] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:54.010102  5315 ts_tablet_manager.cc:1434] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:54.011260  5315 tablet_bootstrap.cc:492] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:54.015915  5311 tablet_bootstrap.cc:654] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.017656  5315 tablet_bootstrap.cc:654] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:54.020262  5068 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:54.020730  5314 ts_tablet_manager.cc:1434] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:13:54.026988  5314 tablet_bootstrap.cc:492] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:54.027019  5315 tablet_bootstrap.cc:492] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:54.027720  5315 ts_tablet_manager.cc:1403] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.011s
I20260709 13:13:54.028265  5311 tablet_bootstrap.cc:492] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:54.028879  5311 ts_tablet_manager.cc:1403] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:13:54.030874  5315 raft_consensus.cc:359] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.031723  5315 raft_consensus.cc:385] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.032092  5315 raft_consensus.cc:740] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.031852  5311 raft_consensus.cc:359] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.032687  5311 raft_consensus.cc:385] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.032946  5314 tablet_bootstrap.cc:654] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.033004  5311 raft_consensus.cc:740] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.032953  5315 consensus_queue.cc:260] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.034138  5311 consensus_queue.cc:260] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.036415  5311 ts_tablet_manager.cc:1434] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:54.037436  5311 tablet_bootstrap.cc:492] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:54.039593  5315 ts_tablet_manager.cc:1434] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:54.041512  5315 tablet_bootstrap.cc:492] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:54.042006  5314 tablet_bootstrap.cc:492] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:54.045393  5311 tablet_bootstrap.cc:654] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.045449  5314 ts_tablet_manager.cc:1403] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:13:54.049079  5314 raft_consensus.cc:359] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.049687  5314 raft_consensus.cc:385] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.050006  5314 raft_consensus.cc:740] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.050745  5314 consensus_queue.cc:260] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.051465  5311 tablet_bootstrap.cc:492] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:54.052011  5311 ts_tablet_manager.cc:1403] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:13:54.052954  5314 ts_tablet_manager.cc:1434] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:54.054172  5315 tablet_bootstrap.cc:654] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.054251  5314 tablet_bootstrap.cc:492] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:54.054911  5311 raft_consensus.cc:359] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.055675  5311 raft_consensus.cc:385] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.055965  5311 raft_consensus.cc:740] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.056845  5311 consensus_queue.cc:260] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.059507  5311 ts_tablet_manager.cc:1434] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:54.060580  5311 tablet_bootstrap.cc:492] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:54.061457  5314 tablet_bootstrap.cc:654] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.067103  5311 tablet_bootstrap.cc:654] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.070384  5321 raft_consensus.cc:493] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.070914  5321 raft_consensus.cc:515] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.072890  5315 tablet_bootstrap.cc:492] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:54.073534  5315 ts_tablet_manager.cc:1403] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.005s
I20260709 13:13:54.074445  5314 tablet_bootstrap.cc:492] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:54.075068  5314 ts_tablet_manager.cc:1403] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.003s
I20260709 13:13:54.073518  5321 leader_election.cc:290] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.077688  5317 raft_consensus.cc:493] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.077126  5315 raft_consensus.cc:359] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.078009  5311 tablet_bootstrap.cc:492] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:54.078418  5315 raft_consensus.cc:385] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.078689  5311 ts_tablet_manager.cc:1403] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:13:54.078189  5314 raft_consensus.cc:359] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.078212  5317 raft_consensus.cc:515] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.079062  5315 raft_consensus.cc:740] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.079298  5314 raft_consensus.cc:385] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.079939  5314 raft_consensus.cc:740] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.080394  5315 consensus_queue.cc:260] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.080837  5314 consensus_queue.cc:260] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.081696  5311 raft_consensus.cc:359] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.082494  5311 raft_consensus.cc:385] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.082765  5311 raft_consensus.cc:740] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.083133  5315 ts_tablet_manager.cc:1434] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:13:54.083491  5311 consensus_queue.cc:260] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.086257  5311 ts_tablet_manager.cc:1434] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:54.087347  5311 tablet_bootstrap.cc:492] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:54.090473  5313 raft_consensus.cc:493] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.090952  5317 leader_election.cc:290] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.091091  5313 raft_consensus.cc:515] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.092195  5315 tablet_bootstrap.cc:492] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:54.092794  5314 ts_tablet_manager.cc:1434] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:13:54.093973  5314 tablet_bootstrap.cc:492] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:54.097827  5317 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.104341  5315 tablet_bootstrap.cc:654] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.101277  5313 leader_election.cc:290] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.104059  5317 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.107024  5317 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:13:54.111783  5314 tablet_bootstrap.cc:654] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.114866  5311 tablet_bootstrap.cc:654] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.116755  5315 tablet_bootstrap.cc:492] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:54.117504  5315 ts_tablet_manager.cc:1403] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:13:54.120693  5313 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.121312  5313 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.123502  5313 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.124936  5315 raft_consensus.cc:359] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.125859  5315 raft_consensus.cc:385] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.126262  5315 raft_consensus.cc:740] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.127240  5315 consensus_queue.cc:260] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.129670  5315 ts_tablet_manager.cc:1434] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:54.130494  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.130780  5315 tablet_bootstrap.cc:492] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:54.131340  5271 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:54.133216  5160 leader_election.cc:304] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.134200  5317 raft_consensus.cc:2804] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.134574  5317 raft_consensus.cc:493] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.134951  5317 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.136744  5337 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.136952  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.137306  5337 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.138012  5321 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.138799  5315 tablet_bootstrap.cc:654] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.138978  5321 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.139546  5337 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.137603  5271 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:54.141047  5321 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.141706  5160 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.142719  5337 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.143126  5337 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.143934  5337 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.144761  5317 raft_consensus.cc:515] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.149984  5317 leader_election.cc:290] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.150470  5315 tablet_bootstrap.cc:492] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:54.151135  5315 ts_tablet_manager.cc:1403] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:13:54.151885  5311 tablet_bootstrap.cc:492] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:54.152427  5311 ts_tablet_manager.cc:1403] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.001s
I20260709 13:13:54.152670  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.153347  5270 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.154248  5315 raft_consensus.cc:359] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.155074  5315 raft_consensus.cc:385] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.155229  5311 raft_consensus.cc:359] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.155980  5311 raft_consensus.cc:385] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.156267  5311 raft_consensus.cc:740] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.155755  5321 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.157150  5321 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.151177  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.158578  5271 raft_consensus.cc:2468] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:54.159328  5321 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.160550  5314 tablet_bootstrap.cc:492] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:54.160841  5315 raft_consensus.cc:740] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.161146  5314 ts_tablet_manager.cc:1403] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.000s
I20260709 13:13:54.162017  5317 raft_consensus.cc:493] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.161834  5315 consensus_queue.cc:260] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.162509  5317 raft_consensus.cc:515] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.163725  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.164495  5122 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:54.164352  5314 raft_consensus.cc:359] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.165107  5314 raft_consensus.cc:385] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.165395  5314 raft_consensus.cc:740] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.165834  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.166581  5121 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:54.166738  5317 leader_election.cc:290] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.167488  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.169116  5315 ts_tablet_manager.cc:1434] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:13:54.168998  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.169380  5311 consensus_queue.cc:260] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
W20260709 13:13:54.171113  5163 leader_election.cc:343] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.171514  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.172209  5121 raft_consensus.cc:2468] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:54.173447  5119 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.173378  5337 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.175966  5314 consensus_queue.cc:260] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.178426  5314 ts_tablet_manager.cc:1434] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:13:54.179476  5314 tablet_bootstrap.cc:492] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:54.182107  5119 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:54.182485  5337 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:13:54.176491  5315 tablet_bootstrap.cc:492] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:54.186880  5270 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:54.171546  5311 ts_tablet_manager.cc:1434] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:13:54.190099  5313 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.190644  5313 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.191788  5163 leader_election.cc:304] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.191136  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.193660  5119 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.184391  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.186862  5314 tablet_bootstrap.cc:654] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.194000  5315 tablet_bootstrap.cc:654] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.194331  5271 raft_consensus.cc:2468] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:54.185940  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.182983  5160 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:54.195387  5269 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.196327  5337 raft_consensus.cc:2804] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.196760  5337 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.192888  5313 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.197108  5337 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.203886  5269 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:54.205250  5337 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.192898  5163 leader_election.cc:304] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.212391  5337 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.214533  5160 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.216207  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.216970  5269 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.217442  5119 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:54.217767  5315 tablet_bootstrap.cc:492] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:54.218137  5337 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.218277  5315 ts_tablet_manager.cc:1403] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.001s
I20260709 13:13:54.194104  5317 raft_consensus.cc:2804] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.220247  5314 tablet_bootstrap.cc:492] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:54.220322  5317 raft_consensus.cc:493] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.220983  5317 raft_consensus.cc:3060] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.223269  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.224040  5121 raft_consensus.cc:2468] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.224856  5337 raft_consensus.cc:697] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:54.223683  5314 ts_tablet_manager.cc:1403] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.005s
I20260709 13:13:54.225148  5269 raft_consensus.cc:2468] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:54.226491  5160 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.226657  5337 consensus_queue.cc:237] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:54.228281  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.229008  5121 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.229228  5317 raft_consensus.cc:515] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.223078  5315 raft_consensus.cc:359] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.231163  5315 raft_consensus.cc:385] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.231442  5315 raft_consensus.cc:740] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.232161  5315 consensus_queue.cc:260] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.232854  5317 leader_election.cc:290] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.233457  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.234198  5315 ts_tablet_manager.cc:1434] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:54.234619  5269 raft_consensus.cc:3060] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.236055  5314 raft_consensus.cc:359] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
W20260709 13:13:54.236346  5163 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35527, user_credentials={real_user=slave}} blocked reactor thread for 43534us
I20260709 13:13:54.224850  5350 raft_consensus.cc:2804] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.237322  5350 raft_consensus.cc:697] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:54.238395  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.238224  5350 consensus_queue.cc:237] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.234167  5317 raft_consensus.cc:2804] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.239113  5121 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.241603  5237 leader_election.cc:304] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.242708  5313 raft_consensus.cc:2804] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.243098  5313 raft_consensus.cc:493] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.243312  5315 tablet_bootstrap.cc:492] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:54.243916  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.243449  5313 raft_consensus.cc:3060] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.246500  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.247104  5121 raft_consensus.cc:3060] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.248445  5269 raft_consensus.cc:2468] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:54.249183  5315 tablet_bootstrap.cc:654] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.249512  5314 raft_consensus.cc:385] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.251869  5314 raft_consensus.cc:740] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.252708  5314 consensus_queue.cc:260] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.253072  5160 leader_election.cc:304] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.254318  5337 raft_consensus.cc:2804] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.254789  5337 raft_consensus.cc:697] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:54.254992  5314 ts_tablet_manager.cc:1434] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.004s
I20260709 13:13:54.254979  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.255846  5197 raft_consensus.cc:2468] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.256322  5314 tablet_bootstrap.cc:492] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:54.257413  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.258178  5197 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.259840  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.260497  5197 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.260759  5313 raft_consensus.cc:515] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
W20260709 13:13:54.261979  5163 leader_election.cc:343] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:54.264181  5234 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.265439  5337 consensus_queue.cc:237] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.272368  5317 raft_consensus.cc:697] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:54.274649  5317 consensus_queue.cc:237] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.275606  5314 tablet_bootstrap.cc:654] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:54.277100  5355 raft_consensus.cc:2804] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.273288  5121 raft_consensus.cc:2468] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:54.280510  5019 catalog_manager.cc:5697] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.285329  5313 leader_election.cc:290] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.277624  5355 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.288966  5237 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.296262  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.296979  5197 raft_consensus.cc:2468] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 0.
I20260709 13:13:54.297079  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.297672  5121 raft_consensus.cc:3060] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.288546  5355 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.301087  5085 leader_election.cc:304] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.302502  5313 raft_consensus.cc:2804] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.303303  5313 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.303663  5313 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.312777  5121 raft_consensus.cc:2468] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.313539  5321 raft_consensus.cc:2764] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:13:54.310750  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.314713  5269 raft_consensus.cc:2393] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:13:54.314770  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.315670  5237 leader_election.cc:304] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.322199  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.322952  5195 raft_consensus.cc:3060] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.323153  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.323815  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.324396  5270 raft_consensus.cc:2393] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:13:54.316370  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.324927  5196 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 0.
I20260709 13:13:54.326413  5085 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.327368  5321 raft_consensus.cc:2804] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.327740  5321 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.328085  5321 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.330554  5195 raft_consensus.cc:2468] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.332563  5355 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.334280  5271 raft_consensus.cc:2393] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:13:54.323096  5313 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.337145  5355 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.337760  5355 raft_consensus.cc:2804] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.338235  5355 raft_consensus.cc:697] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.338721  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.339278  5085 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:13:54.339448  5195 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.341078  5313 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.339056  5355 consensus_queue.cc:237] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.342808  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.343454  5196 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.360842  5363 raft_consensus.cc:2749] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.362767  5195 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.364367  5234 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.365537  5361 raft_consensus.cc:2804] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.366164  5361 raft_consensus.cc:697] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.367447  5315 tablet_bootstrap.cc:492] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:54.367097  5361 consensus_queue.cc:237] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.368144  5315 ts_tablet_manager.cc:1403] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.002s
I20260709 13:13:54.374109  5314 tablet_bootstrap.cc:492] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:54.374626  5314 ts_tablet_manager.cc:1403] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.004s
I20260709 13:13:54.375008  5315 raft_consensus.cc:359] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.375576  5315 raft_consensus.cc:385] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.375777  5315 raft_consensus.cc:740] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
W20260709 13:13:54.360766  5237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.65:35527, user_credentials={real_user=slave}} blocked reactor thread for 45195.1us
I20260709 13:13:54.378189  5196 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.376693  5315 consensus_queue.cc:260] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.379949  5314 raft_consensus.cc:359] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.381336  5314 raft_consensus.cc:385] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:54.381538  5315 ts_tablet_manager.cc:1434] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:13:54.381582  5314 raft_consensus.cc:740] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:54.384325  5314 consensus_queue.cc:260] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.385846  5234 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.386569  5314 ts_tablet_manager.cc:1434] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:13:54.387027  5020 catalog_manager.cc:5697] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.389413  5361 raft_consensus.cc:2804] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.380712  5321 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.390767  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.391431  5119 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.391568  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.392102  5321 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.392429  5121 raft_consensus.cc:2393] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 1: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:13:54.393420  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.390231  5361 raft_consensus.cc:697] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.395787  5361 consensus_queue.cc:237] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.400801  5119 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.404771  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.405854  5196 raft_consensus.cc:2393] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:13:54.406451  5019 catalog_manager.cc:5697] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.408214  5085 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:13:54.409195  5321 raft_consensus.cc:2749] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.408571  5019 catalog_manager.cc:5697] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.410528  5019 catalog_manager.cc:5697] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.414728  5020 catalog_manager.cc:5697] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.416092  5020 catalog_manager.cc:5697] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.443583  5321 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.444141  5321 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.446031  5321 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.446797  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.447006  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:54.447746  5271 raft_consensus.cc:2393] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:13:54.448562  5085 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:13:54.449261  5321 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.454375  5321 raft_consensus.cc:2749] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:54.462744  5361 raft_consensus.cc:493] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.463300  5361 raft_consensus.cc:515] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.465003  5361 leader_election.cc:290] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.465884  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb0f61fc8542678397012b66fd6377" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.466075  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb0f61fc8542678397012b66fd6377" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.466560  5119 raft_consensus.cc:2468] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.466684  5196 raft_consensus.cc:2468] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.467535  5237 leader_election.cc:304] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.468250  5361 raft_consensus.cc:2804] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.468614  5361 raft_consensus.cc:493] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.468871  5361 raft_consensus.cc:3060] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.474233  5361 raft_consensus.cc:515] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.475989  5361 leader_election.cc:290] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.476966  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb0f61fc8542678397012b66fd6377" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.477001  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbfb0f61fc8542678397012b66fd6377" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.477579  5196 raft_consensus.cc:3060] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.477671  5119 raft_consensus.cc:3060] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.482723  5196 raft_consensus.cc:2468] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.482798  5119 raft_consensus.cc:2468] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.483894  5234 leader_election.cc:304] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.484637  5361 raft_consensus.cc:2804] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.485054  5361 raft_consensus.cc:697] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.485771  5361 consensus_queue.cc:237] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.493125  5020 catalog_manager.cc:5697] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.551407  5361 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:54.551964  5361 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.553761  5361 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.554682  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:54.554814  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:54.555639  5119 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.555671  5196 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:54.556881  5234 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.557585  5361 raft_consensus.cc:2804] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:54.557873  5361 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:54.558169  5361 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.563246  5361 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.564905  5361 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:54.565840  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.565898  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.566457  5119 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.566565  5196 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:54.571589  5196 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.571668  5119 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:54.572726  5234 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:54.573494  5361 raft_consensus.cc:2804] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:54.573957  5361 raft_consensus.cc:697] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.574615  5361 consensus_queue.cc:237] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.582067  5020 catalog_manager.cc:5697] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:54.641759  5337 consensus_queue.cc:1048] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.653266  5317 consensus_queue.cc:1048] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.662358  5317 consensus_queue.cc:1048] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.662448  5337 consensus_queue.cc:1048] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.677857  5337 consensus_queue.cc:1048] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.684598  5351 consensus_queue.cc:1048] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.745524  5351 consensus_queue.cc:1048] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.757865  5337 consensus_queue.cc:1048] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.759212  5196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:35522
I20260709 13:13:54.759976  5196 raft_consensus.cc:606] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:54.779201  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:13:54.779735  5271 raft_consensus.cc:606] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:54.785070  5196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:35522
I20260709 13:13:54.785701  5196 raft_consensus.cc:606] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:54.791054  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be940b4505394de29c92782330c934b1"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:13:54.791572  5271 raft_consensus.cc:606] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:54.796573  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:13:54.797097  5271 raft_consensus.cc:606] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS 5b7a9ad7678346938272011c63630e31
I20260709 13:13:54.808081  5271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "805755305c3341db9b9faf4823bb827e"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:13:54.808595  5271 raft_consensus.cc:606] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS 5b7a9ad7678346938272011c63630e31
I20260709 13:13:54.831580  5361 consensus_queue.cc:1048] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.838261  5355 raft_consensus.cc:993] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:54.838737  5313 raft_consensus.cc:1081] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:54.841042  5121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be940b4505394de29c92782330c934b1"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 13:13:54.841710  5121 raft_consensus.cc:493] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.842162  5121 raft_consensus.cc:3060] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.846684  5361 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.848404  5313 consensus_queue.cc:1048] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.850348  5121 raft_consensus.cc:515] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.853276  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.853840  5361 consensus_queue.cc:1048] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.856070  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.856745  5271 raft_consensus.cc:3055] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:54.857049  5271 raft_consensus.cc:740] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.857934  5271 consensus_queue.cc:260] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.858951  5271 raft_consensus.cc:3060] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.866345  5121 leader_election.cc:290] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.867532  5271 raft_consensus.cc:2468] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:13:54.868800  5085 leader_election.cc:304] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:13:54.869653  5321 raft_consensus.cc:2804] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:54.870157  5321 raft_consensus.cc:697] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:13:54.870986  5321 consensus_queue.cc:237] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.875381  5355 raft_consensus.cc:993] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:54.875833  5355 raft_consensus.cc:1081] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:54.882213  5119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 13:13:54.882817  5119 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.883193  5119 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.884074  5355 raft_consensus.cc:993] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e: : Instructing follower 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:13:54.882954  5313 consensus_queue.cc:1048] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:13:54.884598  5355 raft_consensus.cc:1081] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:13:54.888115  5196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:35508
I20260709 13:13:54.888741  5196 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.889119  5196 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.890312  5313 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.891165  5119 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.893329  5119 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.895612  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.896206  5271 raft_consensus.cc:3055] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:54.896529  5271 raft_consensus.cc:740] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.897378  5271 consensus_queue.cc:260] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.897655  5196 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.898623  5271 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.897379  5019 catalog_manager.cc:5697] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.900710  5196 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:54.902011  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:54.902680  5270 raft_consensus.cc:3055] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:54.903048  5270 raft_consensus.cc:740] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:54.903908  5270 consensus_queue.cc:260] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.904902  5270 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.902277  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.907450  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:54.908125  5194 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.909947  5195 raft_consensus.cc:1240] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Rejecting Update request from peer 0d88c0686b8f405780417f916e2f273e for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:54.920853  5270 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:13:54.921980  5271 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:13:54.921453  5194 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:13:54.923872  5160 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:54.923871  5085 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:54.925129  5337 raft_consensus.cc:2804] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:54.925390  5321 raft_consensus.cc:2804] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:54.925810  5337 raft_consensus.cc:697] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:54.926189  5321 raft_consensus.cc:697] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:13:54.926997  5337 consensus_queue.cc:237] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.927058  5321 consensus_queue.cc:237] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.935393  5019 catalog_manager.cc:5697] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.943002  5020 catalog_manager.cc:5697] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:54.969905  5361 consensus_queue.cc:1048] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.977051  5313 raft_consensus.cc:993] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e: : Instructing follower 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:13:54.977558  5355 raft_consensus.cc:1081] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:13:54.980000  5195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "805755305c3341db9b9faf4823bb827e"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:35508
I20260709 13:13:54.981207  5195 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:54.981658  5195 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:54.982651  5355 consensus_queue.cc:1048] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.989085  5313 consensus_queue.cc:1048] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:54.990973  5195 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:54.994158  5313 consensus_queue.cc:1048] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:54.994236  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:54.997795  5121 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.000006  5195 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:55.000859  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:55.001520  5271 raft_consensus.cc:3055] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.001850  5271 raft_consensus.cc:740] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:55.002782  5271 consensus_queue.cc:260] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:55.003938  5271 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.013748  5121 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:13:55.015236  5163 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:55.016216  5337 raft_consensus.cc:2804] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.016722  5337 raft_consensus.cc:697] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:55.017572  5337 consensus_queue.cc:237] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:55.019495  5271 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:13:55.028179  5019 catalog_manager.cc:5697] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.160691  5337 raft_consensus.cc:993] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:55.161183  5350 raft_consensus.cc:1081] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:55.162864  5121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32866
I20260709 13:13:55.163432  5121 raft_consensus.cc:493] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.163776  5121 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.169513  5121 raft_consensus.cc:515] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:55.171419  5121 leader_election.cc:290] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:55.172441  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:55.172609  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:55.173241  5195 raft_consensus.cc:3055] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.173275  5271 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.173738  5195 raft_consensus.cc:740] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:55.174633  5195 consensus_queue.cc:260] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:55.175920  5195 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.181160  5271 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:13:55.182603  5085 leader_election.cc:304] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:55.183223  5195 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:13:55.183506  5321 raft_consensus.cc:2804] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.184056  5321 raft_consensus.cc:697] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:13:55.184798  5321 consensus_queue.cc:237] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:55.191005  5017 catalog_manager.cc:5697] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 5b7a9ad7678346938272011c63630e31 (127.27.229.66) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:55.294912  5337 raft_consensus.cc:993] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:55.295354  5350 raft_consensus.cc:1081] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:13:55.296936  5121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32866
I20260709 13:13:55.297449  5121 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:55.297753  5121 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.303608  5121 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:55.304201  5270 raft_consensus.cc:1275] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.305591  5121 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:55.305757  5321 consensus_queue.cc:1048] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.306701  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:55.307390  5195 raft_consensus.cc:3055] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:55.307735  5195 raft_consensus.cc:740] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:55.307818  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:55.308415  5270 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.308580  5195 consensus_queue.cc:260] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:55.309983  5195 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.316929  5270 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:13:55.319360  5194 raft_consensus.cc:3060] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.318979  5085 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:55.320333  5321 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:55.320787  5321 raft_consensus.cc:697] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:13:55.321580  5321 consensus_queue.cc:237] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:55.317626  5195 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:13:55.330183  5019 catalog_manager.cc:5697] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 5b7a9ad7678346938272011c63630e31 (127.27.229.66) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:55.331808  5194 raft_consensus.cc:1275] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.333310  5321 consensus_queue.cc:1048] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.371445  5121 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:55.377010  5121 raft_consensus.cc:1275] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.378371  5350 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.386896  5270 raft_consensus.cc:1275] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.389494  5194 raft_consensus.cc:1275] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.389744  5350 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:55.391757  5321 consensus_queue.cc:1048] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.404398  5270 raft_consensus.cc:1275] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.406422  5363 consensus_queue.cc:1048] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.427991  5270 raft_consensus.cc:1275] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.429188  5350 consensus_queue.cc:1048] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.437302  5121 raft_consensus.cc:1275] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.439306  5397 consensus_queue.cc:1048] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.653676  5270 raft_consensus.cc:1275] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.655061  5363 consensus_queue.cc:1048] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.663847  5194 raft_consensus.cc:1275] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.665504  5396 consensus_queue.cc:1048] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.909644  5270 raft_consensus.cc:1275] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.911167  5395 consensus_queue.cc:1048] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:55.912698  5194 raft_consensus.cc:1275] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:55.914290  5395 consensus_queue.cc:1048] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:57.842131  5020 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56718:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:57.844285  5020 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:57.892377  5106 tablet_service.cc:1511] Processing CreateTablet for tablet d436ea16af034c70bb2b2ca8eff7abcb (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:57.893684  5106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d436ea16af034c70bb2b2ca8eff7abcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.895778  5105 tablet_service.cc:1511] Processing CreateTablet for tablet 1003f2d372b44f0aa07221068f4fdbd3 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:57.896461  5261 tablet_service.cc:1511] Processing CreateTablet for tablet d436ea16af034c70bb2b2ca8eff7abcb (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:57.893352  5181 tablet_service.cc:1511] Processing CreateTablet for tablet d436ea16af034c70bb2b2ca8eff7abcb (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:57.897116  5105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1003f2d372b44f0aa07221068f4fdbd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.897081  5185 tablet_service.cc:1511] Processing CreateTablet for tablet 1003f2d372b44f0aa07221068f4fdbd3 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:57.897677  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d436ea16af034c70bb2b2ca8eff7abcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.898554  5185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1003f2d372b44f0aa07221068f4fdbd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.899667  5181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d436ea16af034c70bb2b2ca8eff7abcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.903126  5256 tablet_service.cc:1511] Processing CreateTablet for tablet 1003f2d372b44f0aa07221068f4fdbd3 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:57.904560  5111 tablet_service.cc:1511] Processing CreateTablet for tablet f331ba3a1df54c029047713c03b71def (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:57.905864  5111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331ba3a1df54c029047713c03b71def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.904522  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1003f2d372b44f0aa07221068f4fdbd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.908219  5109 tablet_service.cc:1511] Processing CreateTablet for tablet 139ea201bd904f1b9a8f69dcab29c2dd (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:57.910924  5109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 139ea201bd904f1b9a8f69dcab29c2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.913333  5108 tablet_service.cc:1511] Processing CreateTablet for tablet bd1707f4d4084cb08ccfad64c28362c5 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:57.916421  5107 tablet_service.cc:1511] Processing CreateTablet for tablet d2079268427b43698086a3f3241df795 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:57.917559  5260 tablet_service.cc:1511] Processing CreateTablet for tablet f331ba3a1df54c029047713c03b71def (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:57.918876  5260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331ba3a1df54c029047713c03b71def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.921072  5182 tablet_service.cc:1511] Processing CreateTablet for tablet 139ea201bd904f1b9a8f69dcab29c2dd (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:57.921759  5259 tablet_service.cc:1511] Processing CreateTablet for tablet 139ea201bd904f1b9a8f69dcab29c2dd (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:57.922550  5184 tablet_service.cc:1511] Processing CreateTablet for tablet bd1707f4d4084cb08ccfad64c28362c5 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:57.923604  5414 tablet_bootstrap.cc:492] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:57.923996  5110 tablet_service.cc:1511] Processing CreateTablet for tablet 7e301e6d29fd4569bc78544c0685685c (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:57.924531  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 139ea201bd904f1b9a8f69dcab29c2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.922592  5182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 139ea201bd904f1b9a8f69dcab29c2dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.918758  5186 tablet_service.cc:1511] Processing CreateTablet for tablet f331ba3a1df54c029047713c03b71def (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:57.926290  5184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1707f4d4084cb08ccfad64c28362c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.930755  5186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331ba3a1df54c029047713c03b71def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.941790  5261 tablet_service.cc:1511] Processing CreateTablet for tablet bd1707f4d4084cb08ccfad64c28362c5 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:57.942308  5108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1707f4d4084cb08ccfad64c28362c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.943291  5261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd1707f4d4084cb08ccfad64c28362c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.945789  5187 tablet_service.cc:1511] Processing CreateTablet for tablet d2079268427b43698086a3f3241df795 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:57.947192  5187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2079268427b43698086a3f3241df795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.948370  5183 tablet_service.cc:1511] Processing CreateTablet for tablet 7e301e6d29fd4569bc78544c0685685c (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:57.949779  5183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e301e6d29fd4569bc78544c0685685c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.950277  5110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e301e6d29fd4569bc78544c0685685c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.950989  5257 tablet_service.cc:1511] Processing CreateTablet for tablet 7e301e6d29fd4569bc78544c0685685c (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:57.952142  5107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2079268427b43698086a3f3241df795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.952351  5257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e301e6d29fd4569bc78544c0685685c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.959403  5112 tablet_service.cc:1511] Processing CreateTablet for tablet 1aff5ee6b87f42a8ab1c3d7f506561a2 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:57.960882  5112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aff5ee6b87f42a8ab1c3d7f506561a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.961584  5180 tablet_service.cc:1511] Processing CreateTablet for tablet 1aff5ee6b87f42a8ab1c3d7f506561a2 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:57.963073  5180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aff5ee6b87f42a8ab1c3d7f506561a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.967653  5104 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc6d242ddb3480aa056198e7b942d07 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:57.969144  5104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc6d242ddb3480aa056198e7b942d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.948370  5259 tablet_service.cc:1511] Processing CreateTablet for tablet d2079268427b43698086a3f3241df795 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:57.971356  5259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2079268427b43698086a3f3241df795. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.979058  5258 tablet_service.cc:1511] Processing CreateTablet for tablet 1aff5ee6b87f42a8ab1c3d7f506561a2 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:57.980547  5258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aff5ee6b87f42a8ab1c3d7f506561a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:57.983556  5179 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc6d242ddb3480aa056198e7b942d07 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:57.985041  5179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc6d242ddb3480aa056198e7b942d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:58.017629  5256 tablet_service.cc:1511] Processing CreateTablet for tablet 4dc6d242ddb3480aa056198e7b942d07 (DEFAULT_TABLE table=soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:58.019155  5256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dc6d242ddb3480aa056198e7b942d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:58.019371  5414 tablet_bootstrap.cc:654] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:58.069427  5068 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:58.070626  5415 tablet_bootstrap.cc:492] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.076864  5415 tablet_bootstrap.cc:654] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.080325  5416 tablet_bootstrap.cc:492] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.090489  5416 tablet_bootstrap.cc:654] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.094696  5415 tablet_bootstrap.cc:492] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.095204  5415 ts_tablet_manager.cc:1403] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.013s
I20260709 13:13:58.095537  5414 tablet_bootstrap.cc:492] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.098440  5414 ts_tablet_manager.cc:1403] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.175s	user 0.006s	sys 0.008s
I20260709 13:13:58.098196  5415 raft_consensus.cc:359] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.098924  5415 raft_consensus.cc:385] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.098968  5416 tablet_bootstrap.cc:492] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.099162  5415 raft_consensus.cc:740] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.099644  5416 ts_tablet_manager.cc:1403] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 13:13:58.099869  5415 consensus_queue.cc:260] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.101646  5415 ts_tablet_manager.cc:1434] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:58.102735  5415 tablet_bootstrap.cc:492] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.103111  5416 raft_consensus.cc:359] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.103937  5416 raft_consensus.cc:385] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.104269  5416 raft_consensus.cc:740] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.105000  5416 consensus_queue.cc:260] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.107481  5416 ts_tablet_manager.cc:1434] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:58.108603  5416 tablet_bootstrap.cc:492] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.109941  5415 tablet_bootstrap.cc:654] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.115315  5416 tablet_bootstrap.cc:654] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.102839  5414 raft_consensus.cc:359] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.116041  5414 raft_consensus.cc:385] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.116433  5414 raft_consensus.cc:740] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.117252  5414 consensus_queue.cc:260] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.124006  5414 ts_tablet_manager.cc:1434] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.005s
I20260709 13:13:58.124990  5414 tablet_bootstrap.cc:492] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.129220  5415 tablet_bootstrap.cc:492] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.129952  5415 ts_tablet_manager.cc:1403] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.015s
I20260709 13:13:58.131131  5416 tablet_bootstrap.cc:492] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.131963  5416 ts_tablet_manager.cc:1403] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260709 13:13:58.133224  5415 raft_consensus.cc:359] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.134064  5415 raft_consensus.cc:385] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.134317  5415 raft_consensus.cc:740] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.134995  5415 consensus_queue.cc:260] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.135115  5416 raft_consensus.cc:359] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.135977  5416 raft_consensus.cc:385] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.136307  5416 raft_consensus.cc:740] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.137152  5416 consensus_queue.cc:260] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.137650  5415 ts_tablet_manager.cc:1434] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:13:58.138813  5415 tablet_bootstrap.cc:492] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.139655  5416 ts_tablet_manager.cc:1434] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:58.140715  5416 tablet_bootstrap.cc:492] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.146962  5415 tablet_bootstrap.cc:654] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.147006  5416 tablet_bootstrap.cc:654] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.153579  5414 tablet_bootstrap.cc:654] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.167568  5415 tablet_bootstrap.cc:492] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.167668  5414 tablet_bootstrap.cc:492] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.168038  5415 ts_tablet_manager.cc:1403] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.004s
I20260709 13:13:58.168184  5414 ts_tablet_manager.cc:1403] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.043s	user 0.003s	sys 0.015s
I20260709 13:13:58.170595  5416 tablet_bootstrap.cc:492] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.170533  5415 raft_consensus.cc:359] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.171221  5416 ts_tablet_manager.cc:1403] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260709 13:13:58.171238  5415 raft_consensus.cc:385] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.171749  5415 raft_consensus.cc:740] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.171949  5414 raft_consensus.cc:359] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.172394  5415 consensus_queue.cc:260] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.172714  5414 raft_consensus.cc:385] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.173170  5414 raft_consensus.cc:740] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.174029  5414 consensus_queue.cc:260] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.174655  5415 ts_tablet_manager.cc:1434] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:13:58.174471  5416 raft_consensus.cc:359] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.175587  5416 raft_consensus.cc:385] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.175747  5415 tablet_bootstrap.cc:492] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.175956  5416 raft_consensus.cc:740] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.176397  5414 ts_tablet_manager.cc:1434] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:13:58.177749  5414 tablet_bootstrap.cc:492] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.176990  5416 consensus_queue.cc:260] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.182893  5415 tablet_bootstrap.cc:654] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.184535  5416 ts_tablet_manager.cc:1434] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:13:58.185786  5416 tablet_bootstrap.cc:492] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.187193  5414 tablet_bootstrap.cc:654] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.192346  5321 raft_consensus.cc:493] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.193010  5321 raft_consensus.cc:515] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.195492  5321 leader_election.cc:290] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.199489  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:58.200353  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
W20260709 13:13:58.201330  5085 leader_election.cc:343] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.202419  5416 tablet_bootstrap.cc:654] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:58.205220  5085 leader_election.cc:343] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.205770  5085 leader_election.cc:304] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:13:58.206398  5402 raft_consensus.cc:493] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.206977  5321 raft_consensus.cc:2749] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.206892  5402 raft_consensus.cc:515] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.210441  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.211208  5121 raft_consensus.cc:2468] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:58.212911  5163 leader_election.cc:304] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:58.216197  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
W20260709 13:13:58.218122  5160 leader_election.cc:343] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.218906  5402 leader_election.cc:290] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.219588  5402 raft_consensus.cc:2804] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.220088  5402 raft_consensus.cc:493] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.221207  5402 raft_consensus.cc:3060] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.225772  5415 tablet_bootstrap.cc:492] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.226342  5415 ts_tablet_manager.cc:1403] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.051s	user 0.026s	sys 0.019s
I20260709 13:13:58.228641  5415 raft_consensus.cc:359] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.229180  5415 raft_consensus.cc:385] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.229552  5415 raft_consensus.cc:740] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.230482  5415 consensus_queue.cc:260] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.232963  5415 ts_tablet_manager.cc:1434] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:13:58.233430  5402 raft_consensus.cc:515] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.234129  5415 tablet_bootstrap.cc:492] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.237407  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
W20260709 13:13:58.239249  5160 leader_election.cc:343] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.240016  5402 leader_election.cc:290] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.240662  5415 tablet_bootstrap.cc:654] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.252823  5415 tablet_bootstrap.cc:492] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.253394  5415 ts_tablet_manager.cc:1403] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.011s
I20260709 13:13:58.255971  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:58.256489  5414 tablet_bootstrap.cc:492] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.256706  5121 raft_consensus.cc:3060] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.256459  5415 raft_consensus.cc:359] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.257216  5414 ts_tablet_manager.cc:1403] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.040s
I20260709 13:13:58.257303  5415 raft_consensus.cc:385] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.257721  5415 raft_consensus.cc:740] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.258476  5415 consensus_queue.cc:260] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.260826  5415 ts_tablet_manager.cc:1434] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:58.259824  5414 raft_consensus.cc:359] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.261791  5414 raft_consensus.cc:385] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.262120  5415 tablet_bootstrap.cc:492] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.262215  5414 raft_consensus.cc:740] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.263221  5414 consensus_queue.cc:260] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.265242  5414 ts_tablet_manager.cc:1434] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 13:13:58.266345  5414 tablet_bootstrap.cc:492] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.269287  5415 tablet_bootstrap.cc:654] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.272574  5414 tablet_bootstrap.cc:654] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.279438  5121 raft_consensus.cc:2468] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:58.280874  5415 tablet_bootstrap.cc:492] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.281544  5415 ts_tablet_manager.cc:1403] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:13:58.281482  5163 leader_election.cc:304] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:13:58.282985  5428 raft_consensus.cc:2804] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.284662  5414 tablet_bootstrap.cc:492] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.285254  5414 ts_tablet_manager.cc:1403] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.010s
I20260709 13:13:58.285341  5415 raft_consensus.cc:359] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.286404  5415 raft_consensus.cc:385] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.286801  5415 raft_consensus.cc:740] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.287701  5415 consensus_queue.cc:260] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.288460  5414 raft_consensus.cc:359] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.289386  5414 raft_consensus.cc:385] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.289696  5414 raft_consensus.cc:740] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.290756  5414 consensus_queue.cc:260] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.293252  5414 ts_tablet_manager.cc:1434] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:13:58.294353  5414 tablet_bootstrap.cc:492] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.298988  5415 ts_tablet_manager.cc:1434] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.012s
I20260709 13:13:58.300272  5415 tablet_bootstrap.cc:492] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.300774  5414 tablet_bootstrap.cc:654] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.307243  5415 tablet_bootstrap.cc:654] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.312071  5402 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.312644  5414 tablet_bootstrap.cc:492] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.313262  5414 ts_tablet_manager.cc:1403] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 13:13:58.316529  5414 raft_consensus.cc:359] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.317322  5414 raft_consensus.cc:385] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.317616  5414 raft_consensus.cc:740] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.312649  5402 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.320329  5402 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.321142  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.321152  5415 tablet_bootstrap.cc:492] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.321748  5414 consensus_queue.cc:260] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
W20260709 13:13:58.322798  5163 leader_election.cc:343] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.322943  5415 ts_tablet_manager.cc:1403] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 13:13:58.324322  5414 ts_tablet_manager.cc:1434] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:13:58.325534  5414 tablet_bootstrap.cc:492] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.327108  5415 raft_consensus.cc:359] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.332108  5415 raft_consensus.cc:385] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.332755  5414 tablet_bootstrap.cc:654] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.332880  5416 tablet_bootstrap.cc:492] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.335072  5313 raft_consensus.cc:493] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.341614  5415 raft_consensus.cc:740] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.342135  5416 ts_tablet_manager.cc:1403] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.157s	user 0.012s	sys 0.003s
I20260709 13:13:58.342068  5313 raft_consensus.cc:515] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.342584  5415 consensus_queue.cc:260] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.344729  5313 leader_election.cc:290] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:58.345402  5416 raft_consensus.cc:359] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.346354  5416 raft_consensus.cc:385] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:58.346621  5160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:40915, user_credentials={real_user=slave}} blocked reactor thread for 61505us
I20260709 13:13:58.346649  5416 raft_consensus.cc:740] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.348039  5416 consensus_queue.cc:260] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.348892  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:58.349440  5432 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.346959  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:58.350067  5432 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
W20260709 13:13:58.352242  5234 leader_election.cc:343] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.350592  5435 raft_consensus.cc:493] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.353228  5435 raft_consensus.cc:515] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.355356  5435 leader_election.cc:290] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.356695  5432 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.350484  5415 ts_tablet_manager.cc:1434] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:13:58.357955  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.358660  5415 tablet_bootstrap.cc:492] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
W20260709 13:13:58.359611  5163 leader_election.cc:343] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.360913  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.361415  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:58.361629  5120 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:58.363389  5163 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:58.365375  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:58.365794  5416 ts_tablet_manager.cc:1434] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:13:58.366518  5415 tablet_bootstrap.cc:654] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:58.366417  5160 leader_election.cc:343] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.367528  5160 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:58.366912  5271 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:58.374694  5435 raft_consensus.cc:2804] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.375201  5435 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.375602  5435 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.379127  5428 raft_consensus.cc:697] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:58.380119  5428 consensus_queue.cc:237] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
W20260709 13:13:58.381531  5160 leader_election.cc:343] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.366973  5416 tablet_bootstrap.cc:492] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.380517  5432 raft_consensus.cc:2749] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.384608  5160 leader_election.cc:304] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:58.392234  5416 tablet_bootstrap.cc:654] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.393177  5432 raft_consensus.cc:2749] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.395841  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
W20260709 13:13:58.397591  5237 leader_election.cc:343] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.398128  5237 leader_election.cc:304] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:58.399427  5313 raft_consensus.cc:2749] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.400480  5321 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.401018  5321 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.402619  5313 raft_consensus.cc:493] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.403386  5321 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.403143  5313 raft_consensus.cc:515] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.406721  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:58.407919  5313 leader_election.cc:290] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:58.421161  5435 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.429750  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
W20260709 13:13:58.434438  5085 leader_election.cc:343] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.431159  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.432400  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:58.435482  5194 raft_consensus.cc:2468] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 0.
I20260709 13:13:58.436940  5085 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:13:58.437857  5321 raft_consensus.cc:2804] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.438246  5321 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.438561  5321 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.446715  5321 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.448964  5321 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.449782  5121 raft_consensus.cc:2393] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 1: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:13:58.452571  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:58.454608  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:58.455205  5194 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.463353  5194 raft_consensus.cc:2468] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 1.
I20260709 13:13:58.467224  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:58.468021  5121 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.478608  5237 leader_election.cc:304] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:58.480233  5313 raft_consensus.cc:3060] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.489075  5432 raft_consensus.cc:493] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.489842  5432 raft_consensus.cc:515] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.493046  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
W20260709 13:13:58.494850  5163 leader_election.cc:343] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.496049  5432 leader_election.cc:290] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.497783  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
W20260709 13:13:58.499708  5160 leader_election.cc:343] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.500260  5160 leader_election.cc:304] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:58.501557  5432 raft_consensus.cc:2749] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.488658  5313 raft_consensus.cc:2749] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:58.503583  5085 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
W20260709 13:13:58.504770  5085 leader_election.cc:343] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.506287  5435 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.508280  5321 raft_consensus.cc:2804] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.511042  5321 raft_consensus.cc:697] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 1 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:13:58.509836  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:58.515851  5271 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.520143  5414 tablet_bootstrap.cc:492] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.520745  5414 ts_tablet_manager.cc:1403] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.195s	user 0.084s	sys 0.096s
I20260709 13:13:58.520596  5321 consensus_queue.cc:237] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.509706  5416 tablet_bootstrap.cc:492] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.519927  5019 catalog_manager.cc:5697] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.523432  5271 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:58.524048  5414 raft_consensus.cc:359] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.526062  5414 raft_consensus.cc:385] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.526042  5160 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:58.514484  5415 tablet_bootstrap.cc:492] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.526597  5414 raft_consensus.cc:740] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.527087  5428 raft_consensus.cc:2804] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.527266  5415 ts_tablet_manager.cc:1403] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.169s	user 0.060s	sys 0.091s
I20260709 13:13:58.527606  5428 raft_consensus.cc:697] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:58.527395  5414 consensus_queue.cc:260] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.528514  5428 consensus_queue.cc:237] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.530107  5415 raft_consensus.cc:359] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.530825  5415 raft_consensus.cc:385] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.531090  5415 raft_consensus.cc:740] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.531548  5416 ts_tablet_manager.cc:1403] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.165s	user 0.037s	sys 0.026s
I20260709 13:13:58.531811  5415 consensus_queue.cc:260] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.534118  5415 ts_tablet_manager.cc:1434] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:58.535002  5415 tablet_bootstrap.cc:492] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31: Bootstrap starting.
I20260709 13:13:58.536229  5432 raft_consensus.cc:493] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.536834  5432 raft_consensus.cc:515] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.538043  5017 catalog_manager.cc:5697] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 0 to 1, leader changed from <none> to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 1 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:58.540030  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aff5ee6b87f42a8ab1c3d7f506561a2" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.541236  5415 tablet_bootstrap.cc:654] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:58.541620  5163 leader_election.cc:343] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:58.545948  5416 raft_consensus.cc:359] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.546793  5416 raft_consensus.cc:385] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.547114  5416 raft_consensus.cc:740] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.548152  5414 ts_tablet_manager.cc:1434] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:13:58.547902  5416 consensus_queue.cc:260] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.549377  5432 leader_election.cc:290] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.550542  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aff5ee6b87f42a8ab1c3d7f506561a2" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:13:58.551266  5271 raft_consensus.cc:2468] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:13:58.543215  5121 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:58.552950  5160 leader_election.cc:304] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:13:58.554466  5428 raft_consensus.cc:2804] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.554853  5428 raft_consensus.cc:493] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.555250  5428 raft_consensus.cc:3060] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.556754  5414 tablet_bootstrap.cc:492] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.559439  5415 tablet_bootstrap.cc:492] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31: No bootstrap required, opened a new log
I20260709 13:13:58.560423  5415 ts_tablet_manager.cc:1403] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.001s
I20260709 13:13:58.563248  5415 raft_consensus.cc:359] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.563779  5414 tablet_bootstrap.cc:654] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.563452  5428 raft_consensus.cc:515] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.564085  5415 raft_consensus.cc:385] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.564574  5415 raft_consensus.cc:740] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.565279  5415 consensus_queue.cc:260] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.566892  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aff5ee6b87f42a8ab1c3d7f506561a2" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:58.567652  5121 raft_consensus.cc:3060] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.567658  5415 ts_tablet_manager.cc:1434] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:58.569844  5416 ts_tablet_manager.cc:1434] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:13:58.571033  5416 tablet_bootstrap.cc:492] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.575740  5414 tablet_bootstrap.cc:492] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.576344  5414 ts_tablet_manager.cc:1403] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:13:58.577755  5416 tablet_bootstrap.cc:654] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.579126  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aff5ee6b87f42a8ab1c3d7f506561a2" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:13:58.579756  5414 raft_consensus.cc:359] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.580554  5414 raft_consensus.cc:385] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.580569  5313 raft_consensus.cc:493] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.580976  5414 raft_consensus.cc:740] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.581246  5313 raft_consensus.cc:515] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.579833  5271 raft_consensus.cc:3060] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.581853  5414 consensus_queue.cc:260] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.583523  5313 leader_election.cc:290] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:58.585433  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:58.586934  5194 raft_consensus.cc:2468] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:58.588279  5234 leader_election.cc:304] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:58.585968  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.588533  5414 ts_tablet_manager.cc:1434] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.008s
I20260709 13:13:58.589061  5120 raft_consensus.cc:2468] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:58.591291  5313 raft_consensus.cc:2804] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.591734  5313 raft_consensus.cc:493] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.589643  5414 tablet_bootstrap.cc:492] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.592185  5313 raft_consensus.cc:3060] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.595569  5271 raft_consensus.cc:2468] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:58.597021  5160 leader_election.cc:304] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:13:58.598043  5432 raft_consensus.cc:2804] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.598549  5432 raft_consensus.cc:697] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:13:58.599372  5432 consensus_queue.cc:237] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.599821  5414 tablet_bootstrap.cc:654] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.602083  5121 raft_consensus.cc:2468] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:13:58.603037  5428 leader_election.cc:290] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:58.601361  5313 raft_consensus.cc:515] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.607455  5313 leader_election.cc:290] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:58.609407  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:13:58.610140  5120 raft_consensus.cc:3060] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.611254  5414 tablet_bootstrap.cc:492] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.611793  5414 ts_tablet_manager.cc:1403] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 13:13:58.614537  5414 raft_consensus.cc:359] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.615216  5414 raft_consensus.cc:385] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.615480  5414 raft_consensus.cc:740] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.615885  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:58.616566  5194 raft_consensus.cc:3060] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.616176  5414 consensus_queue.cc:260] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.618651  5414 ts_tablet_manager.cc:1434] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:58.619652  5414 tablet_bootstrap.cc:492] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e: Bootstrap starting.
I20260709 13:13:58.625511  5414 tablet_bootstrap.cc:654] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.628295  5120 raft_consensus.cc:2468] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:58.630014  5237 leader_election.cc:304] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:58.632853  5313 raft_consensus.cc:2804] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:58.633458  5313 raft_consensus.cc:697] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:13:58.634483  5313 consensus_queue.cc:237] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.639079  5416 tablet_bootstrap.cc:492] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.639815  5416 ts_tablet_manager.cc:1403] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.046s
I20260709 13:13:58.644701  5194 raft_consensus.cc:2468] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:58.653684  5416 raft_consensus.cc:359] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.654729  5416 raft_consensus.cc:385] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.655063  5416 raft_consensus.cc:740] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.655933  5416 consensus_queue.cc:260] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.658766  5416 ts_tablet_manager.cc:1434] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:13:58.659869  5416 tablet_bootstrap.cc:492] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.660188  5414 tablet_bootstrap.cc:492] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e: No bootstrap required, opened a new log
I20260709 13:13:58.660727  5414 ts_tablet_manager.cc:1403] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e: Time spent bootstrapping tablet: real 0.041s	user 0.036s	sys 0.003s
I20260709 13:13:58.664016  5414 raft_consensus.cc:359] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.664815  5414 raft_consensus.cc:385] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.665110  5414 raft_consensus.cc:740] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.665973  5414 consensus_queue.cc:260] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.666366  5416 tablet_bootstrap.cc:654] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.668850  5414 ts_tablet_manager.cc:1434] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:58.681591  5416 tablet_bootstrap.cc:492] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.682260  5416 ts_tablet_manager.cc:1403] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.003s
I20260709 13:13:58.685384  5416 raft_consensus.cc:359] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.686108  5019 catalog_manager.cc:5697] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:58.686177  5416 raft_consensus.cc:385] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.687290  5416 raft_consensus.cc:740] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.688079  5416 consensus_queue.cc:260] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.692903  5416 ts_tablet_manager.cc:1434] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:13:58.696277  5416 tablet_bootstrap.cc:492] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.702173  5416 tablet_bootstrap.cc:654] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:58.702945  5451 raft_consensus.cc:493] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:58.703557  5451 raft_consensus.cc:515] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.706163  5451 leader_election.cc:290] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:13:58.707051  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:13:58.707373  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:13:58.707818  5120 raft_consensus.cc:2468] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:58.708086  5194 raft_consensus.cc:2468] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:13:58.708531  5416 tablet_bootstrap.cc:492] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:13:58.709112  5416 ts_tablet_manager.cc:1403] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 13:13:58.709277  5237 leader_election.cc:304] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:13:58.710268  5451 raft_consensus.cc:2804] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:58.711134  5451 raft_consensus.cc:493] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:58.711570  5451 raft_consensus.cc:3060] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.711994  5416 raft_consensus.cc:359] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.712759  5416 raft_consensus.cc:385] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:58.713028  5416 raft_consensus.cc:740] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:13:58.713724  5416 consensus_queue.cc:260] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.716060  5416 ts_tablet_manager.cc:1434] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:58.717036  5416 tablet_bootstrap.cc:492] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e: Bootstrap starting.
I20260709 13:13:58.720369  5451 raft_consensus.cc:515] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:58.724625  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:13:58.725343  5194 raft_consensus.cc:3060] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:58.735930  5194 raft_consensus.cc:2468] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:13:58.736505  5451 leader_election.cc:290] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
W20260709 13:13:59.071623  5068 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:59.753065  5460 raft_consensus.cc:493] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.753851  5460 raft_consensus.cc:515] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:59.756073  5460 leader_election.cc:290] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:59.849968  5463 raft_consensus.cc:493] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.851809  5463 raft_consensus.cc:515] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:59.891144  5462 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:13:59.891912  5462 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:13:59.896432  5461 raft_consensus.cc:493] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:59.897125  5461 raft_consensus.cc:515] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:13:59.899400  5461 leader_election.cc:290] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:13:59.915570  5462 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:14:00.067746  5463 leader_election.cc:290] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.068557  5463 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.069052  5463 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
W20260709 13:14:00.073740  5068 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:00.095713  5321 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.096629  5321 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.099120  5321 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.142264  5463 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.154927  5462 raft_consensus.cc:493] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.210762  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.210640  5462 raft_consensus.cc:515] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.211498  5194 raft_consensus.cc:2468] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:14:00.158950  5234 leader_election.cc:304] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
W20260709 13:14:00.212616  5234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:44483, user_credentials={real_user=slave}} blocked reactor thread for 53798.6us
I20260709 13:14:00.157859  5461 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.213361  5461 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.213897  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.215492  5461 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.212697  5462 leader_election.cc:290] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.216979  5463 raft_consensus.cc:2804] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.217537  5463 raft_consensus.cc:697] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:00.218513  5463 consensus_queue.cc:237] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.224822  5416 tablet_bootstrap.cc:654] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:00.225025  5463 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.225845  5463 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.227986  5321 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.228803  5321 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.231300  5321 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.231698  5234 leader_election.cc:304] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:00.233558  5463 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.234447  5463 raft_consensus.cc:2804] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.234937  5463 raft_consensus.cc:493] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.235357  5463 raft_consensus.cc:3060] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.236492  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.237998  5321 raft_consensus.cc:493] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.238688  5321 raft_consensus.cc:515] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.241065  5321 leader_election.cc:290] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.239212  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.243723  5120 raft_consensus.cc:3060] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.250159  5270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.251209  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.251889  5313 raft_consensus.cc:493] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.252955  5267 raft_consensus.cc:2468] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 1.
I20260709 13:14:00.252642  5313 raft_consensus.cc:515] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.263336  5464 raft_consensus.cc:493] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.264120  5313 leader_election.cc:290] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.264914  5313 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.265475  5313 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.254314  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.264242  5464 raft_consensus.cc:515] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.272285  5313 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.271806  5268 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:00.270622  5019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56698 (request call id 63) took 1590 ms. Trace:
I20260709 13:14:00.273803  5313 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.274324  5019 rpcz_store.cc:276] 0709 13:13:58.680647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.682354 (+  1707us) service_pool.cc:224] Handling call
0709 13:14:00.135061 (+1452707us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:00.135096 (+    35us) write_op.cc:454] Released schema lock
0709 13:14:00.270553 (+135457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:13:58.691402 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:13:58.692009 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:13:58.692044 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:13:58.692066 (+    22us) tablet.cc:662] Decoding operations
0709 13:13:58.692498 (+   432us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:13:58.692594 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:13:58.692626 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:13:58.692852 (+   226us) tablet.cc:701] Row locks acquired
0709 13:13:58.692870 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:13:58.693043 (+   173us) write_op.cc:270] Start()
0709 13:13:58.693148 (+   105us) write_op.cc:276] Timestamp: P: 1783602838692990 usec, L: 0
0709 13:13:58.693172 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:13:58.693938 (+   766us) log.cc:844] Serialized 540 byte log entry
0709 13:13:58.696221 (+  2283us) op_driver.cc:464] REPLICATION: finished
0709 13:13:58.696614 (+   393us) write_op.cc:301] APPLY: starting
0709 13:13:58.696692 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:13:58.696796 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:13:58.696920 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:13:58.697124 (+   204us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:13:58.697282 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:13:58.697324 (+    42us) write_op.cc:312] APPLY: finished
0709 13:13:58.697504 (+   180us) log.cc:844] Serialized 22 byte log entry
0709 13:13:58.697677 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:13:58.697753 (+    76us) write_op.cc:454] Released schema lock
0709 13:13:58.697799 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":20274,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":155,"apply.run_cpu_time_us":1530,"apply.run_wall_time_us":1530,"num_ops":1,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":2854,"prepare.run_wall_time_us":2857,"replication_time_us":2934}]]}
I20260709 13:14:00.274629  5464 leader_election.cc:290] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.279501  5313 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.281615  5313 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.282322  5464 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.281515  5120 raft_consensus.cc:2468] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:00.282714  5313 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.285708  5416 tablet_bootstrap.cc:492] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e: No bootstrap required, opened a new log
I20260709 13:14:00.286363  5416 ts_tablet_manager.cc:1403] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e: Time spent bootstrapping tablet: real 1.570s	user 0.017s	sys 0.051s
I20260709 13:14:00.288177  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.288861  5121 raft_consensus.cc:2468] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:14:00.289207  5416 raft_consensus.cc:359] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.289953  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.290310  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.290663  5122 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:00.289953  5416 raft_consensus.cc:385] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:00.291687  5416 raft_consensus.cc:740] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Initialized, Role: FOLLOWER
I20260709 13:14:00.291409  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.292384  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.292448  5416 consensus_queue.cc:260] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.293198  5119 raft_consensus.cc:2468] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:00.294206  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.294857  5122 raft_consensus.cc:2468] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:00.295081  5416 ts_tablet_manager.cc:1434] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:14:00.296159  5313 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.282931  5464 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.298646  5313 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.299206  5464 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.299543  5237 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.295697  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.302888  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.303670  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.304344  5464 raft_consensus.cc:2804] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:00.319504  5428 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.322180  5464 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.303701  5269 raft_consensus.cc:2468] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 1.
I20260709 13:14:00.320430  5433 raft_consensus.cc:493] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.322875  5464 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.313294  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.316718  5466 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.323437  5433 raft_consensus.cc:515] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.324079  5466 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.324415  5462 raft_consensus.cc:493] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.318519  5321 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.313432  5194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.322782  5428 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.314335  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.326635  5122 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:00.313933  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.328069  5428 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.313856  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.308293  5460 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.329007  5321 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.325537  5433 leader_election.cc:290] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.329321  5460 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.330958  5321 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.331740  5195 raft_consensus.cc:2393] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 1: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.331493  5464 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.311210  5237 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.326249  5466 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.328234  5191 raft_consensus.cc:2468] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:14:00.332003  5460 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.332772  5468 raft_consensus.cc:493] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.316457  5463 raft_consensus.cc:515] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.333506  5468 raft_consensus.cc:515] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.335994  5270 raft_consensus.cc:2393] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.335536  5018 catalog_manager.cc:5697] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.336503  5085 leader_election.cc:304] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:00.335533  5468 leader_election.cc:290] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.338475  5321 raft_consensus.cc:2804] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.339090  5321 raft_consensus.cc:493] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.339109  5468 raft_consensus.cc:2804] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.306082  5313 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.340165  5468 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.339612  5321 raft_consensus.cc:3060] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.338491  5018 catalog_manager.cc:5697] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 1 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.335567  5463 leader_election.cc:290] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.340440  5085 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:00.338583  5462 raft_consensus.cc:515] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.314704  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.340552  5313 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.341349  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.344880  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.341573  5463 consensus_queue.cc:1048] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:14:00.345583  5192 raft_consensus.cc:2468] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 0.
I20260709 13:14:00.340581  5468 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.347910  5462 leader_election.cc:290] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.348155  5313 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.358745  5313 consensus_queue.cc:1048] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.346165  5194 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:00.342636  5466 raft_consensus.cc:2804] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:00.351024  5234 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.353451  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.359931  5196 raft_consensus.cc:2468] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:14:00.355151  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.355494  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.361539  5192 raft_consensus.cc:3060] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.359544  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.363971  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.365162  5017 catalog_manager.cc:5697] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.366247  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.366866  5234 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:00.342222  5470 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.368368  5470 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:00.366925  5191 raft_consensus.cc:2468] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 0.
I20260709 13:14:00.360198  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.369824  5468 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.376081  5468 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.370253  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.376526  5192 raft_consensus.cc:2468] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:00.356495  5464 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.359555  5466 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.378057  5466 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.370846  5470 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:14:00.373852  5237 leader_election.cc:304] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.373000  5234 leader_election.cc:304] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.383827  5237 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.384230  5234 leader_election.cc:304] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:00.372536  5321 raft_consensus.cc:515] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.385215  5472 raft_consensus.cc:2804] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.373462  5473 raft_consensus.cc:2804] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.386406  5473 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.386668  5321 leader_election.cc:290] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.386819  5237 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.387667  5463 raft_consensus.cc:2804] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:14:00.387868  5051 debug-util.cc:398] Leaking SignalData structure 0x7b08001cb120 after lost signal to thread 28568
I20260709 13:14:00.388433  5463 raft_consensus.cc:493] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.389067  5463 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:00.389535  5051 debug-util.cc:398] Leaking SignalData structure 0x7b08001d87c0 after lost signal to thread 5054
I20260709 13:14:00.388345  5470 raft_consensus.cc:2804] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.390426  5470 raft_consensus.cc:493] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.390475  5464 raft_consensus.cc:2804] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:00.390851  5470 raft_consensus.cc:3060] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.371363  5460 consensus_queue.cc:1048] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:14:00.370779  5469 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.398721  5018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56688 (request call id 59) took 1719 ms. Trace:
W20260709 13:14:00.398940  5051 debug-util.cc:398] Leaking SignalData structure 0x7b080011cd40 after lost signal to thread 5146
I20260709 13:14:00.399753  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.400138  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.390915  5464 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.400946  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.401871  5264 raft_consensus.cc:1240] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Rejecting Update request from peer 5b7a9ad7678346938272011c63630e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:00.401000  5464 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.400529  5271 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:14:00.385486  5234 leader_election.cc:304] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
W20260709 13:14:00.403501  5051 debug-util.cc:398] Leaking SignalData structure 0x7b08002971e0 after lost signal to thread 5221
W20260709 13:14:00.403874  5051 debug-util.cc:398] Leaking SignalData structure 0x7b08003073c0 after lost signal to thread 5222
W20260709 13:14:00.405048  5051 debug-util.cc:398] Leaking SignalData structure 0x7b080006f2e0 after lost signal to thread 5295
I20260709 13:14:00.406539  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.407374  5264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.407711  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.408133  5264 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 1.
I20260709 13:14:00.408574  5265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.409137  5264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.400995  5267 raft_consensus.cc:2393] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b7a9ad7678346938272011c63630e31 in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.390089  5468 raft_consensus.cc:2749] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.410498  5268 raft_consensus.cc:1240] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Rejecting Update request from peer 5b7a9ad7678346938272011c63630e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:00.411305  5313 raft_consensus.cc:2804] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.412190  5265 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:14:00.412845  5267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.411882  5313 raft_consensus.cc:697] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:00.414095  5433 consensus_queue.cc:1048] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.414852  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.414709  5313 consensus_queue.cc:237] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.415634  5433 consensus_queue.cc:1048] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.386724  5473 raft_consensus.cc:3060] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.385656  5472 raft_consensus.cc:493] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.413218  5464 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.411751  5268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.421280  5466 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.425325  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.428031  5470 raft_consensus.cc:515] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.432921  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.433228  5263 raft_consensus.cc:2393] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b7a9ad7678346938272011c63630e31 in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.433655  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be940b4505394de29c92782330c934b1" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.419620  5472 raft_consensus.cc:3060] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.427390  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.430085  5269 raft_consensus.cc:1240] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Rejecting Update request from peer 5b7a9ad7678346938272011c63630e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:00.372264  5085 leader_election.cc:304] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:00.431164  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.432143  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.433132  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.458551  5121 raft_consensus.cc:1240] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Rejecting Update request from peer 5b7a9ad7678346938272011c63630e31 for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:00.458441  5120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.455931  5017 catalog_manager.cc:5697] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.471805  5120 raft_consensus.cc:2468] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:14:00.437482  5116 raft_consensus.cc:1240] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Rejecting Update request from peer 5b7a9ad7678346938272011c63630e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:00.447077  5469 raft_consensus.cc:2749] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.442869  5463 raft_consensus.cc:515] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.474259  5271 raft_consensus.cc:1240] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Rejecting Update request from peer c7c79888505d4f2f86b4b9c06753c04e for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:00.448760  5433 consensus_queue.cc:1048] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:14:00.475042  5472 raft_consensus.cc:515] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.472199  5471 raft_consensus.cc:2804] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.476155  5270 raft_consensus.cc:1240] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Rejecting Update request from peer 5b7a9ad7678346938272011c63630e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:00.477006  5463 leader_election.cc:290] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.477149  5472 leader_election.cc:290] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.451329  5115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.478294  5115 raft_consensus.cc:2468] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 0.
I20260709 13:14:00.464118  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.478540  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.478919  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.458904  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.479127  5196 raft_consensus.cc:3060] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.483780  5471 raft_consensus.cc:493] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.484385  5471 raft_consensus.cc:3060] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.472573  5473 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.488384  5433 consensus_queue.cc:1048] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.488835  5163 leader_election.cc:304] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.489462  5460 raft_consensus.cc:493] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.489993  5460 raft_consensus.cc:515] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.490276  5473 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.490744  5428 raft_consensus.cc:2749] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.449290  5160 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:00.490104  5462 consensus_queue.cc:1048] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.491868  5196 raft_consensus.cc:2468] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:00.492043  5460 leader_election.cc:290] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.492647  5435 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:00.493378  5435 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.493836  5435 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.493709  5433 consensus_queue.cc:1048] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:00.493511  5461 consensus_queue.cc:1059] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:00.491796  5262 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b7a9ad7678346938272011c63630e31 in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.495286  5461 raft_consensus.cc:3055] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.495673  5461 raft_consensus.cc:740] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:00.495883  5160 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:00.496791  5428 raft_consensus.cc:2804] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:00.496459  5461 consensus_queue.cc:260] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.497179  5428 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.493237  5432 consensus_queue.cc:1059] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:14:00.494201  5163 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:00.435336  5464 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.497570  5428 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.503921  5432 raft_consensus.cc:3055] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:00.504401  5432 raft_consensus.cc:740] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:00.505213  5435 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:00.505178  5432 consensus_queue.cc:260] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.511544  5432 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.512662  5428 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.513595  5471 raft_consensus.cc:515] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.514883  5118 raft_consensus.cc:2393] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5b7a9ad7678346938272011c63630e31 in current term 1: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.402320  5018 rpcz_store.cc:276] 0709 13:13:58.678990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:13:58.679125 (+   135us) service_pool.cc:224] Handling call
0709 13:14:00.398643 (+1719518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:14:00.346769 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:14:00.347310 (+   541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:14:00.347339 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:14:00.347357 (+    18us) tablet.cc:662] Decoding operations
0709 13:14:00.349444 (+  2087us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:14:00.349530 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:14:00.349557 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:14:00.349880 (+   323us) tablet.cc:701] Row locks acquired
0709 13:14:00.349898 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:14:00.350060 (+   162us) write_op.cc:270] Start()
0709 13:14:00.350167 (+   107us) write_op.cc:276] Timestamp: P: 1783602840350016 usec, L: 0
0709 13:14:00.350187 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:14:00.350837 (+   650us) log.cc:844] Serialized 928 byte log entry
0709 13:14:00.374153 (+ 23316us) op_driver.cc:464] REPLICATION: finished
0709 13:14:00.378749 (+  4596us) write_op.cc:301] APPLY: starting
0709 13:14:00.378834 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:14:00.378945 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:14:00.379062 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:14:00.379361 (+   299us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:14:00.379527 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:14:00.379566 (+    39us) write_op.cc:312] APPLY: finished
0709 13:14:00.379761 (+   195us) log.cc:844] Serialized 28 byte log entry
0709 13:14:00.379940 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:00.380019 (+    79us) write_op.cc:454] Released schema lock
0709 13:14:00.380058 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:14:00.384748 (+  4690us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:14:00.384778 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1206,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":4374,"apply.run_cpu_time_us":1656,"apply.run_wall_time_us":5969,"num_ops":2,"prepare.queue_time_us":2584,"prepare.run_cpu_time_us":6125,"prepare.run_wall_time_us":21549,"raft.queue_time_us":16744,"raft.run_cpu_time_us":2509,"raft.run_wall_time_us":8982,"replication_time_us":23821,"thread_start_us":32314,"threads_started":4,"wal-append.queue_time_us":9129}]]}
I20260709 13:14:00.498689  5433 consensus_queue.cc:1059] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:14:00.517357  5471 leader_election.cc:290] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.467801  5466 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.462853  5470 leader_election.cc:290] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:00.517616  5433 raft_consensus.cc:2804] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.518329  5433 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.518735  5433 raft_consensus.cc:3060] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.499356  5462 consensus_queue.cc:1059] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:00.519848  5432 raft_consensus.cc:3055] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.506283  5461 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.522147  5428 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.521052  5481 raft_consensus.cc:3055] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:00.522974  5481 raft_consensus.cc:740] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:00.523842  5481 consensus_queue.cc:260] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.527323  5163 leader_election.cc:304] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.528684  5163 leader_election.cc:304] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:14:00.530143  5482 consensus_queue.cc:1059] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:00.530601  5461 raft_consensus.cc:2749] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:14:00.493027  5085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.66:44483, user_credentials={real_user=slave}} blocked reactor thread for 120854us
I20260709 13:14:00.531286  5482 raft_consensus.cc:2764] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:14:00.531679  5432 raft_consensus.cc:740] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:00.532553  5432 consensus_queue.cc:260] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.533847  5432 raft_consensus.cc:3060] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.531440  5435 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 election: Requested vote from peers 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:14:00.540977  5085 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:00.541963  5471 raft_consensus.cc:2804] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:00.541947  5433 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.547397  5471 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:00.547825  5471 raft_consensus.cc:3060] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.549219  5433 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.550367  5085 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.551227  5163 leader_election.cc:304] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.553297  5234 leader_election.cc:304] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:00.553814  5466 raft_consensus.cc:2804] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.554318  5466 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.554517  5470 raft_consensus.cc:2804] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:00.554725  5466 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.555127  5470 raft_consensus.cc:697] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:00.555991  5470 consensus_queue.cc:237] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.557296  5432 raft_consensus.cc:2749] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.564792  5466 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.567236  5466 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.570585  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.582181  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.583945  5192 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 1: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:14:00.569427  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.569977  5115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.568998  5085 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.590879  5085 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.592753  5321 raft_consensus.cc:2749] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.592155  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.598315  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.599328  5266 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b7a9ad7678346938272011c63630e31 in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.601670  5471 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.602974  5121 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b7a9ad7678346938272011c63630e31 in current term 1: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.603058  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.607292  5321 consensus_queue.cc:1048] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.604739  5432 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:00.603962  5471 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.612399  5321 consensus_queue.cc:1059] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:00.615990  5466 raft_consensus.cc:2804] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.617233  5163 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.612445  5432 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.615357  5471 raft_consensus.cc:3055] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:00.622324  5160 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.623008  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.624155  5462 raft_consensus.cc:2749] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.624512  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.625138  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:00.625839  5266 raft_consensus.cc:2468] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 1.
I20260709 13:14:00.626012  5462 raft_consensus.cc:2749] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.625335  5271 raft_consensus.cc:2393] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 3: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.622720  5471 raft_consensus.cc:740] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:00.627480  5163 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.628378  5192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.629045  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.629673  5121 raft_consensus.cc:2468] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 0.
I20260709 13:14:00.630707  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.631635  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.632022  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.632422  5263 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.632532  5481 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.632810  5116 raft_consensus.cc:2393] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 3: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.634944  5466 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:00.636996  5462 raft_consensus.cc:2749] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.637092  5466 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.639523  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.635133  5471 consensus_queue.cc:260] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.642840  5017 catalog_manager.cc:5697] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 1 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.649596  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.650228  5121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.650488  5119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.651602  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:00.652505  5117 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 1: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.652741  5266 raft_consensus.cc:2393] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 2: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.653162  5271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.646013  5471 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.658530  5115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.659369  5115 raft_consensus.cc:2393] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 1: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.649700  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.662403  5262 raft_consensus.cc:2393] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 2: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.662997  5192 raft_consensus.cc:2468] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:00.636942  5432 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.697049  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.697747  5117 raft_consensus.cc:3060] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:00.699028  5466 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.702636  5466 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.698863  5160 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.751124  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:00.751480  5117 raft_consensus.cc:2468] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:00.752723  5120 raft_consensus.cc:1240] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Rejecting Update request from peer 5b7a9ad7678346938272011c63630e31 for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:00.756059  5118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0813b7dde9c4fdd993078c4419be9df" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.756930  5118 raft_consensus.cc:2393] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 2: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.756733  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.758260  5116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.758790  5237 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.760089  5237 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
W20260709 13:14:00.760687  5160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.27.229.67:40915, user_credentials={real_user=slave}} blocked reactor thread for 61935.8us
I20260709 13:14:00.761255  5237 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.762619  5473 raft_consensus.cc:2749] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.762952  5464 raft_consensus.cc:2749] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.762790  5470 raft_consensus.cc:2749] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.759087  5116 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 1: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:00.763911  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.764961  5481 raft_consensus.cc:2804] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:00.765761  5462 consensus_queue.cc:1059] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.767017  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.768286  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a74b85acbfe4cc3bd5884201482ff4b" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.770001  5085 leader_election.cc:304] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:00.771554  5466 raft_consensus.cc:2804] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:00.772076  5466 raft_consensus.cc:697] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:00.772140  5085 leader_election.cc:304] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.772940  5466 consensus_queue.cc:237] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.771349  5237 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.776695  5473 raft_consensus.cc:2749] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.782876  5471 raft_consensus.cc:2749] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.780095  5195 raft_consensus.cc:2468] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:00.788236  5191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.798743  5197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.799695  5197 raft_consensus.cc:2393] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:14:00.800889  5481 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:00.801728  5481 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.802421  5117 raft_consensus.cc:2468] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 3.
I20260709 13:14:00.805869  5433 raft_consensus.cc:3055] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.806315  5193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.806526  5433 raft_consensus.cc:740] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:00.807273  5193 raft_consensus.cc:2393] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e in current term 1: Already voted for candidate 0d88c0686b8f405780417f916e2f273e in this term.
I20260709 13:14:00.807816  5433 consensus_queue.cc:260] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.818200  5433 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.823576  5193 raft_consensus.cc:1240] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Rejecting Update request from peer c7c79888505d4f2f86b4b9c06753c04e for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:00.830112  5464 consensus_queue.cc:1048] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.834118  5085 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.835074  5471 raft_consensus.cc:2749] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.835631  5085 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.836365  5471 raft_consensus.cc:2749] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.836812  5085 leader_election.cc:304] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.837639  5471 raft_consensus.cc:2749] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.838100  5085 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:14:00.838915  5471 raft_consensus.cc:2804] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:00.840166  5481 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.851271  5193 raft_consensus.cc:1240] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Rejecting Update request from peer c7c79888505d4f2f86b4b9c06753c04e for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:00.850865  5018 catalog_manager.cc:5697] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 5b7a9ad7678346938272011c63630e31 (127.27.229.66) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.846087  5471 raft_consensus.cc:697] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:00.855089  5471 consensus_queue.cc:237] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.846228  5321 consensus_queue.cc:1059] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:14:00.858960  5321 raft_consensus.cc:3055] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:00.859274  5321 raft_consensus.cc:740] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:00.859954  5321 consensus_queue.cc:260] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.860978  5321 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:14:00.862107  5466 consensus_queue.cc:1175] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0d88c0686b8f405780417f916e2f273e" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:14:00.846757  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:00.842378  5237 leader_election.cc:304] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.867501  5237 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.868824  5237 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e; no voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.870887  5470 raft_consensus.cc:2749] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.871644  5470 raft_consensus.cc:2749] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:00.872218  5470 raft_consensus.cc:2749] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:14:00.874457  5481 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:00.876402  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:00.876799  5196 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 3.
I20260709 13:14:00.878180  5085 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:14:00.856340  5460 consensus_queue.cc:1059] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:14:00.879257  5466 raft_consensus.cc:2804] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:00.879606  5466 raft_consensus.cc:697] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:00.880168  5466 consensus_queue.cc:237] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.876752  5237 leader_election.cc:304] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:00.884848  5473 raft_consensus.cc:2804] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:00.885388  5473 raft_consensus.cc:697] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 3 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:00.886264  5473 consensus_queue.cc:237] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.894758  5505 raft_consensus.cc:3055] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:00.895496  5505 raft_consensus.cc:740] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:00.901963  5505 consensus_queue.cc:260] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:00.910665  5505 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:00.912675  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:00.916503  5160 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5b7a9ad7678346938272011c63630e31; no voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:00.916623  5019 catalog_manager.cc:5697] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 2 to 3, leader changed from c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65) to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 3 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:00.919175  5433 raft_consensus.cc:2749] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:14:00.921118  5472 consensus_queue.cc:1048] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.922911  5313 consensus_queue.cc:1048] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:00.939934  5018 catalog_manager.cc:5697] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 5b7a9ad7678346938272011c63630e31 (127.27.229.66) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.941785  5018 catalog_manager.cc:5697] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 2 to 3, leader changed from 5b7a9ad7678346938272011c63630e31 (127.27.229.66) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 3 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:00.952759  5196 raft_consensus.cc:1240] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Rejecting Update request from peer c7c79888505d4f2f86b4b9c06753c04e for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:00.958524  5505 consensus_queue.cc:1059] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:00.959514  5506 raft_consensus.cc:3055] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:00.959875  5506 raft_consensus.cc:740] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:00.960721  5506 consensus_queue.cc:260] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:00.962103  5506 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:00.973183  5473 consensus_queue.cc:1048] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:14:01.083374  5068 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:01.127832  5472 consensus_queue.cc:1048] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.141304  5472 consensus_queue.cc:1048] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:01.223371  5263 raft_consensus.cc:1275] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.224661  5506 consensus_queue.cc:1048] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.231736  5196 raft_consensus.cc:1275] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.233404  5466 consensus_queue.cc:1048] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.245290  5263 raft_consensus.cc:1275] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.247274  5466 consensus_queue.cc:1048] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.264230  5196 raft_consensus.cc:1275] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:01.266149  5505 consensus_queue.cc:1048] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:01.294637  5196 raft_consensus.cc:1275] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:01.295820  5466 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:01.317828  5263 raft_consensus.cc:1275] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:01.319693  5471 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:01.461550  5117 raft_consensus.cc:1275] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:01.463007  5472 consensus_queue.cc:1048] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:01.476403  5196 raft_consensus.cc:3060] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:01.484810  5196 raft_consensus.cc:1275] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:01.486523  5473 consensus_queue.cc:1048] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:01.808991  5433 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:01.809556  5433 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:01.811890  5433 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:01.812605  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:01.812999  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:01.813755  5263 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 3.
I20260709 13:14:01.815078  5160 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:01.816895  5433 raft_consensus.cc:2804] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:01.817356  5433 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:01.817821  5433 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:01.826547  5433 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:01.828723  5433 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:01.829563  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:01.830097  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:01.830762  5263 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:01.838614  5263 raft_consensus.cc:2468] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 4.
I20260709 13:14:01.839962  5160 leader_election.cc:304] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:01.840727  5433 raft_consensus.cc:2804] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:01.841710  5433 raft_consensus.cc:697] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 4 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:01.842633  5433 consensus_queue.cc:237] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:01.850970  5017 catalog_manager.cc:5697] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
W20260709 13:14:02.098117  5068 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:02.152264  5471 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.153512  5471 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.156320  5471 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:02.157791  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.158516  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:02.160967  5085 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.161911  5471 raft_consensus.cc:2749] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:14:02.178435  5471 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.179327  5471 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.181613  5471 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:02.182663  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.183681  5195 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 3.
I20260709 13:14:02.184078  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:02.185443  5085 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:02.186336  5471 raft_consensus.cc:2804] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:02.186861  5471 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.187201  5471 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.196417  5471 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.198386  5471 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 4 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:02.199306  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:02.199508  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:02.200059  5195 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.210290  5195 raft_consensus.cc:2468] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 4.
I20260709 13:14:02.211633  5085 leader_election.cc:304] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:14:02.212262  5471 raft_consensus.cc:2804] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:02.212754  5471 raft_consensus.cc:697] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 4 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:02.214025  5471 consensus_queue.cc:237] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.226466  5017 catalog_manager.cc:5697] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.268275  5471 raft_consensus.cc:493] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:02.268976  5471 raft_consensus.cc:515] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.270758  5471 leader_election.cc:290] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:02.271522  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.271819  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "805755305c3341db9b9faf4823bb827e" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:02.272716  5263 raft_consensus.cc:2368] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e for earlier term 3. Current term is 4.
I20260709 13:14:02.273711  5085 leader_election.cc:400] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915) with higher term. Message: Invalid argument: T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e for earlier term 3. Current term is 4.
I20260709 13:14:02.273964  5085 leader_election.cc:403] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:02.274457  5471 raft_consensus.cc:3060] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.281591  5471 raft_consensus.cc:2749] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915) with higher term. Message: Invalid argument: T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7c79888505d4f2f86b4b9c06753c04e for earlier term 3. Current term is 4.
I20260709 13:14:02.318785  5473 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:02.319779  5473 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.323326  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:02.323706  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.324627  5117 raft_consensus.cc:2393] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 2: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:02.324569  5195 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:02.325951  5234 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:02.327395  5470 raft_consensus.cc:493] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:02.328365  5470 raft_consensus.cc:515] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.329835  5313 raft_consensus.cc:2804] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:02.330390  5313 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5b7a9ad7678346938272011c63630e31)
I20260709 13:14:02.330796  5313 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.322515  5473 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:02.333549  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:02.335681  5473 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:02.337123  5473 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.336313  5470 leader_election.cc:290] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:02.341295  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.342308  5196 raft_consensus.cc:2393] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 2: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:14:02.346276  5313 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.348991  5313 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:02.352245  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:02.354655  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:02.355770  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:02.356892  5117 raft_consensus.cc:2393] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 2: Already voted for candidate c7c79888505d4f2f86b4b9c06753c04e in this term.
I20260709 13:14:02.362278  5122 raft_consensus.cc:2468] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:02.362919  5473 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:02.363896  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5ea5df379e4100a68c3589be0d9849" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.364763  5195 raft_consensus.cc:2368] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e for earlier term 3. Current term is 4.
I20260709 13:14:02.365911  5234 leader_election.cc:400] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483) with higher term. Message: Invalid argument: T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e for earlier term 3. Current term is 4.
I20260709 13:14:02.366336  5234 leader_election.cc:403] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:14:02.366647  5196 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:02.368244  5234 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:02.367527  5473 raft_consensus.cc:3060] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.368597  5237 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.369275  5530 raft_consensus.cc:2804] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:02.369966  5313 raft_consensus.cc:2804] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:02.370329  5313 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:02.370675  5313 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.370734  5530 raft_consensus.cc:697] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:02.372217  5530 consensus_queue.cc:237] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.379501  5470 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.379420  5313 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.380474  5470 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.383095  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:02.383981  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:02.384845  5117 raft_consensus.cc:2468] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:02.385210  5470 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:02.386261  5237 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:02.387269  5470 raft_consensus.cc:2804] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:14:02.387686  5470 raft_consensus.cc:493] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.388048  5470 raft_consensus.cc:3060] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.388626  5263 raft_consensus.cc:1275] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:02.389765  5313 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:02.388032  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.390321  5433 consensus_queue.cc:1048] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:02.391185  5196 raft_consensus.cc:2468] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 1.
I20260709 13:14:02.390525  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:02.392283  5195 raft_consensus.cc:2393] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 2: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:14:02.399243  5122 raft_consensus.cc:2468] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:02.400710  5017 catalog_manager.cc:5697] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 1 to 2, leader changed from 5b7a9ad7678346938272011c63630e31 (127.27.229.66) to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 2 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:02.402292  5237 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.386822  5473 raft_consensus.cc:2749] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483) with higher term. Message: Invalid argument: T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e for earlier term 3. Current term is 4.
I20260709 13:14:02.404986  5313 raft_consensus.cc:2804] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:02.405586  5313 raft_consensus.cc:697] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:02.406692  5313 consensus_queue.cc:237] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.411860  5470 raft_consensus.cc:515] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.415611  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:02.416277  5122 raft_consensus.cc:3060] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.417064  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dc6d242ddb3480aa056198e7b942d07" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:02.417703  5196 raft_consensus.cc:3060] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:02.424925  5122 raft_consensus.cc:2468] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:02.428648  5196 raft_consensus.cc:2468] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 2.
I20260709 13:14:02.430814  5234 leader_election.cc:304] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:02.429387  5470 leader_election.cc:290] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:02.431764  5313 raft_consensus.cc:2804] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:02.432286  5313 raft_consensus.cc:697] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:02.433368  5313 consensus_queue.cc:237] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.435328  5017 catalog_manager.cc:5697] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 1 to 2, leader changed from c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65) to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 2 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:02.438233  5122 raft_consensus.cc:1275] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:02.440364  5533 consensus_queue.cc:1048] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:02.446554  5470 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:02.447476  5470 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:02.451000  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31" is_pre_election: true
I20260709 13:14:02.452081  5196 raft_consensus.cc:2393] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 3: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:14:02.454442  5470 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:14:02.455608  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:02.456509  5117 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 3.
I20260709 13:14:02.457813  5237 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.459069  5470 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:14:02.459481  5470 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting leader election (detected failure of leader c7c79888505d4f2f86b4b9c06753c04e)
I20260709 13:14:02.459808  5470 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.477877  5018 catalog_manager.cc:5697] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 0 to 2, leader changed from <none> to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 2 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:02.484468  5470 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:02.486720  5470 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:14:02.487884  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:02.490787  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:02.491690  5196 raft_consensus.cc:2393] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d88c0686b8f405780417f916e2f273e in current term 3: Already voted for candidate 5b7a9ad7678346938272011c63630e31 in this term.
I20260709 13:14:02.501803  5117 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 3.
I20260709 13:14:02.503090  5237 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.503916  5470 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:02.504462  5470 raft_consensus.cc:697] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 3 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:02.505381  5470 consensus_queue.cc:237] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:02.514246  5018 catalog_manager.cc:5697] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 2 to 3, leader changed from c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65) to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 3 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.607844  5196 raft_consensus.cc:1275] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:02.609366  5471 consensus_queue.cc:1048] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:02.625213  5263 raft_consensus.cc:1275] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:02.627393  5544 consensus_queue.cc:1048] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:02.645982  5537 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:02.646667  5537 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:02.649197  5537 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:14:02.649873  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e" is_pre_election: true
I20260709 13:14:02.650313  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e" is_pre_election: true
I20260709 13:14:02.651003  5117 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 3.
I20260709 13:14:02.652143  5163 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:14:02.652971  5537 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:14:02.653407  5537 raft_consensus.cc:493] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:02.653692  5537 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.660717  5537 raft_consensus.cc:515] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:02.662549  5537 leader_election.cc:290] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 election: Requested vote from peers 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915), c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527)
I20260709 13:14:02.663427  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:02.664387  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2daea3d597cc4a4c8935365a2e03a23a" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:02.665035  5117 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.671077  5117 raft_consensus.cc:2468] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 4.
I20260709 13:14:02.672160  5163 leader_election.cc:304] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 0d88c0686b8f405780417f916e2f273e
I20260709 13:14:02.673022  5537 raft_consensus.cc:2804] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:02.673440  5537 raft_consensus.cc:697] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 4 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:02.674397  5537 consensus_queue.cc:237] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:02.683374  5017 catalog_manager.cc:5697] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 3 to 4, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:02.866958  5263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:14:02.867944  5263 raft_consensus.cc:606] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:02.868284  5117 raft_consensus.cc:1275] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:02.869827  5470 consensus_queue.cc:1048] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:02.873898  5196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:35522
I20260709 13:14:02.874538  5196 raft_consensus.cc:606] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:02.882817  5196 raft_consensus.cc:1275] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:14:02.886116  5473 consensus_queue.cc:1048] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:02.887902  5263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f331ba3a1df54c029047713c03b71def"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:14:02.888602  5263 raft_consensus.cc:606] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:02.895395  5263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:14:02.896112  5263 raft_consensus.cc:606] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Received request to transfer leadership to TS c7c79888505d4f2f86b4b9c06753c04e
I20260709 13:14:02.903646  5263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:14:02.904328  5263 raft_consensus.cc:606] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.910676  5263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2079268427b43698086a3f3241df795"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:14:02.911221  5263 raft_consensus.cc:606] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Received request to transfer leadership to TS 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.917492  5263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
mode: GRACEFUL
new_leader_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:56986
I20260709 13:14:02.918067  5263 raft_consensus.cc:606] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Received request to transfer leadership to TS 5b7a9ad7678346938272011c63630e31
I20260709 13:14:02.922163  5196 raft_consensus.cc:1240] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 4 LEADER]: Rejecting Update request from peer 0d88c0686b8f405780417f916e2f273e for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:02.924780  5117 raft_consensus.cc:1240] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Rejecting Update request from peer 0d88c0686b8f405780417f916e2f273e for earlier term 3. Current term is 4. Ops: []
I20260709 13:14:02.924962  5473 consensus_queue.cc:1059] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:02.926038  5473 consensus_queue.cc:1243] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [LEADER]: Peer 5b7a9ad7678346938272011c63630e31 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:14:02.926501  5530 consensus_queue.cc:1059] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:02.928321  5470 raft_consensus.cc:3055] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:02.928642  5470 raft_consensus.cc:740] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:02.929291  5470 consensus_queue.cc:260] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } } peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } }
I20260709 13:14:02.930305  5470 raft_consensus.cc:3060] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:02.942107  5196 raft_consensus.cc:1275] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.943558  5530 consensus_queue.cc:1048] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.943589  5117 raft_consensus.cc:1275] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.945904  5530 consensus_queue.cc:1048] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:02.965847  5473 raft_consensus.cc:993] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:02.966423  5470 raft_consensus.cc:1081] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:02.967087  5117 raft_consensus.cc:1275] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.969547  5530 consensus_queue.cc:1048] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:02.971901  5122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 13:14:02.976588  5122 raft_consensus.cc:493] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:02.977035  5122 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:02.982702  5196 raft_consensus.cc:1275] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:02.984490  5470 consensus_queue.cc:1048] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:02.987952  5122 raft_consensus.cc:515] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:02.994496  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:02.995136  5195 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:03.007680  5195 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 3.
I20260709 13:14:03.009245  5122 leader_election.cc:290] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:03.011379  5085 leader_election.cc:304] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:03.011658  5263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "139ea201bd904f1b9a8f69dcab29c2dd" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:03.012354  5263 raft_consensus.cc:3055] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:03.012656  5263 raft_consensus.cc:740] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:03.013213  5470 raft_consensus.cc:993] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: : Instructing follower 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:03.014911  5470 raft_consensus.cc:1081] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Signalling peer 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:03.015547  5544 raft_consensus.cc:2804] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:03.016129  5544 raft_consensus.cc:697] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 3 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:03.017151  5544 consensus_queue.cc:237] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.023428  5193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:35508
I20260709 13:14:03.024166  5193 raft_consensus.cc:493] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.024557  5193 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:03.013443  5263 consensus_queue.cc:260] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.029951  5535 raft_consensus.cc:993] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:03.030290  5263 raft_consensus.cc:3060] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:03.030514  5535 raft_consensus.cc:1081] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:03.032341  5117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32866
I20260709 13:14:03.032893  5117 raft_consensus.cc:493] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.033270  5117 raft_consensus.cc:3060] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.033985  5470 raft_consensus.cc:993] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:03.034547  5470 raft_consensus.cc:1081] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:03.041435  5117 raft_consensus.cc:515] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.045450  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:03.045820  5117 leader_election.cc:290] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:03.046093  5196 raft_consensus.cc:3055] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:03.046489  5196 raft_consensus.cc:740] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:03.047386  5196 consensus_queue.cc:260] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.048441  5196 raft_consensus.cc:3060] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.048753  5193 raft_consensus.cc:515] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.050983  5269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1003f2d372b44f0aa07221068f4fdbd3" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:03.051105  5193 leader_election.cc:290] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:03.052618  5269 raft_consensus.cc:3060] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.052924  5195 raft_consensus.cc:1240] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Rejecting Update request from peer 0d88c0686b8f405780417f916e2f273e for earlier term 2. Current term is 3. Ops: []
I20260709 13:14:03.053035  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:03.053700  5262 raft_consensus.cc:3055] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:03.054018  5262 raft_consensus.cc:740] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:03.051834  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e301e6d29fd4569bc78544c0685685c" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:03.054553  5473 consensus_queue.cc:1059] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.055269  5117 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:03.058444  5262 consensus_queue.cc:260] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.060480  5262 raft_consensus.cc:3060] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:03.061491  5020 catalog_manager.cc:5697] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 2 to 3, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 3 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.046149  5118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 13:14:03.070490  5118 raft_consensus.cc:493] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.073465  5117 raft_consensus.cc:2468] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 3.
I20260709 13:14:03.073802  5118 raft_consensus.cc:3060] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.075155  5163 leader_election.cc:304] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:03.076323  5537 raft_consensus.cc:2804] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:03.078814  5263 raft_consensus.cc:2468] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 3.
I20260709 13:14:03.076845  5537 raft_consensus.cc:697] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 3 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:03.082068  5537 consensus_queue.cc:237] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.073223  5269 raft_consensus.cc:2468] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:03.066910  5196 raft_consensus.cc:2468] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:03.076884  5262 raft_consensus.cc:2468] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 3.
W20260709 13:14:03.084648  5473 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:14:03.085281  5085 leader_election.cc:304] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:03.086975  5471 raft_consensus.cc:2804] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:03.087486  5471 raft_consensus.cc:697] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:03.088472  5471 consensus_queue.cc:237] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.090834  5263 raft_consensus.cc:1275] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:14:03.093446  5263 pending_rounds.cc:85] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: Aborting all ops after (but not including) 2
I20260709 13:14:03.093724  5263 pending_rounds.cc:107] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:14:03.094074  5263 raft_consensus.cc:2889] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:14:03.095752  5535 consensus_queue.cc:1048] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.096189  5118 raft_consensus.cc:515] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.098758  5118 leader_election.cc:290] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:03.099447  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:03.100103  5196 raft_consensus.cc:3060] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.107043  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d436ea16af034c70bb2b2ca8eff7abcb" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:03.107739  5262 raft_consensus.cc:3055] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:03.108048  5262 raft_consensus.cc:740] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:03.111174  5196 raft_consensus.cc:2468] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:03.112506  5020 catalog_manager.cc:5697] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 2 to 3, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 3 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.114269  5085 leader_election.cc:304] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:03.114763  5470 raft_consensus.cc:993] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: : Instructing follower 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:03.115128  5506 raft_consensus.cc:2804] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:03.115324  5470 raft_consensus.cc:1081] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:03.115728  5506 raft_consensus.cc:697] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:03.116732  5506 consensus_queue.cc:237] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.108953  5262 consensus_queue.cc:260] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.123931  5262 raft_consensus.cc:3060] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.134006  5196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:35508
I20260709 13:14:03.136689  5196 raft_consensus.cc:493] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.137666  5196 raft_consensus.cc:3060] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.138959  5118 raft_consensus.cc:1275] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:14:03.141624  5535 consensus_queue.cc:1048] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.147589  5262 raft_consensus.cc:2468] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:03.164955  5020 catalog_manager.cc:5697] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 5b7a9ad7678346938272011c63630e31 (127.27.229.66) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.166898  5196 raft_consensus.cc:515] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.175812  5196 leader_election.cc:290] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:03.176919  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:03.176993  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd1707f4d4084cb08ccfad64c28362c5" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:03.181877  5117 raft_consensus.cc:3060] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.182431  5262 raft_consensus.cc:3055] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:03.182772  5262 raft_consensus.cc:740] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:03.184234  5262 consensus_queue.cc:260] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.186404  5262 raft_consensus.cc:3060] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.189615  5117 raft_consensus.cc:2468] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:14:03.190930  5163 leader_election.cc:304] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:03.191032  5020 catalog_manager.cc:5697] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.191857  5537 raft_consensus.cc:2804] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:03.193076  5537 raft_consensus.cc:697] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:03.194024  5262 raft_consensus.cc:2468] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:14:03.194115  5537 consensus_queue.cc:237] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.203008  5018 catalog_manager.cc:5697] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.243268  5313 raft_consensus.cc:993] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: : Instructing follower c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:03.243743  5473 raft_consensus.cc:1081] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer c7c79888505d4f2f86b4b9c06753c04e to start an election
I20260709 13:14:03.245486  5117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f331ba3a1df54c029047713c03b71def"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
 from {username='slave'} at 127.0.0.1:32880
I20260709 13:14:03.246014  5117 raft_consensus.cc:493] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.246318  5117 raft_consensus.cc:3060] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.251647  5117 raft_consensus.cc:515] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.253400  5117 leader_election.cc:290] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Requested vote from peers 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:03.254338  5196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:03.254561  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331ba3a1df54c029047713c03b71def" candidate_uuid: "c7c79888505d4f2f86b4b9c06753c04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:03.255028  5196 raft_consensus.cc:3060] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.255208  5262 raft_consensus.cc:3055] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:03.255626  5262 raft_consensus.cc:740] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:03.256316  5262 consensus_queue.cc:260] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.257366  5262 raft_consensus.cc:3060] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.262285  5196 raft_consensus.cc:2468] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:03.262769  5262 raft_consensus.cc:2468] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7c79888505d4f2f86b4b9c06753c04e in term 2.
I20260709 13:14:03.263724  5085 leader_election.cc:304] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:03.264626  5506 raft_consensus.cc:2804] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:03.265027  5506 raft_consensus.cc:697] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Leader. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:03.265821  5506 consensus_queue.cc:237] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.274107  5018 catalog_manager.cc:5697] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65). New cstate: current_term: 2 leader_uuid: "c7c79888505d4f2f86b4b9c06753c04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.327129  5313 raft_consensus.cc:993] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: : Instructing follower 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:03.327615  5473 raft_consensus.cc:1081] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Signalling peer 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:03.329218  5196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2079268427b43698086a3f3241df795"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:35508
I20260709 13:14:03.329707  5196 raft_consensus.cc:493] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:03.330008  5196 raft_consensus.cc:3060] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.334694  5196 raft_consensus.cc:515] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.336864  5196 leader_election.cc:290] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:03.338416  5262 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:03.339123  5262 raft_consensus.cc:3055] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:03.339285  5117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2079268427b43698086a3f3241df795" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:03.339571  5262 raft_consensus.cc:740] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:03.340138  5117 raft_consensus.cc:3060] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.340859  5262 consensus_queue.cc:260] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.342430  5262 raft_consensus.cc:3060] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:03.347617  5117 raft_consensus.cc:2468] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:14:03.349138  5163 leader_election.cc:304] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b7a9ad7678346938272011c63630e31, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:03.349706  5262 raft_consensus.cc:2468] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 2.
I20260709 13:14:03.349988  5537 raft_consensus.cc:2804] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:03.350641  5537 raft_consensus.cc:697] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:03.351588  5537 consensus_queue.cc:237] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:03.360850  5018 catalog_manager.cc:5697] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 1 to 2, leader changed from 0d88c0686b8f405780417f916e2f273e (127.27.229.67) to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 2 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:03.435966  5262 raft_consensus.cc:1275] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:03.437638  5506 consensus_queue.cc:1048] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.449013  5196 raft_consensus.cc:1275] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:03.450532  5471 consensus_queue.cc:1048] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.521243  5262 raft_consensus.cc:1275] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.522533  5471 consensus_queue.cc:1048] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.525808  5263 raft_consensus.cc:1275] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.528723  5471 consensus_queue.cc:1048] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.535173  5196 raft_consensus.cc:1275] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.536871  5544 consensus_queue.cc:1048] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.564792  5193 raft_consensus.cc:1275] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.566372  5506 consensus_queue.cc:1048] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.569541  5262 raft_consensus.cc:1275] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:03.570799  5555 consensus_queue.cc:1048] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.573329  5117 raft_consensus.cc:1275] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:03.574940  5537 consensus_queue.cc:1048] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:03.595173  5117 raft_consensus.cc:1275] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.599978  5555 consensus_queue.cc:1048] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.625866  5262 raft_consensus.cc:1275] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.627367  5555 consensus_queue.cc:1048] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.778127  5262 raft_consensus.cc:1275] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.779379  5506 consensus_queue.cc:1048] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.790061  5193 raft_consensus.cc:1275] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Refusing update from remote peer c7c79888505d4f2f86b4b9c06753c04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.791704  5471 consensus_queue.cc:1048] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.821875  5262 raft_consensus.cc:1275] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.823189  5555 consensus_queue.cc:1048] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:03.833014  5117 raft_consensus.cc:1275] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:03.838163  5537 consensus_queue.cc:1048] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:05.928342  5017 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56718:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:14:05.949558  5017 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56718:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:14:05.985471 28565 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:06.098687  5609 tablet.cc:1724] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.100957  5610 tablet.cc:1724] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.146292  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
mode: GRACEFUL
new_leader_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:56014
I20260709 13:14:06.147068  5117 raft_consensus.cc:606] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 LEADER]: Received request to transfer leadership to TS 5b7a9ad7678346938272011c63630e31
I20260709 13:14:06.165232  5117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9"
dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
mode: GRACEFUL
new_leader_uuid: "0d88c0686b8f405780417f916e2f273e"
 from {username='slave'} at 127.0.0.1:56014
W20260709 13:14:06.167892  5602 log.cc:927] Time spent T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:14:06.165977  5117 raft_consensus.cc:606] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Received request to transfer leadership to TS 0d88c0686b8f405780417f916e2f273e
I20260709 13:14:06.180522 28565 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:06.181299 28565 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:06.223590  5624 tablet.cc:1724] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.278187  5627 tablet.cc:1724] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.281421  5633 tablet.cc:1724] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:06.285175  5160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.27.229.67:40915, user_credentials={real_user=slave}} blocked reactor thread for 94732.9us
I20260709 13:14:06.307476  5610 tablet.cc:1724] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:06.318064  5623 log.cc:927] Time spent T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:14:06.340643  5609 tablet.cc:1724] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.352758  5635 tablet.cc:1724] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:14:06.354048  5617 log.cc:927] Time spent T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:14:06.318136  5629 tablet.cc:1724] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.368054  5638 tablet.cc:1724] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.370016  5624 tablet.cc:1724] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.378165  5639 tablet.cc:1724] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.388695  5641 tablet.cc:1724] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.392177  5609 tablet.cc:1724] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.393047  5629 tablet.cc:1724] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.395795  5615 raft_consensus.cc:993] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e: : Instructing follower 0d88c0686b8f405780417f916e2f273e to start an election
I20260709 13:14:06.398221  5615 raft_consensus.cc:1081] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Signalling peer 0d88c0686b8f405780417f916e2f273e to start an election
I20260709 13:14:06.379539  5636 tablet.cc:1724] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.406764  5266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9"
dest_uuid: "0d88c0686b8f405780417f916e2f273e"
 from {username='slave'} at 127.0.0.1:56970
I20260709 13:14:06.409054  5266 raft_consensus.cc:493] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:06.409533  5266 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.411829  5610 tablet.cc:1724] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.418777  5629 tablet.cc:1724] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.424180  5642 tablet.cc:1724] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.427446  5624 tablet.cc:1724] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.433804  5635 tablet.cc:1724] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.439492  5641 tablet.cc:1724] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.397835  5627 tablet.cc:1724] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.437533  5633 tablet.cc:1724] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.467186  5639 tablet.cc:1724] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.479310  5266 raft_consensus.cc:515] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:06.471783  5624 tablet.cc:1724] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.486773  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:06.487432  5122 raft_consensus.cc:3055] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:06.487733  5122 raft_consensus.cc:740] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:06.488569  5122 consensus_queue.cc:260] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:06.489703  5122 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.495723  5610 tablet.cc:1724] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:14:06.504662  5122 raft_consensus.cc:2468] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 3.
I20260709 13:14:06.506263  5237 leader_election.cc:304] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, c7c79888505d4f2f86b4b9c06753c04e; no voters: 
I20260709 13:14:06.507251  5620 raft_consensus.cc:2804] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:06.507766  5620 raft_consensus.cc:697] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 3 LEADER]: Becoming Leader. State: Replica: 0d88c0686b8f405780417f916e2f273e, State: Running, Role: LEADER
I20260709 13:14:06.508622  5620 consensus_queue.cc:237] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:06.509294  5195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8000d55e864e4f40bc76f6f61c8acfe9" candidate_uuid: "0d88c0686b8f405780417f916e2f273e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5b7a9ad7678346938272011c63630e31"
I20260709 13:14:06.511108  5195 raft_consensus.cc:3060] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:06.523761  5195 raft_consensus.cc:2468] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d88c0686b8f405780417f916e2f273e in term 3.
I20260709 13:14:06.524420  5266 leader_election.cc:290] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [CANDIDATE]: Term 3 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483)
I20260709 13:14:06.525677  5017 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f: soft_deleted_table [id=8967ed520f4c4ee99e3c997166890bc9] alter complete (version 1)
I20260709 13:14:06.538180  5019 catalog_manager.cc:5697] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e reported cstate change: term changed from 2 to 3, leader changed from c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65) to 0d88c0686b8f405780417f916e2f273e (127.27.229.67). New cstate: current_term: 3 leader_uuid: "0d88c0686b8f405780417f916e2f273e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:06.560724  5607 raft_consensus.cc:993] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e: : Instructing follower 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:06.561223  5644 raft_consensus.cc:1081] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 LEADER]: Signalling peer 5b7a9ad7678346938272011c63630e31 to start an election
I20260709 13:14:06.562706  5195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f"
dest_uuid: "5b7a9ad7678346938272011c63630e31"
 from {username='slave'} at 127.0.0.1:35506
I20260709 13:14:06.563187  5195 raft_consensus.cc:493] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:06.563467  5195 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:06.568667  5195 raft_consensus.cc:515] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:06.570328  5195 leader_election.cc:290] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 election: Requested vote from peers c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527), 0d88c0686b8f405780417f916e2f273e (127.27.229.67:40915)
I20260709 13:14:06.571161  5122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c7c79888505d4f2f86b4b9c06753c04e"
I20260709 13:14:06.571305  5266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0608bfa534fa4ad38d6ec2edfe7a442f" candidate_uuid: "5b7a9ad7678346938272011c63630e31" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0d88c0686b8f405780417f916e2f273e"
I20260709 13:14:06.571825  5122 raft_consensus.cc:3055] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:06.571890  5266 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:06.572149  5122 raft_consensus.cc:740] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c7c79888505d4f2f86b4b9c06753c04e, State: Running, Role: LEADER
I20260709 13:14:06.572903  5122 consensus_queue.cc:260] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:06.574002  5122 raft_consensus.cc:3060] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:06.577616  5266 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 4.
I20260709 13:14:06.578904  5160 leader_election.cc:304] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d88c0686b8f405780417f916e2f273e, 5b7a9ad7678346938272011c63630e31; no voters: 
I20260709 13:14:06.579612  5537 raft_consensus.cc:2804] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:06.579608  5122 raft_consensus.cc:2468] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b7a9ad7678346938272011c63630e31 in term 4.
I20260709 13:14:06.580338  5537 raft_consensus.cc:697] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 4 LEADER]: Becoming Leader. State: Replica: 5b7a9ad7678346938272011c63630e31, State: Running, Role: LEADER
I20260709 13:14:06.581271  5537 consensus_queue.cc:237] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } }
I20260709 13:14:06.589560  5019 catalog_manager.cc:5697] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 reported cstate change: term changed from 3 to 4, leader changed from c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65) to 5b7a9ad7678346938272011c63630e31 (127.27.229.66). New cstate: current_term: 4 leader_uuid: "5b7a9ad7678346938272011c63630e31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:06.927703  5122 raft_consensus.cc:1275] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:06.929033  5620 consensus_queue.cc:1048] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:06.939225  5195 raft_consensus.cc:1275] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Refusing update from remote peer 0d88c0686b8f405780417f916e2f273e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:06.940985  5625 consensus_queue.cc:1048] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b7a9ad7678346938272011c63630e31" member_type: VOTER last_known_addr { host: "127.27.229.66" port: 44483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:07.022728  5266 raft_consensus.cc:1275] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:07.023914  5611 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88c0686b8f405780417f916e2f273e" member_type: VOTER last_known_addr { host: "127.27.229.67" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:07.033397  5122 raft_consensus.cc:1275] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Refusing update from remote peer 5b7a9ad7678346938272011c63630e31: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:07.035372  5611 consensus_queue.cc:1048] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7c79888505d4f2f86b4b9c06753c04e" member_type: VOTER last_known_addr { host: "127.27.229.65" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:07.239415 28565 tablet_server.cc:179] TabletServer@127.27.229.65:0 shutting down...
W20260709 13:14:07.249126  5237 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:14:07.252442  5237 consensus_peers.cc:597] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.274583 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:07.275485 28565 tablet_replica.cc:333] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.276376 28565 raft_consensus.cc:2243] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.277169 28565 raft_consensus.cc:2272] T d436ea16af034c70bb2b2ca8eff7abcb P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.280331 28565 tablet_replica.cc:333] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.281014 28565 raft_consensus.cc:2243] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.281538 28565 raft_consensus.cc:2272] T bd1707f4d4084cb08ccfad64c28362c5 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:07.283387  5163 consensus_peers.cc:597] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.284428 28565 tablet_replica.cc:333] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.285082 28565 raft_consensus.cc:2243] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.285498 28565 raft_consensus.cc:2272] T d2079268427b43698086a3f3241df795 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.288503 28565 tablet_replica.cc:333] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.289296 28565 raft_consensus.cc:2243] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.289855 28565 raft_consensus.cc:2272] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.292654 28565 tablet_replica.cc:333] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.293334 28565 raft_consensus.cc:2243] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.293787 28565 raft_consensus.cc:2272] T 7e301e6d29fd4569bc78544c0685685c P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.296339 28565 tablet_replica.cc:333] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.296995 28565 raft_consensus.cc:2243] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.297781 28565 raft_consensus.cc:2272] T f331ba3a1df54c029047713c03b71def P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.300422 28565 tablet_replica.cc:333] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.301040 28565 raft_consensus.cc:2243] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.301472 28565 raft_consensus.cc:2272] T 4dc6d242ddb3480aa056198e7b942d07 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.303829 28565 tablet_replica.cc:333] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.304443 28565 raft_consensus.cc:2243] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.305280 28565 raft_consensus.cc:2272] T f0813b7dde9c4fdd993078c4419be9df P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.307868 28565 tablet_replica.cc:333] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.308734 28565 raft_consensus.cc:2243] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.309475 28565 raft_consensus.cc:2272] T 139ea201bd904f1b9a8f69dcab29c2dd P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.311969 28565 tablet_replica.cc:333] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.312500 28565 raft_consensus.cc:2243] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.312911 28565 raft_consensus.cc:2272] T 2daea3d597cc4a4c8935365a2e03a23a P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.314865 28565 tablet_replica.cc:333] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.315364 28565 raft_consensus.cc:2243] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.316083 28565 raft_consensus.cc:2272] T 1003f2d372b44f0aa07221068f4fdbd3 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.318657 28565 tablet_replica.cc:333] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.319195 28565 raft_consensus.cc:2243] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.319592 28565 raft_consensus.cc:2272] T 8000d55e864e4f40bc76f6f61c8acfe9 P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.322026 28565 tablet_replica.cc:333] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.322575 28565 raft_consensus.cc:2243] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.323024 28565 raft_consensus.cc:2272] T 805755305c3341db9b9faf4823bb827e P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.325100 28565 tablet_replica.cc:333] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.325599 28565 raft_consensus.cc:2243] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.326062 28565 raft_consensus.cc:2272] T bbfb0f61fc8542678397012b66fd6377 P c7c79888505d4f2f86b4b9c06753c04e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.328102 28565 tablet_replica.cc:333] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.328569 28565 raft_consensus.cc:2243] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.329344 28565 raft_consensus.cc:2272] T be940b4505394de29c92782330c934b1 P c7c79888505d4f2f86b4b9c06753c04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.331411 28565 tablet_replica.cc:333] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.331907 28565 raft_consensus.cc:2243] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.332302 28565 raft_consensus.cc:2272] T 0608bfa534fa4ad38d6ec2edfe7a442f P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.335233 28565 tablet_replica.cc:333] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.335788 28565 raft_consensus.cc:2243] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.336265 28565 raft_consensus.cc:2272] T 9a74b85acbfe4cc3bd5884201482ff4b P c7c79888505d4f2f86b4b9c06753c04e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:07.336897  5163 consensus_peers.cc:597] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.338402 28565 tablet_replica.cc:333] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e: stopping tablet replica
I20260709 13:14:07.338990 28565 raft_consensus.cc:2243] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.339705 28565 raft_consensus.cc:2272] T ff5ea5df379e4100a68c3589be0d9849 P c7c79888505d4f2f86b4b9c06753c04e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:07.352174  5163 consensus_peers.cc:597] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:07.363243  5163 consensus_peers.cc:597] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.383194 28565 tablet_server.cc:196] TabletServer@127.27.229.65:0 shutdown complete.
W20260709 13:14:07.407053  5237 consensus_peers.cc:597] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.420123 28565 tablet_server.cc:179] TabletServer@127.27.229.66:0 shutting down...
W20260709 13:14:07.450364  5237 consensus_peers.cc:597] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.450726 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:14:07.450784  5234 consensus_peers.cc:597] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e -> Peer 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483): Couldn't send request to peer 5b7a9ad7678346938272011c63630e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.451546 28565 tablet_replica.cc:333] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.452296 28565 raft_consensus.cc:2243] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.452728 28565 raft_consensus.cc:2272] T f331ba3a1df54c029047713c03b71def P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.455354 28565 tablet_replica.cc:333] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.455981 28565 raft_consensus.cc:2243] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.456408 28565 raft_consensus.cc:2272] T d436ea16af034c70bb2b2ca8eff7abcb P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.458297 28565 tablet_replica.cc:333] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.458819 28565 raft_consensus.cc:2243] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.459517 28565 raft_consensus.cc:2272] T bd1707f4d4084cb08ccfad64c28362c5 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.461405 28565 tablet_replica.cc:333] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.461953 28565 raft_consensus.cc:2243] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.462715 28565 raft_consensus.cc:2272] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.464604 28565 tablet_replica.cc:333] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.465114 28565 raft_consensus.cc:2243] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.465795 28565 raft_consensus.cc:2272] T d2079268427b43698086a3f3241df795 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.468164 28565 tablet_replica.cc:333] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.468771 28565 raft_consensus.cc:2243] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.469528 28565 raft_consensus.cc:2272] T 7e301e6d29fd4569bc78544c0685685c P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:07.471330  5163 consensus_peers.cc:597] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.472013 28565 tablet_replica.cc:333] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.472806 28565 raft_consensus.cc:2243] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.473361 28565 raft_consensus.cc:2272] T 4dc6d242ddb3480aa056198e7b942d07 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.476117 28565 tablet_replica.cc:333] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.476864 28565 raft_consensus.cc:2243] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:07.476994  5234 consensus_peers.cc:597] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e -> Peer 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483): Couldn't send request to peer 5b7a9ad7678346938272011c63630e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.477458 28565 raft_consensus.cc:2272] T f0813b7dde9c4fdd993078c4419be9df P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.479689 28565 tablet_replica.cc:333] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.480249 28565 raft_consensus.cc:2243] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.480702 28565 raft_consensus.cc:2272] T 139ea201bd904f1b9a8f69dcab29c2dd P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.482633 28565 tablet_replica.cc:333] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.483182 28565 raft_consensus.cc:2243] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.483939 28565 raft_consensus.cc:2272] T 805755305c3341db9b9faf4823bb827e P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.486122 28565 tablet_replica.cc:333] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.486888 28565 raft_consensus.cc:2243] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.487501 28565 raft_consensus.cc:2272] T bbfb0f61fc8542678397012b66fd6377 P 5b7a9ad7678346938272011c63630e31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.490275 28565 tablet_replica.cc:333] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.490950 28565 raft_consensus.cc:2243] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:14:07.491314  5237 consensus_peers.cc:597] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e -> Peer c7c79888505d4f2f86b4b9c06753c04e (127.27.229.65:35527): Couldn't send request to peer c7c79888505d4f2f86b4b9c06753c04e. Status: Network error: Client connection negotiation failed: client connection to 127.27.229.65:35527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.491525 28565 raft_consensus.cc:2272] T ff5ea5df379e4100a68c3589be0d9849 P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.493662 28565 tablet_replica.cc:333] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.494235 28565 raft_consensus.cc:2243] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.494990 28565 raft_consensus.cc:2272] T 0608bfa534fa4ad38d6ec2edfe7a442f P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.497417 28565 tablet_replica.cc:333] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.498027 28565 raft_consensus.cc:2243] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.498453 28565 raft_consensus.cc:2272] T be940b4505394de29c92782330c934b1 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.500476 28565 tablet_replica.cc:333] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.501040 28565 raft_consensus.cc:2243] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.501442 28565 raft_consensus.cc:2272] T 1003f2d372b44f0aa07221068f4fdbd3 P 5b7a9ad7678346938272011c63630e31 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.503240 28565 tablet_replica.cc:333] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.503707 28565 raft_consensus.cc:2243] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.504412 28565 raft_consensus.cc:2272] T 2daea3d597cc4a4c8935365a2e03a23a P 5b7a9ad7678346938272011c63630e31 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.506470 28565 tablet_replica.cc:333] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.506918 28565 raft_consensus.cc:2243] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.507316 28565 raft_consensus.cc:2272] T 9a74b85acbfe4cc3bd5884201482ff4b P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.509341 28565 tablet_replica.cc:333] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31: stopping tablet replica
I20260709 13:14:07.509774 28565 raft_consensus.cc:2243] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.510185 28565 raft_consensus.cc:2272] T 8000d55e864e4f40bc76f6f61c8acfe9 P 5b7a9ad7678346938272011c63630e31 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:07.534031  5234 consensus_peers.cc:597] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e -> Peer 5b7a9ad7678346938272011c63630e31 (127.27.229.66:44483): Couldn't send request to peer 5b7a9ad7678346938272011c63630e31. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:07.550236 28565 tablet_server.cc:196] TabletServer@127.27.229.66:0 shutdown complete.
I20260709 13:14:07.582412 28565 tablet_server.cc:179] TabletServer@127.27.229.67:0 shutting down...
I20260709 13:14:07.611003 28565 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:07.611667 28565 tablet_replica.cc:333] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.612329 28565 raft_consensus.cc:2243] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.612818 28565 raft_consensus.cc:2272] T d2079268427b43698086a3f3241df795 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.614954 28565 tablet_replica.cc:333] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.615569 28565 raft_consensus.cc:2243] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.615985 28565 raft_consensus.cc:2272] T 7e301e6d29fd4569bc78544c0685685c P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.617800 28565 tablet_replica.cc:333] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.618471 28565 raft_consensus.cc:2243] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.618906 28565 raft_consensus.cc:2272] T bd1707f4d4084cb08ccfad64c28362c5 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.620859 28565 tablet_replica.cc:333] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.621464 28565 raft_consensus.cc:2243] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.621933 28565 raft_consensus.cc:2272] T 1aff5ee6b87f42a8ab1c3d7f506561a2 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.623970 28565 tablet_replica.cc:333] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.624528 28565 raft_consensus.cc:2243] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.624955 28565 raft_consensus.cc:2272] T f331ba3a1df54c029047713c03b71def P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.627135 28565 tablet_replica.cc:333] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.627677 28565 raft_consensus.cc:2243] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.628458 28565 raft_consensus.cc:2272] T 4dc6d242ddb3480aa056198e7b942d07 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.630473 28565 tablet_replica.cc:333] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.631009 28565 raft_consensus.cc:2243] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.631472 28565 raft_consensus.cc:2272] T f0813b7dde9c4fdd993078c4419be9df P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.633562 28565 tablet_replica.cc:333] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.634169 28565 raft_consensus.cc:2243] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.634627 28565 raft_consensus.cc:2272] T 139ea201bd904f1b9a8f69dcab29c2dd P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.636519 28565 tablet_replica.cc:333] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.637035 28565 raft_consensus.cc:2243] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.637501 28565 raft_consensus.cc:2272] T 805755305c3341db9b9faf4823bb827e P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.639540 28565 tablet_replica.cc:333] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.640053 28565 raft_consensus.cc:2243] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.640906 28565 raft_consensus.cc:2272] T bbfb0f61fc8542678397012b66fd6377 P 0d88c0686b8f405780417f916e2f273e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.642937 28565 tablet_replica.cc:333] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.643481 28565 raft_consensus.cc:2243] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.643913 28565 raft_consensus.cc:2272] T 1003f2d372b44f0aa07221068f4fdbd3 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.645807 28565 tablet_replica.cc:333] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.646332 28565 raft_consensus.cc:2243] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.646772 28565 raft_consensus.cc:2272] T 2daea3d597cc4a4c8935365a2e03a23a P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.648758 28565 tablet_replica.cc:333] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.649271 28565 raft_consensus.cc:2243] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.650104 28565 raft_consensus.cc:2272] T 9a74b85acbfe4cc3bd5884201482ff4b P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.652171 28565 tablet_replica.cc:333] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.652690 28565 raft_consensus.cc:2243] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.653156 28565 raft_consensus.cc:2272] T ff5ea5df379e4100a68c3589be0d9849 P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.655194 28565 tablet_replica.cc:333] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.655696 28565 raft_consensus.cc:2243] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.656117 28565 raft_consensus.cc:2272] T d436ea16af034c70bb2b2ca8eff7abcb P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.658046 28565 tablet_replica.cc:333] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.658548 28565 raft_consensus.cc:2243] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.659010 28565 raft_consensus.cc:2272] T be940b4505394de29c92782330c934b1 P 0d88c0686b8f405780417f916e2f273e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.661010 28565 tablet_replica.cc:333] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.661475 28565 raft_consensus.cc:2243] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:07.661899 28565 raft_consensus.cc:2272] T 0608bfa534fa4ad38d6ec2edfe7a442f P 0d88c0686b8f405780417f916e2f273e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.664361 28565 tablet_replica.cc:333] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e: stopping tablet replica
I20260709 13:14:07.664826 28565 raft_consensus.cc:2243] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.665602 28565 raft_consensus.cc:2272] T 8000d55e864e4f40bc76f6f61c8acfe9 P 0d88c0686b8f405780417f916e2f273e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.705595 28565 tablet_server.cc:196] TabletServer@127.27.229.67:0 shutdown complete.
I20260709 13:14:07.737427 28565 master.cc:562] Master@127.27.229.126:34401 shutting down...
I20260709 13:14:07.756217 28565 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:07.756719 28565 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:07.757010 28565 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8885e1783b4a4c5397a1b43c20016a8f: stopping tablet replica
I20260709 13:14:07.795645 28565 master.cc:584] Master@127.27.229.126:34401 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (14950 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (28277 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (262718 ms total)
[  PASSED  ] 8 tests.
I20260709 13:14:07.849001 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 378 messages since previous log ~18 seconds ago
I20260709 13:14:07.849241 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 378 messages since previous log ~18 seconds ago
I20260709 13:14:07.849409 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 376 messages since previous log ~18 seconds ago
I20260709 13:14:07.849601 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:14:07.849787 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~36 seconds ago
I20260709 13:14:07.850010 28565 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~193 seconds ago
I20260709 13:14:07.850206 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~193 seconds ago
I20260709 13:14:07.850441 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 11 messages since previous log ~0 seconds ago
I20260709 13:14:07.850724 28565 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 122 messages since previous log ~36 seconds ago
